papersSEP 11 04:00 UTC
Paper Proposes Langevin Gradient Descent for Data-Driven Hyperparameter Tuning
A new arXiv preprint introduces the Langevin Gradient Descent Algorithm (LGD), which approximates the mean of a posterior distribution defined by a regression problem's loss function and regularizer in order to tune gradient descent hyperparameters. The authors frame this as a learning-to-learn problem and provide generalization guarantees for the approach. The work targets data-driven tuning of optimization settings rather than hand-selected values.