papersTODAY 04:00 UTC
Multi-Objective Hyperparameter Search Using Damped Gauss-Newton Optimization
A new arXiv paper reframes hyperparameter optimization as a numerical optimization problem rather than a sequence of independent trials. The authors propose a multi-objective, damped Gauss-Newton search method that estimates a finite-difference-based model of the objective landscape. The work is a replacement cross-list submission on arXiv's machine learning section.