Silver Rate Proved Near-Optimal for Accelerated Gradient Descent
Researchers analyze how much predetermined stepsizes can speed up gradient descent in smooth convex optimization. They establish a lower bound matching the so-called silver rate, up to a doubly logarithmic correction factor. The result indicates that this rate is essentially the best achievable acceleration for the setting studied.