Papers
arxiv:2508.06884

Near-Optimal Convergence of Accelerated Gradient Methods under Generalized and (L_0, L_1)-Smoothness

Published on May 21
Authors:

Abstract

We study first-order methods for convex optimization problems with functions f satisfying the recently proposed ell-smoothness condition ||nabla^{2}f(x)|| le ellleft(||nabla f(x)||right), which generalizes the L-smoothness and (L_{0},L_{1})-smoothness. While accelerated gradient descent AGD is known to reach the optimal complexity O(L R / varepsilon) under L-smoothness, where varepsilon is an error tolerance and R is the distance between a starting and an optimal point, existing extensions to ell-smoothness either incur extra dependence on the initial gradient, suffer exponential factors in L_{1} R, or require costly auxiliary sub-routines, leaving open whether an AGD-type O(ell(0) R / varepsilon) rate is possible for small-varepsilon, even in the (L_{0},L_{1})-smoothness case. We resolve this open question. Leveraging a new Lyapunov function and designing new algorithms, we achieve O(ell(0) R / varepsilon) oracle complexity for small-varepsilon and virtually any ell. For instance, for (L_{0},L_{1})-smoothness, our bound O(L_0 R / varepsilon) is provably optimal in the small-varepsilon regime and removes all non-constant multiplicative factors present in prior accelerated algorithms.

Community

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2508.06884
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2508.06884 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2508.06884 in a dataset README.md to link it from this page.

Spaces citing this paper 1

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.