4.6 Article

CONVERGENCE RATES OF DAMPED INERTIAL DYNAMICS UNDER GEOMETRIC CONDITIONS AND PERTURBATIONS

Journal

SIAM JOURNAL ON OPTIMIZATION
Volume 30, Issue 3, Pages 1850-1877

Publisher

SIAM PUBLICATIONS
DOI: 10.1137/19M1272767

Keywords

Lyapunov functions; rate of convergence; ODEs; optimization; Lojasiewicz property

Funding

  1. ANR GOTMI [ANR-16-VCE33-0010-01]
  2. [ANR-11-LABX-0040-CIMI]
  3. [ANR-11-IDEX-0002-02]

Ask authors/readers for more resources

In this article a family of second-order ODEs associated with the inertial gradient descent is studied. These ODEs are widely used to build trajectories converging to a minimizer x* of a function F, possibly convex. This family includes the continuous version of the Nesterov inertial scheme and the continuous heavy ball method. Several damping parameters, not necessarily vanishing, and a perturbation term g are thus considered. The damping parameter is linked to the inertia of the associated inertial scheme and the perturbation term g is linked to the error that can be made on the gradient of the function F. This article presents new asymptotic bounds on F(x(t)) - F(x*), where x is a solution of the ODE, when F is convex and satisfies local geometrical properties such as Lojasiewicz properties and under integrability conditions on g. Even if geometrical properties and perturbations were already studied for most ODEs of these families, it is the first time they are jointly studied. All these results give an insight on the behavior of these inertial and perturbed algorithms if F satisfies some Lojasiewicz properties especially in the setting of stochastic algorithms.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available