4.6 Article

Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity

Journal

MATHEMATICAL PROGRAMMING
Volume 168, Issue 1-2, Pages 123-175

Publisher

SPRINGER HEIDELBERG
DOI: 10.1007/s10107-016-0992-8

Keywords

Convex optimization; Fast convergent methods; Dynamical systems; Gradient flows; Inertial dynamics; Vanishing viscosity; Nesterov method

Funding

  1. Air Force Office of Scientific Research, Air Force Material Command, USAF [FA9550-14-1-0056]
  2. Fondecyt [1140829]
  3. Conicyt Anillo [ACT-1106]
  4. ECOS-Conicyt [C13E03]
  5. Millenium Nucleus ICM/FIC [RC130003]
  6. Conicyt Project MATHAMSUD [15MATH-02]
  7. Conicyt Redes [140183]
  8. Basal Project CMM Universidad de Chile

Ask authors/readers for more resources

In a Hilbert space setting H, we study the fast convergence properties as t -> +infinity of the trajectories of the second-order differential equation x(t) + alpha/t(x) over dot(t) + del Phi(x(t)) = g(t), where del Phi is the gradient of a convex continuously differentiable function Phi : H -> R, alpha is a positive parameter, and g : [t(0),+infinity[-> H is a small perturbation term. In this inertial system, the viscous damping coefficient alpha/t vanishes asymptotically, but not too rapidly. For alpha >= 3, and integral(+infinity)(t0) t parallel to g(t)parallel to dt < +infinity, just assuming that argmin Phi not equal theta, we show that any trajectory of the above system satisfies the fast convergence property Phi(x(t)) - min(H) Phi <= C/t(2). Moreover, for alpha > 3, any trajectory converges weakly to a minimizer of Phi. The strong convergence is established in various practical situations. These results complement the O(t(-2)) rate of convergence for the values obtained by Su, Boyd and Candes in the unperturbed case g = 0. Time discretization of this system, and some of its variants, provides new fast converging algorithms, expanding the field of rapid methods for structured convex minimization introduced by Nesterov, and further developed by Beck and Teboulle with FISTA. This study also complements recent advances due to Chambolle and Dossal.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available