4.6 Article

Lower bounds for non-convex stochastic optimization

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Computer Science, Software Engineering

Lower bounds for finding stationary points II: first-order methods

Yair Carmon et al.

Summary: In this study, lower bounds are established on the complexity of finding similar to-stationary points of smooth, non-convex high-dimensional functions using first-order methods. It is proven that deterministic first-order methods cannot achieve convergence rates better than certain limits, with accelerated gradient descent performing better for convex functions with Lipschitz gradient.

MATHEMATICAL PROGRAMMING (2021)

Article Computer Science, Theory & Methods

A Geometric Analysis of Phase Retrieval

Ju Sun et al.

FOUNDATIONS OF COMPUTATIONAL MATHEMATICS (2018)

Article Mathematics, Applied

Optimization Methods for Large-Scale Machine Learning

Leon Bottou et al.

SIAM REVIEW (2018)

Article Computer Science, Information Systems

Lower Bounds on the Oracle Complexity of Nonsmooth Convex Optimization via Information Theory

Gabor Braun et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2017)

Article Mathematics, Applied

STOCHASTIC FIRST- AND ZEROTH-ORDER METHODS FOR NONCONVEX STOCHASTIC PROGRAMMING

Saeed Ghadimi et al.

SIAM JOURNAL ON OPTIMIZATION (2013)

Article Computer Science, Information Systems

Information-Theoretic Lower Bounds on the Oracle Complexity of Stochastic Convex Optimization

Alekh Agarwal et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2012)

Article Computer Science, Theory & Methods

Complexity bounds for second-order optimality in unconstrained optimization

C. Cartis et al.

JOURNAL OF COMPLEXITY (2012)

Article Computer Science, Information Systems

Information-Based Complexity, Feedback and Dynamics in Convex Programming

Maxim Raginsky et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2011)

Article Computer Science, Software Engineering

Cubic regularization of Newton method and its global performance

Yurii Nesterov et al.

MATHEMATICAL PROGRAMMING (2006)