4.4 Article

Derivative-free separable quadratic modeling and cubic regularization for unconstrained optimization

Related references

Note: Only part of the references are listed.
Article Mathematics, Applied

Adaptive cubic regularization methods with dynamic inexact Hessian information and applications to finite-sum minimization

Stefania Bellavia et al.

Summary: The approach utilizes adaptive regularization with cubics to solve nonconvex optimization problems, proposing a new variant based on dynamically chosen inexact Hessian information. The theoretical analysis of the proposed procedure ensures the key property of the ARC framework, which guarantees optimal worst-case function/derivative evaluation bounds for first- and second-order critical points. Additionally, the application to large-scale finite-sum minimization based on subsampled Hessian is discussed and analyzed in a deterministic and probabilistic manner, supported by numerical experiments on synthetic and real datasets.

IMA JOURNAL OF NUMERICAL ANALYSIS (2021)

Article Computer Science, Software Engineering

Newton-type methods for non-convex optimization under inexact Hessian information

Peng Xu et al.

MATHEMATICAL PROGRAMMING (2020)

Article Operations Research & Management Science

Large-scale unconstrained optimization using separable cubic modeling and matrix-free subspace minimization

C. P. Bras et al.

COMPUTATIONAL OPTIMIZATION AND APPLICATIONS (2020)

Article Operations Research & Management Science

On global minimizers of quadratic functions with cubic regularization

Andrea Cristofari et al.

OPTIMIZATION LETTERS (2019)

Article Computer Science, Software Engineering

Global convergence rate analysis of unconstrained optimization methods based on probabilistic models

C. Cartis et al.

MATHEMATICAL PROGRAMMING (2018)

Article Operations Research & Management Science

Cubic-regularization counterpart of a variable-norm trust-region method for unconstrained minimization

J. M. Martinez et al.

JOURNAL OF GLOBAL OPTIMIZATION (2017)

Article Computer Science, Software Engineering

Worst-case evaluation complexity for unconstrained nonlinear optimization using high-order regularized models

E. G. Birgin et al.

MATHEMATICAL PROGRAMMING (2017)

Article Mathematics, Applied

ON HIGH-ORDER MODEL REGULARIZATION FOR CONSTRAINED OPTIMIZATION

Jose Mario Martinez

SIAM JOURNAL ON OPTIMIZATION (2017)

Article Operations Research & Management Science

On the optimal order of worst case complexity of direct search

M. Dodangeh et al.

OPTIMIZATION LETTERS (2016)

Article Mathematics, Applied

TRUST-REGION METHODS WITHOUT USING DERIVATIVES: WORST CASE COMPLEXITY AND THE NONSMOOTH CASE

R. Garmanjani et al.

SIAM JOURNAL ON OPTIMIZATION (2016)

Article Operations Research & Management Science

Separable cubic modeling and a trust-region strategy for unconstrained minimization with impact in global optimization

J. M. Martinez et al.

JOURNAL OF GLOBAL OPTIMIZATION (2015)

Article Operations Research & Management Science

Algebraic rules for quadratic regularization of Newton's method

Elizabeth W. Karas et al.

COMPUTATIONAL OPTIMIZATION AND APPLICATIONS (2015)

Article Operations Research & Management Science

CUTEst: a Constrained and Unconstrained Testing Environment with safe threads for mathematical optimization

Nicholas I. M. Gould et al.

COMPUTATIONAL OPTIMIZATION AND APPLICATIONS (2015)

Article Computer Science, Software Engineering

On the convergence and worst-case complexity of trust-region and regularization methods for unconstrained optimization

Geovani N. Grapiglia et al.

MATHEMATICAL PROGRAMMING (2015)

Article Operations Research & Management Science

Worst case complexity of direct search

L. N. Vicente

EURO JOURNAL ON COMPUTATIONAL OPTIMIZATION (2013)

Article Operations Research & Management Science

A trust region algorithm with adaptive cubic regularization methods for nonsmooth convex minimization

Sha Lu et al.

COMPUTATIONAL OPTIMIZATION AND APPLICATIONS (2012)

Article Computer Science, Software Engineering

Computation of sparse low degree interpolating polynomials and their application to derivative-free optimization

A. S. Bandeira et al.

MATHEMATICAL PROGRAMMING (2012)

Article Mathematics, Applied

ON THE ORACLE COMPLEXITY OF FIRST-ORDER AND DERIVATIVE-FREE ALGORITHMS FOR SMOOTH NONCONVEX MINIMIZATION

Coralia Cartis et al.

SIAM JOURNAL ON OPTIMIZATION (2012)

Article Computer Science, Software Engineering

Adaptive cubic regularisation methods for unconstrained optimization. Part I: motivation, convergence and numerical results

Coralia Cartis et al.

MATHEMATICAL PROGRAMMING (2011)

Article Operations Research & Management Science

Incorporating minimum Frobenius norm models in direct search

A. L. Custodio et al.

COMPUTATIONAL OPTIMIZATION AND APPLICATIONS (2010)

Article Mathematics, Applied

SELF-CORRECTING GEOMETRY IN MODEL-BASED ALGORITHMS FOR DERIVATIVE-FREE UNCONSTRAINED OPTIMIZATION

K. Scheinberg et al.

SIAM JOURNAL ON OPTIMIZATION (2010)

Article Computer Science, Software Engineering

On the geometry phase in model-based algorithms for derivative-free optimization

Giovanni Fasano et al.

OPTIMIZATION METHODS & SOFTWARE (2009)

Article Mathematics, Applied

GLOBAL CONVERGENCE OF GENERAL DERIVATIVE-FREE TRUST-REGION ALGORITHMS TO FIRST- AND SECOND-ORDER CRITICAL POINTS

Andrew R. Conn et al.

SIAM JOURNAL ON OPTIMIZATION (2009)

Article Mathematics, Applied

BENCHMARKING DERIVATIVE-FREE OPTIMIZATION ALGORITHMS

Jorge J. More et al.

SIAM JOURNAL ON OPTIMIZATION (2009)

Article Mathematics, Applied

Geometry of sample sets in derivative-free optimization: polynomial regression and underdetermined interpolation

Andrew R. Conn et al.

IMA JOURNAL OF NUMERICAL ANALYSIS (2008)

Article Computer Science, Software Engineering

Geometry of interpolation sets in derivative free optimization

A. R. Conn et al.

MATHEMATICAL PROGRAMMING (2008)

Article Computer Science, Software Engineering

Cubic regularization of Newton method and its global performance

Yurii Nesterov et al.

MATHEMATICAL PROGRAMMING (2006)

Article Computer Science, Software Engineering

Benchmarking optimization software with performance profiles

ED Dolan et al.

MATHEMATICAL PROGRAMMING (2002)