期刊
MATHEMATICAL PROGRAMMING
卷 127, 期 2, 页码 245-295出版社
SPRINGER HEIDELBERG
DOI: 10.1007/s10107-009-0286-5
关键词
Nonlinear optimization; Unconstrained optimization; Cubic regularization; Newton's method; Trust-region methods; Global convergence; Local convergence
类别
资金
- EPSRC [GR/S42170]
- EPSRC [EP/F005369/1, EP/E053351/1] Funding Source: UKRI
- Engineering and Physical Sciences Research Council [EP/F005369/1, EP/E053351/1] Funding Source: researchfish
An Adaptive Regularisation algorithm using Cubics (ARC) is proposed for unconstrained optimization, generalizing at the same time an unpublished method due to Griewank (Technical Report NA/12, 1981, DAMTP, University of Cambridge), an algorithm by Nesterov and Polyak (Math Program 108(1):177-205, 2006) and a proposal by Weiser et al. (Optim Methods Softw 22(3):413-431, 2007). At each iteration of our approach, an approximate global minimizer of a local cubic regularisation of the objective function is determined, and this ensures a significant improvement in the objective so long as the Hessian of the objective is locally Lipschitz continuous. The new method uses an adaptive estimation of the local Lipschitz constant and approximations to the global model-minimizer which remain computationally-viable even for large-scale problems. We show that the excellent global and local convergence properties obtained by Nesterov and Polyak are retained, and sometimes extended to a wider class of problems, by our ARC approach. Preliminary numerical experiments with small-scale test problems from the CUTEr set show encouraging performance of the ARC algorithm when compared to a basic trust-region implementation.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据