4.6 Article

Proximal Splitting Algorithms for Convex Optimization: A Tour of Recent Advances, with New Twists

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Operations Research & Management Science

Primal-dual splittings as fixed point iterations in the range of linear operators

Luis Briceno-Arias et al.

Summary: In this paper, we study the convergence of the relaxed primal-dual algorithm with critical preconditioners for solving composite monotone inclusions in real Hilbert spaces. It is proven that this algorithm defines Krasnosel'skii-Mann (KM) iterations in the range of a particular monotone self-adjoint linear operator with non-trivial kernel. The convergence result is a generalization of a previous theorem and is based on the convergence of KM iterations defined in the range of linear operators under certain conditions. The Douglas-Rachford splitting (DRS) is shown to be a particular instance of the primal-dual algorithm with critical preconditioners, and classical results are recovered from this perspective.

JOURNAL OF GLOBAL OPTIMIZATION (2023)

Article Mathematics, Applied

A Direct Proof of Convergence of Davis-Yin Splitting Algorithm Allowing Larger Stepsizes

Francisco J. Aragon-Artacho et al.

Summary: This note discusses the splitting algorithm proposed by Davis and Yin and proves its convergence. It also introduces a new splitting algorithm and provides numerical experiments to showcase the importance of choosing appropriate stepsize and relaxation parameters.

SET-VALUED AND VARIATIONAL ANALYSIS (2022)

Article Operations Research & Management Science

Dualize, Split, Randomize: Toward Fast Nonsmooth Optimization Algorithms

Adil Salim et al.

Summary: The article introduces a new primal-dual algorithm PDDY for minimizing the sum of three convex functions, identifying it as the fourth missing link in this self-consistent class of algorithms. This representation allows for easier derivation of sublinear convergence rates and linear convergence results. Furthermore, new stochastic generalizations of the algorithms are proposed, with important applications in decentralized optimization.

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2022)

Article Engineering, Electrical & Electronic

Distributed Proximal Splitting Algorithms with Rates and Acceleration

Laurent Condat et al.

Summary: We analyze several generic proximal splitting algorithms suitable for large-scale convex nonsmooth optimization and derive new convergence results and accelerated versions. We also propose distributed variants of these algorithms. Our nonergodic results significantly broaden our understanding of primal-dual optimization algorithms.

FRONTIERS IN SIGNAL PROCESSING (2022)

Article Computer Science, Software Engineering

Accelerated proximal point method for maximally monotone operators

Donghwan Kim

Summary: This paper introduces an accelerated proximal point method for maximally monotone operators, with computer-assisted proof using the performance estimation problem approach. By incorporating various well-known convex optimization methods, such as the proximal method of multipliers and the alternating direction method of multipliers, the proposed acceleration technique has wide applications. Numerical experiments demonstrate the accelerating behavior of the method.

MATHEMATICAL PROGRAMMING (2021)

Article Mathematics, Applied

NONLINEAR FORWARD-BACKWARD SPLITTING WITH PROJECTION CORRECTION

Pontus Giselsson

Summary: The study introduces a versatile algorithm called Nonlinear Forward-Backward Splitting (NOFOB) for nonlinear optimization problems. By incorporating a nonlinear forward-backward map and relaxed projection onto separating hyperplanes, the algorithm generalizes standard resolvent constructions and opens up new possibilities for operator splitting methods. This new method shows linear convergence under a metric subregularity assumption, providing new insights into existing algorithms and paving the way for further developments in the field.

SIAM JOURNAL ON OPTIMIZATION (2021)

Article Engineering, Electrical & Electronic

Fixed Point Strategies in Data Science

Patrick L. Combettes et al.

Summary: This article aims to promote the use of fixed point strategies in data science, showcasing their advantage as a simplifying and unifying framework for modeling, analyzing, and solving a variety of problems. It highlights the role of fixed points in explaining the behavior of advanced convex optimization methods and recent nonlinear methods in data science. The article reviews tools of fixed point theory, describes state-of-the-art convergent algorithms, and discusses applications in various fields such as signal processing, machine learning, and neural networks.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2021)

Article Computer Science, Software Engineering

On the equivalence of the primal-dual hybrid gradient method and Douglas-Rachford splitting

Daniel O'Connor et al.

MATHEMATICAL PROGRAMMING (2020)

Article Computer Science, Software Engineering

Uniqueness of DRS as the 2 operator resolvent-splitting and impossibility of 3 operator resolvent-splitting

Ernest K. Ryu

MATHEMATICAL PROGRAMMING (2020)

Article Operations Research & Management Science

Finding the Forward-Douglas-Rachford-Forward Method

Ernest K. Ryu et al.

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2020)

Article Mathematics, Applied

Warped proximal iterations for monotone inclusions

Minh N. Bui et al.

JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS (2020)

Article Mathematics, Applied

OPERATOR SPLITTING PERFORMANCE ESTIMATION: TIGHT CONTRACTION FACTORS AND OPTIMAL PARAMETER SELECTION

Ernest K. Ryu et al.

SIAM JOURNAL ON OPTIMIZATION (2020)

Article Mathematics, Applied

A FORWARD-BACKWARD SPLITTING METHOD FOR MONOTONE INCLUSIONS WITHOUT COCOERCIVITY

Yura Malitsky et al.

SIAM JOURNAL ON OPTIMIZATION (2020)

Article Automation & Control Systems

THE DOUGLAS-RACHFORD ALGORITHM CONVERGES ONLY WEAKLY

Minh N. Bui et al.

SIAM JOURNAL ON CONTROL AND OPTIMIZATION (2020)

Article Operations Research & Management Science

A note on the forward-Douglas-Rachford splitting for monotone inclusion and convex optimization

Hugo Raguet

OPTIMIZATION LETTERS (2019)

Article Computer Science, Artificial Intelligence

A Convex Approach to Superresolution and Regularization of Lines in Images

Kevin Polisano et al.

SIAM JOURNAL ON IMAGING SCIENCES (2019)

Article Operations Research & Management Science

Analysis of Fully Preconditioned Alternating Direction Method of Multipliers with Relaxation in Hilbert Spaces

Hongpeng Sun

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2019)

Article Engineering, Electrical & Electronic

Hypercomplex Tensor Completion via Convex Optimization

Takehiko Mizoguchi et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2019)

Article Computer Science, Information Systems

Proximity Operators of Discrete Information Divergences

Mireille El Gheche et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2018)

Article Mathematics, Applied

A New Primal-Dual Algorithm for Minimizing the Sum of Three Functions with a Linear Operator

Ming Yan

JOURNAL OF SCIENTIFIC COMPUTING (2018)

Article Computer Science, Software Engineering

A simplified view of first order methods for optimization

Marc Teboulle

MATHEMATICAL PROGRAMMING (2018)

Article Computer Science, Software Engineering

Monotone operator theory in convex optimization

Patrick L. Combettes

MATHEMATICAL PROGRAMMING (2018)

Article Mathematics, Applied

A FIRST-ORDER PRIMAL-DUAL ALGORITHM WITH LINESEARCH

Yura Malitsky et al.

SIAM JOURNAL ON OPTIMIZATION (2018)

Article Mathematics, Applied

STOCHASTIC PRIMAL-DUAL HYBRID GRADIENT ALGORITHM WITH ARBITRARY SAMPLING AND IMAGING APPLICATIONS

Antonin Chambolle et al.

SIAM JOURNAL ON OPTIMIZATION (2018)

Article Mathematics, Applied

FORWARD-BACKWARD-HALF FORWARD ALGORITHM FOR SOLVING MONOTONE INCLUSIONS

Luis M. Briceno-Arias et al.

SIAM JOURNAL ON OPTIMIZATION (2018)

Article Engineering, Electrical & Electronic

Proximity Operator of a Sum of Functions; Application to Depth Map Estimation

Nelly Pustelnik et al.

IEEE SIGNAL PROCESSING LETTERS (2017)

Article Operations Research & Management Science

A Proximal Point Analysis of the Preconditioned Alternating Direction Method of Multipliers

Kristian Bredies et al.

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2017)

Article Mathematics, Applied

A Three-Operator Splitting Scheme and its Optimization Applications

Damek Davis et al.

SET-VALUED AND VARIATIONAL ANALYSIS (2017)

Article Computer Science, Artificial Intelligence

Discrete Total Variation: New Definition and Minimization

Laurent Condat

SIAM JOURNAL ON IMAGING SCIENCES (2017)

Article Operations Research & Management Science

Asymmetric forward-backward-adjoint splitting for solving monotone inclusions involving three operators

Puya Latafat et al.

COMPUTATIONAL OPTIMIZATION AND APPLICATIONS (2017)

Article Mathematics, Applied

Alternating Proximal Gradient Method for Convex Minimization

Shiqian Ma

JOURNAL OF SCIENTIFIC COMPUTING (2016)

Article Mathematics, Applied

On the Global and Linear Convergence of the Generalized Alternating Direction Method of Multipliers

Wei Deng et al.

JOURNAL OF SCIENTIFIC COMPUTING (2016)

Article Computer Science, Software Engineering

Fast projection onto the simplex and the ball

Laurent Condat

MATHEMATICAL PROGRAMMING (2016)

Article Computer Science, Software Engineering

On the ergodic convergence rates of a first-order primal-dual algorithm

Antonin Chambolle et al.

MATHEMATICAL PROGRAMMING (2016)

Article Computer Science, Artificial Intelligence

Convergence Study on the Symmetric Version of ADMM with Larger Step Sizes

Bingsheng He et al.

SIAM JOURNAL ON IMAGING SCIENCES (2016)

Article Mathematics

An introduction to continuous optimization for imaging

Antonin Chambolle et al.

ACTA NUMERICA (2016)

Article Engineering, Electrical & Electronic

Playing with Duality

Nikos Komodakis et al.

IEEE SIGNAL PROCESSING MAGAZINE (2015)

Article Operations Research & Management Science

On the Convergence of the Iterates of the Fast Iterative Shrinkage/Thresholding Algorithm

A. Chambolle et al.

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2015)

Article Operations Research & Management Science

A simple algorithm for a class of nonsmooth convex-concave saddle-point problems

Yoel Drori et al.

OPERATIONS RESEARCH LETTERS (2015)

Article Mathematics, Applied

PRECONDITIONED DOUGLAS-RACHFORD SPLITTING METHODS FOR CONVEX-CONCAVE SADDLE-POINT PROBLEMS

Kristian Bredies et al.

SIAM JOURNAL ON NUMERICAL ANALYSIS (2015)

Article Mathematics, Applied

STOCHASTIC QUASI-FEJER BLOCK-COORDINATE FIXED POINT ITERATIONS WITH RANDOM SWEEPING

Patrick L. Combettes et al.

SIAM JOURNAL ON OPTIMIZATION (2015)

Article Statistics & Probability

Proximal Algorithms in Statistics and Machine Learning

Nicholas G. Polson et al.

STATISTICAL SCIENCE (2015)

Article Computer Science, Artificial Intelligence

An Inertial Forward-Backward Algorithm for Monotone Inclusions

Dirk A. Lorenz et al.

JOURNAL OF MATHEMATICAL IMAGING AND VISION (2015)

Article Engineering, Electrical & Electronic

Convex Optimization for Big Data

Volkan Cevher et al.

IEEE SIGNAL PROCESSING MAGAZINE (2014)

Article Computer Science, Software Engineering

Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function

Peter Richtarik et al.

MATHEMATICAL PROGRAMMING (2014)

Article Computer Science, Software Engineering

Performance of first-order methods for smooth convex minimization: a novel approach

Yoel Drori et al.

MATHEMATICAL PROGRAMMING (2014)

Article Operations Research & Management Science

Variable metric forward-backward splitting with applications to monotone inclusions in duality

Patrick L. Combettes et al.

OPTIMIZATION (2014)

Article Mathematics, Applied

A splitting algorithm for dual monotone inclusions involving cocoercive operators

Bang Cong Vu

ADVANCES IN COMPUTATIONAL MATHEMATICS (2013)

Article Operations Research & Management Science

Bregman operator splitting with variable stepsize for total variation image reconstruction

Yunmei Chen et al.

COMPUTATIONAL OPTIMIZATION AND APPLICATIONS (2013)

Article Engineering, Electrical & Electronic

A Direct Algorithm for 1-D Total Variation Denoising

Laurent Condat

IEEE SIGNAL PROCESSING LETTERS (2013)

Article Operations Research & Management Science

A Primal-Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms

Laurent Condat

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2013)

Article Computer Science, Artificial Intelligence

A Generalized Forward-Backward Splitting

Hugo Raguet et al.

SIAM JOURNAL ON IMAGING SCIENCES (2013)

Article Computer Science, Artificial Intelligence

Convergence Analysis of Primal-Dual Algorithms for a Saddle-Point Problem: From Contraction Perspective

Bingsheng He et al.

SIAM JOURNAL ON IMAGING SCIENCES (2012)

Article Computer Science, Artificial Intelligence

Optimization with Sparsity-Inducing Penalties

Francis Bach et al.

FOUNDATIONS AND TRENDS IN MACHINE LEARNING (2012)

Article Computer Science, Artificial Intelligence

An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems

Manya V. Afonso et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2011)

Article Computer Science, Artificial Intelligence

Operator Splittings, Bregman Methods and Frame Shrinkage in Image Processing

Simon Setzer

INTERNATIONAL JOURNAL OF COMPUTER VISION (2011)

Article Mathematics, Applied

Tensor completion and low-n-rank tensor recovery via convex optimization

Silvia Gandy et al.

INVERSE PROBLEMS (2011)

Article Computer Science, Artificial Intelligence

A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging

Antonin Chambolle et al.

JOURNAL OF MATHEMATICAL IMAGING AND VISION (2011)

Article Mathematics, Applied

A Unified Primal-Dual Algorithm Framework Based on Bregman Iteration

Xiaoqun Zhang et al.

JOURNAL OF SCIENTIFIC COMPUTING (2011)

Article Automation & Control Systems

ON WEAK CONVERGENCE OF THE DOUGLAS-RACHFORD METHOD

B. F. Svaiter

SIAM JOURNAL ON CONTROL AND OPTIMIZATION (2011)

Article Mathematics, Applied

A MONOTONE plus SKEW SPLITTING MODEL FOR COMPOSITE MONOTONE INCLUSIONS IN DUALITY

Luis M. Briceno-Arias et al.

SIAM JOURNAL ON OPTIMIZATION (2011)

Article Computer Science, Artificial Intelligence

Restoration of Poissonian Images Using Alternating Direction Optimization

Mario A. T. Figueiredo et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2010)

Article Mathematics, Applied

Geometric Applications of the Split Bregman Method: Segmentation and Surface Reconstruction

Tom Goldstein et al.

JOURNAL OF SCIENTIFIC COMPUTING (2010)

Article Computer Science, Artificial Intelligence

A General Framework for a Class of First Order Primal-Dual Algorithms for Convex Optimization in Imaging Science

Ernie Esser et al.

SIAM JOURNAL ON IMAGING SCIENCES (2010)

Article Computer Science, Artificial Intelligence

Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models

Chunlin Wu et al.

SIAM JOURNAL ON IMAGING SCIENCES (2010)

Article Mathematics, Interdisciplinary Applications

SPLIT BREGMAN METHODS AND FRAME BASED IMAGE RESTORATION

Jian-Feng Cai et al.

MULTISCALE MODELING & SIMULATION (2009)

Article Computer Science, Artificial Intelligence

Linearized Bregman Iterations for Frame-Based Image Deblurring

Jian-Feng Cai et al.

SIAM JOURNAL ON IMAGING SCIENCES (2009)

Article Computer Science, Artificial Intelligence

The Split Bregman Method for L1-Regularized Problems

Tom Goldstein et al.

SIAM JOURNAL ON IMAGING SCIENCES (2009)

Article Computer Science, Artificial Intelligence

A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems

Amir Beck et al.

SIAM JOURNAL ON IMAGING SCIENCES (2009)

Article Mathematics, Applied

A variational formulation for frame-based inverse problems

Caroline Chaux et al.

INVERSE PROBLEMS (2007)

Article Mathematics, Interdisciplinary Applications

Signal recovery by proximal forward-backward splitting

PL Combettes et al.

MULTISCALE MODELING & SIMULATION (2005)

Article Operations Research & Management Science

Solving monotone inclusions via compositions of nonexpansive averaged operators

PL Combettes

OPTIMIZATION (2004)

Article Mathematics, Applied

Non-strictly convex minimization over the fixed point set of an asymptotically shrinking nonexpansive mapping

N Ogura et al.

NUMERICAL FUNCTIONAL ANALYSIS AND OPTIMIZATION (2002)

Article Automation & Control Systems

A modified forward-backward splitting method for maximal monotone mappings

P Tseng

SIAM JOURNAL ON CONTROL AND OPTIMIZATION (2000)