4.7 Article

A Second-Order Proximal Algorithm for Consensus Optimization

Journal

IEEE TRANSACTIONS ON AUTOMATIC CONTROL
Volume 66, Issue 4, Pages 1864-1871

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TAC.2020.2996205

Keywords

Convergence; Cost function; Lagrangian functions; Couplings; Machine learning algorithms; Machine learning; Consensus optimization; distributed optimization; proximal algorithm; second-order method

Funding

  1. National Natural Science Foundation of China [61603254]

Ask authors/readers for more resources

The proposed SoPro algorithm is a distributed second-order proximal algorithm that solves consensus optimization in networks. It converges linearly to the exact optimal solution when the global cost function is locally restricted strongly convex, relaxing the standard global strong convexity condition required by existing distributed optimization algorithms. Moreover, SoPro is demonstrated to be computation- and communication-efficient compared to state-of-the-art distributed second-order methods, with extensive simulations showing its competitive convergence performance.
We develop a distributed second-order proximal algorithm, referred to as SoPro, to address in-network consensus optimization. The proposed SoPro algorithm converges linearly to the exact optimal solution, provided that the global cost function is locally restricted strongly convex. This relaxes the standard global strong convexity condition required by the existing distributed optimization algorithms to establish linear convergence. In addition, we demonstrate that SoPro is computation- and communication-efficient in comparison with the state-of-the-art distributed second-order methods. Finally, extensive simulations illustrate the competitive convergence performance of SoPro.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available