4.6 Article

Distributed stochastic gradient tracking methods

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Automation & Control Systems

Push-Pull Gradient Methods for Distributed Optimization in Networks

Shi Pu et al.

Summary: In this article, a distributed convex optimization approach is introduced, which achieves minimal cost functions through the push-pull gradient method for information exchange between nodes in a network. Experimental results demonstrate that this algorithm exhibits linear convergence in various network architectures, especially showing significant performance in random-gossip settings.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2021)

Article Computer Science, Software Engineering

Communication-efficient algorithms for decentralized and stochastic optimization

Guanghui Lan et al.

MATHEMATICAL PROGRAMMING (2020)

Article Automation & Control Systems

Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization

N. S. Aybat et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2018)

Article Management

A Flocking-Based Approach for Distributed Stochastic Optimization

Shi Pu et al.

OPERATIONS RESEARCH (2018)

Article Engineering, Electrical & Electronic

Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization

Angelia Nedic et al.

PROCEEDINGS OF THE IEEE (2018)

Article Mathematics, Applied

DECENTRALIZED CONSENSUS ALGORITHM WITH DELAYED AND STOCHASTIC GRADIENTS

Benjamin Sirb et al.

SIAM JOURNAL ON OPTIMIZATION (2018)

Article Automation & Control Systems

SWARMING FOR FASTER CONVERGENCE IN STOCHASTIC OPTIMIZATION

Shi Pu et al.

SIAM JOURNAL ON CONTROL AND OPTIMIZATION (2018)

Article Automation & Control Systems

Harnessing Smoothness to Accelerate Distributed Optimization

Guannan Qu et al.

IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS (2018)

Article Automation & Control Systems

On Projected Stochastic Gradient Descent Algorithm with Weighted Averaging for Least Squares Regression

Kobi Cohen et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2017)

Article Automation & Control Systems

Fast Convergence Rates for Distributed Non-Bayesian Learning

Angelia Nedic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2017)

Article Automation & Control Systems

Distributed Learning Algorithms for Spectrum Sharing in Spatial Random Access Wireless Networks

Kobi Cohen et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2017)

Article Mathematics, Applied

ACHIEVING GEOMETRIC CONVERGENCE FOR DISTRIBUTED OPTIMIZATION OVER TIME-VARYING GRAPHS

Angelia Nedic et al.

SIAM JOURNAL ON OPTIMIZATION (2017)

Article Engineering, Multidisciplinary

Stochastic Subgradient Algorithms for Strongly Convex Optimization Over Distributed Networks

Muhammed O. Sayin et al.

IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING (2017)

Article Automation & Control Systems

Noise Reduction by Swarming in Social Foraging

Shi Pu et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2016)

Article Automation & Control Systems

Asynchronous Gossip-Based Random Projection Algorithms Over Networks

Soomin Lee et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2016)

Article Automation & Control Systems

A Distributed Algorithm for Convex Constrained Optimization Under Noise

Nikolaos Chatzipanagiotis et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2016)

Article Automation & Control Systems

Stochastic Gradient-Push for Strongly Convex Functions on Time-Varying Directed Graphs

Angelia Nedic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2016)

Article Automation & Control Systems

NONLINEAR GOSSIP

Adwaitvedant S. Mathkar et al.

SIAM JOURNAL ON CONTROL AND OPTIMIZATION (2016)

Article Engineering, Electrical & Electronic

NEXT: In-Network Nonconvex Optimization

Paolo Di Lorenzo et al.

IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS (2016)

Article Computer Science, Information Systems

On the Learning Behavior of Adaptive Networks-Part I: Transient Analysis

Jianshu Chen et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2015)

Article Computer Science, Information Systems

On the Learning Behavior of Adaptive Networks-Part II: Performance Analysis

Jianshu Chen et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2015)

Article Engineering, Electrical & Electronic

DLM: Decentralized Linearized Alternating Direction Method of Multipliers

Qing Ling et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2015)

Article Mathematics, Applied

EXTRA: AN EXACT FIRST-ORDER ALGORITHM FOR DECENTRALIZED CONSENSUS OPTIMIZATION

Wei Shi et al.

SIAM JOURNAL ON OPTIMIZATION (2015)

Article Computer Science, Software Engineering

An augmented Lagrangian method for distributed optimization

Nikolaos Chatzipanagiotis et al.

MATHEMATICAL PROGRAMMING (2015)

Article Engineering, Electrical & Electronic

Proximal-Gradient Algorithms for Tracking Cascades Over Social Networks

Brian Baingana et al.

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING (2014)

Article Automation & Control Systems

Fast Distributed Gradient Methods

Dusan Jakovetic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2014)

Article Engineering, Electrical & Electronic

Adaptive Penalty-Based Distributed Stochastic Convex Optimization

Zaid J. Towfic et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2014)

Article Engineering, Electrical & Electronic

Adaptive Networks

Ali H. Sayed

PROCEEDINGS OF THE IEEE (2014)

Article Engineering, Electrical & Electronic

A Distributed Subgradient Method for Dynamic Convex Optimization Problems Under Noisy Information Exchange

Renato L. G. Cavalcante et al.

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING (2013)

Article Automation & Control Systems

Convergence of a Multi-Agent Projected Stochastic Gradient Algorithm for Non-Convex Optimization

Pascal Bianchi et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2013)

Article Automation & Control Systems

Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling

John C. Duchi et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2012)

Article Engineering, Electrical & Electronic

Distributed Recursive Least-Squares: Stability and Performance Analysis

Gonzalo Mateos et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2012)

Article Engineering, Electrical & Electronic

Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks

Jianshu Chen et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2012)

Article Engineering, Electrical & Electronic

Distributed Asynchronous Constrained Stochastic Optimization

Kunal Srivastava et al.

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING (2011)

Article Automation & Control Systems

Gossip Algorithms for Convex Consensus Optimization Over Networks

Jie Lu et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2011)

Article Computer Science, Software Engineering

Distributed multi-agent optimization with state-dependent communication

Ilan Lobel et al.

MATHEMATICAL PROGRAMMING (2011)

Article Automation & Control Systems

Constrained Consensus and Optimization in Multi-Agent Networks

Angelia Nedic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2010)

Article Operations Research & Management Science

Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization

S. Sundhar Ram et al.

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2010)

Article Automation & Control Systems

Distributed Subgradient Methods for Multi-Agent Optimization

Angelia Nedic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2009)

Article Mathematics, Applied

ROBUST STOCHASTIC APPROXIMATION APPROACH TO STOCHASTIC PROGRAMMING

A. Nemirovski et al.

SIAM JOURNAL ON OPTIMIZATION (2009)

Article Multidisciplinary Sciences

Multi-fidelity optimization via surrogate modelling

Alexander I. J. Forrester et al.

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2007)

Article Computer Science, Information Systems

Randomized gossip algorithms

Stephen Boyd et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2006)