4.7 Article

Communication-Efficient Variance-Reduced Decentralized Stochastic Optimization Over Time-Varying Directed Graphs

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Automation & Control Systems

Push-SAGA: A Decentralized Stochastic Algorithm With Variance Reduction Over Directed Graphs

Muhammad I. Qureshi et al.

Summary: Push-SAGA is a decentralized stochastic algorithm for directed networks that combines node-level variance reduction, network-level gradient tracking, and push-sum consensus. It achieves linear convergence on smooth and strongly convex problems, making it the first stochastic algorithm with linear convergence on arbitrary strongly connected directed graphs.

IEEE CONTROL SYSTEMS LETTERS (2022)

Proceedings Paper Acoustics

DECENTRALIZED OPTIMIZATION ON TIME-VARYING DIRECTED GRAPHS UNDER COMMUNICATION CONSTRAINTS

Yiyue Chen et al.

Summary: The article discusses decentralized optimization and proposes a communication-efficient algorithm for decentralized convex optimization that relies on sparsification of local updates exchanged between neighboring agents in a directed network. The algorithm achieves a convergence rate of O(lnT/root T) by locally modifying mixing matrices. Experiments validate the theoretical results and demonstrate the efficacy of the proposed algorithm.

2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021) (2021)

Article Engineering, Electrical & Electronic

Variance-Reduced Decentralized Stochastic Optimization With Accelerated Convergence

Ran Xin et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2020)

Article Automation & Control Systems

Harnessing Smoothness to Accelerate Distributed Optimization

Guannan Qu et al.

IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS (2018)

Article Computer Science, Software Engineering

Minimizing finite sums with the stochastic average gradient

Mark Schmidt et al.

MATHEMATICAL PROGRAMMING (2017)

Article Computer Science, Artificial Intelligence

On the distributed optimization over directed networks

Chenguang Xi et al.

NEUROCOMPUTING (2017)

Article Mathematics, Applied

ACHIEVING GEOMETRIC CONVERGENCE FOR DISTRIBUTED OPTIMIZATION OVER TIME-VARYING GRAPHS

Angelia Nedic et al.

SIAM JOURNAL ON OPTIMIZATION (2017)

Article Automation & Control Systems

Stochastic Gradient-Push for Strongly Convex Functions on Time-Varying Directed Graphs

Angelia Nedic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2016)

Article Automation & Control Systems

Distributed Optimization Over Time-Varying Directed Graphs

Angelia Nedic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2015)

Article Automation & Control Systems

Average Consensus on Arbitrary Strongly Connected Digraphs With Time-Varying Topologies

Kai Cai et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2014)

Article Automation & Control Systems

Average consensus on general strongly connected digraphs

Kai Cai et al.

AUTOMATICA (2012)

Article Automation & Control Systems

Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling

John C. Duchi et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2012)

Article Operations Research & Management Science

Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization

S. Sundhar Ram et al.

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2010)

Article Automation & Control Systems

Distributed Subgradient Methods for Multi-Agent Optimization

Angelia Nedic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2009)

Article Mathematics, Applied

A RANDOMIZED INCREMENTAL SUBGRADIENT METHOD FOR DISTRIBUTED OPTIMIZATION IN NETWORKED SYSTEMS

Bjorn Johansson et al.

SIAM JOURNAL ON OPTIMIZATION (2009)

Article Automation & Control Systems

Information consensus in multivehicle cooperative control

Wei Ren et al.

IEEE CONTROL SYSTEMS MAGAZINE (2007)

Article Automation & Control Systems

Consensus seeking in multiagent systems under dynamically changing interaction topologies

W Ren et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2005)

Article Automation & Control Systems

Fast linear iterations for distributed averaging

L Xiao et al.

SYSTEMS & CONTROL LETTERS (2004)

Article Automation & Control Systems

Coordination of groups of mobile autonomous agents using nearest neighbor rules

A Jadbabaie et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2003)