4.5 Article

Time-varying dual accelerated gradient ascent: A fast network optimization algorithm

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Automation & Control Systems

Differentially Private Distributed Optimization via State and Direction Perturbation in Multiagent Systems

Tie Ding et al.

Summary: This article studies the problem of achieving convergence and differential privacy in distributed optimization algorithms. It proposes the Distributed algorithm via Direction and State Perturbation (DiaDSP) which perturbs both states and directions using decaying Laplace noise. The algorithm is shown to achieve convergence in mean and almost surely, even with a constant stepsize. It also establishes the optimal stepsize for the fastest convergence rate and describes the tradeoff between differential privacy and convergence accuracy.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2022)

Article Automation & Control Systems

Push-Pull Gradient Methods for Distributed Optimization in Networks

Shi Pu et al.

Summary: In this article, a distributed convex optimization approach is introduced, which achieves minimal cost functions through the push-pull gradient method for information exchange between nodes in a network. Experimental results demonstrate that this algorithm exhibits linear convergence in various network architectures, especially showing significant performance in random-gossip settings.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2021)

Article Automation & Control Systems

A Nesterov-Like Gradient Tracking Algorithm for Distributed Optimization Over Directed Networks

Qingguo Lu et al.

Summary: This article focuses on dealing with distributed optimization over a directed network using a method called D-DNGT, which integrates gradient tracking into the Nesterov method with nonuniform step-sizes. Numerical experiments show that D-DNGT can converge linearly to the optimal solution under certain conditions.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2021)

Article Automation & Control Systems

Privacy Masking Stochastic Subgradient-Push Algorithm for Distributed Online Optimization

Qingguo Lu et al.

Summary: This article introduces a differentially private-distributed stochastic subgradient-push algorithm (DP-DSSP) to address distributed online optimization problems while protecting the privacy of participating units and optimizing the global cost function. The algorithm has important features in tackling optimization problems in time-varying unbalanced directed networks, and theoretical analysis shows that it effectively masks differential privacy and achieves sublinear regrets. Additionally, the algorithm can handle arbitrarily large but uniformly bounded delays in communication links.

IEEE TRANSACTIONS ON CYBERNETICS (2021)

Article Automation & Control Systems

S-ADDOPT: Decentralized Stochastic First-Order Optimization Over Directed Graphs

Muhammad Qureshi et al.

Summary: The study introduces the S-ADDOPT algorithm, which improves decentralized stochastic optimization by utilizing gradient tracking to minimize a sum of distributed cost functions over a directed network of nodes. Experimental results demonstrate the algorithm's good convergence behavior on both strongly convex and non-convex problems.

IEEE CONTROL SYSTEMS LETTERS (2021)

Article Engineering, Multidisciplinary

Achieving Acceleration for Distributed Economic Dispatch in Smart Grids Over Directed Networks

Qingguo Lu et al.

IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING (2020)

Article Engineering, Electrical & Electronic

Supervised Learning Under Distributed Features

Bicheng Ying et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2019)

Article Mathematics, Applied

DISTRIBUTED DETERMINISTIC ASYNCHRONOUS ALGORITHMS IN TIME-VARYING GRAPHS THROUGH DYKSTRA SPLITTING

C. H. Jeffrey Pang

SIAM JOURNAL ON OPTIMIZATION (2019)

Article Automation & Control Systems

Fenchel Dual Gradient Methods for Distributed Convex Optimization Over Time-Varying Networks

Xuyang Wu et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2019)

Article Engineering, Electrical & Electronic

Exact Diffusion for Distributed Optimization and Learning-Part II: Convergence Analysis

Kun Yuan et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2019)

Article Engineering, Electrical & Electronic

Exact Diffusion for Distributed Optimization and Learning-Part I: Algorithm Development

Kun Yuan et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2019)

Article Automation & Control Systems

DEXTRA: A Fast Algorithm for Optimization Over Directed Graphs

Chenguang Xi et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2017)

Article Engineering, Electrical & Electronic

Stochastic Proximal Gradient Consensus Over Random Networks

Mingyi Hong et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2017)

Article Mathematics, Applied

ACHIEVING GEOMETRIC CONVERGENCE FOR DISTRIBUTED OPTIMIZATION OVER TIME-VARYING GRAPHS

Angelia Nedic et al.

SIAM JOURNAL ON OPTIMIZATION (2017)

Article Automation & Control Systems

Distributed Estimation of All the Eigenvalues and Eigenvectors of Matrices Associated With Strongly Connected Digraphs

Azwirman Gusrialdi et al.

IEEE CONTROL SYSTEMS LETTERS (2017)

Article Engineering, Electrical & Electronic

Distributed Gradient Methods with Variable Number of Working Nodes

Dusan Jakovetic et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2016)

Article Automation & Control Systems

Distributed Optimization Over Time-Varying Directed Graphs

Angelia Nedic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2015)

Article Engineering, Electrical & Electronic

Dictionary Learning Over Distributed Models

Jianshu Chen et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2015)

Article Engineering, Electrical & Electronic

Multi-Agent Distributed Optimization via Inexact Consensus ADMM

Tsung-Hui Chang et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2015)

Article Mathematics, Applied

EXTRA: AN EXACT FIRST-ORDER ALGORITHM FOR DECENTRALIZED CONSENSUS OPTIMIZATION

Wei Shi et al.

SIAM JOURNAL ON OPTIMIZATION (2015)

Article Automation & Control Systems

Distributed estimation of Laplacian eigenvalues via constrained consensus optimization problems

Thi-Minh-Dung Tran et al.

SYSTEMS & CONTROL LETTERS (2015)

Article Automation & Control Systems

Fast Distributed Gradient Methods

Dusan Jakovetic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2014)

Article Engineering, Electrical & Electronic

On the Linear Convergence of the ADMM in Decentralized Consensus Optimization

Wei Shi et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2014)

Article Automation & Control Systems

Decentralized estimation of Laplacian eigenvalues in multi-agent systems

Mauro Franceschelli et al.

AUTOMATICA (2013)

Article Automation & Control Systems

Constrained Consensus and Optimization in Multi-Agent Networks

Angelia Nedic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2010)

Article Engineering, Electrical & Electronic

Distributed Sparse Linear Regression

Gonzalo Mateos et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2010)

Article Operations Research & Management Science

Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization

S. Sundhar Ram et al.

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2010)

Article Automation & Control Systems

Distributed Subgradient Methods for Multi-Agent Optimization

Angelia Nedic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2009)

Article Engineering, Electrical & Electronic

Distributed Consensus Algorithms in Sensor Networks With Imperfect Communication: Link Failures and Channel Noise

Soummya Kar et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2009)

Article Operations Research & Management Science

Optimal scaling of a gradient method for distributed resource allocation

L. Xiao et al.

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2006)

Article Computer Science, Information Systems

Randomized gossip algorithms

Stephen Boyd et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2006)

Article Computer Science, Software Engineering

Benchmarking optimization software with performance profiles

ED Dolan et al.

MATHEMATICAL PROGRAMMING (2002)