4.7 Article

Distributed consensus-based multi-agent temporal-difference learning

Related references

Note: Only part of the references are listed.
Article Automation & Control Systems

Distributed Value Function Approximation for Collaborative Multiagent Reinforcement Learning

Milos S. Stankovic et al.

Summary: This article proposes novel distributed gradient-based temporal-difference algorithms for multiagent off-policy learning of linear approximation of the value function in Markov decision processes with strict information structure constraints. The algorithms consist of local parameter updates and linear stochastic time-varying consensus schemes, with differences in form, eligibility traces, time scales, and consensus iterations. The main contribution is a convergence analysis based on Feller-Markov processes and stochastic consensus models, demonstrating weak convergence properties and variance reduction effects of the algorithms.

IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS (2021)

Article Engineering, Electrical & Electronic

A General Framework for Decentralized Optimization With First-Order Methods

Ran Xin et al.

PROCEEDINGS OF THE IEEE (2020)

Proceedings Paper Automation & Control Systems

Distributed Value-Function Learning with Linear Convergence Rates

Lucas Cassano et al.

2019 18TH EUROPEAN CONTROL CONFERENCE (ECC) (2019)

Article Computer Science, Interdisciplinary Applications

Reinforcement Learning for UAV Attitude Control

William Koch et al.

ACM TRANSACTIONS ON CYBER-PHYSICAL SYSTEMS (2019)

Article Automation & Control Systems

Distributed time synchronization for networks with random delays and measurement noise

Milos S. Stankovic et al.

AUTOMATICA (2018)

Article Automation & Control Systems

Asynchronous Distributed Blind Calibration of Sensor Networks Under Noisy Measurements

Milos S. Stankovic et al.

IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS (2018)

Article Automation & Control Systems

Distributed Reinforcement Learning via Gossip

Adwaitvedant Mathkar et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2017)

Article Automation & Control Systems

Distributed model based event-triggered control for synchronization of multi-agent systems

Davide Liuzza et al.

AUTOMATICA (2016)

Article Automation & Control Systems

Optimal dynamic formation control of multi-agent systems in constrained environments

Xinmiao Sun et al.

AUTOMATICA (2016)

Article Automation & Control Systems

Distributed Stochastic Approximation: Weak Convergence and Network Design

Milos S. Stankovic et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2016)

Article Automation & Control Systems

Consensus-based decentralized real-time identification of large-scale systems

Milos S. Stankovic et al.

AUTOMATICA (2015)

Article Automation & Control Systems

Distributed Policy Evaluation Under Multiple Behavior Strategies

Sergio Valcarcel Macua et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2015)

Article Computer Science, Theory & Methods

Application of reinforcement learning to wireless sensor networks: models and algorithms

Kok-Lim Alvin Yau et al.

COMPUTING (2015)

Article Engineering, Electrical & Electronic

QD-Learning: A Collaborative Distributed Strategy for Multi-Agent Reinforcement Learning Through Consensus plus Innovations

Soummya Kar et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2013)

Article Automation & Control Systems

Consensus based overlapping decentralized estimation with missing observations and communication faults

Srdjan S. Stankovic et al.

AUTOMATICA (2009)

Review Computer Science, Artificial Intelligence

A comprehensive survey of multiagent reinforcement learning

Lucian Busoniu et al.

IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS (2008)