4.7 Article

Artificial Intelligence: Can Seemingly Collusive Outcomes Be Avoided?

Journal

MANAGEMENT SCIENCE
Volume -, Issue -, Pages -

Publisher

INFORMS
DOI: 10.1287/mnsc.2022.4623

Keywords

machine learning; multiagent reinforcement learning; algorithmic decision making; tacit collusion; decentralized power systems

Ask authors/readers for more resources

Algorithmic decisions are increasingly used for strategic decision-making and can lead to seemingly collusive behavior in the absence of formal communication. However, studies suggest that this collusion may result from imperfect exploration rather than excessive algorithmic sophistication. Through a study on battery operations, it is observed that regulators can discipline the market to achieve socially desirable outcomes by enforcing decentralized learning or intervening during the learning process.
Strategic decisions are increasingly delegated to algorithms. We extend previous results of the algorithmic collusion literature to the context of dynamic optimization with imperfect monitoring by analyzing a setting where a limited number of agents use simple and independent machine-learning algorithms to buy and sell a storable good. No specific instruction is given to them, only that their objective is to maximize profits based solely on past market prices and payoffs. With an original application to battery operations, we observe that the algorithms learn quickly to reach seemingly collusive decisions, despite the absence of any formal communication between them. Building on the findings of the existing literature on algorithmic collusion, we show that seeming collusion could originate in imperfect exploration rather than excessive algorithmic sophistication. We then show that a regulator may succeed in disciplining the market to produce socially desirable outcomes by enforcing decentralized learning or with adequate intervention during the learning process.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available