Journal
MANAGEMENT SCIENCE
Volume -, Issue -, Pages -Publisher
INFORMS
DOI: 10.1287/mnsc.2022.4623
Keywords
machine learning; multiagent reinforcement learning; algorithmic decision making; tacit collusion; decentralized power systems
Ask authors/readers for more resources
Algorithmic decisions are increasingly used for strategic decision-making and can lead to seemingly collusive behavior in the absence of formal communication. However, studies suggest that this collusion may result from imperfect exploration rather than excessive algorithmic sophistication. Through a study on battery operations, it is observed that regulators can discipline the market to achieve socially desirable outcomes by enforcing decentralized learning or intervening during the learning process.
Strategic decisions are increasingly delegated to algorithms. We extend previous results of the algorithmic collusion literature to the context of dynamic optimization with imperfect monitoring by analyzing a setting where a limited number of agents use simple and independent machine-learning algorithms to buy and sell a storable good. No specific instruction is given to them, only that their objective is to maximize profits based solely on past market prices and payoffs. With an original application to battery operations, we observe that the algorithms learn quickly to reach seemingly collusive decisions, despite the absence of any formal communication between them. Building on the findings of the existing literature on algorithmic collusion, we show that seeming collusion could originate in imperfect exploration rather than excessive algorithmic sophistication. We then show that a regulator may succeed in disciplining the market to produce socially desirable outcomes by enforcing decentralized learning or with adequate intervention during the learning process.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available