Journal
EUROPEAN PHYSICAL JOURNAL E
Volume 46, Issue 3, Pages -Publisher
SPRINGER
DOI: 10.1140/epje/s10189-023-00271-0
Keywords
-
Ask authors/readers for more resources
This study tackles the problem of optimizing both the dispersion rate and control activation cost for two active particles in 2D complex flows using multi-objective reinforcement learning (MORL) with variable swimming velocity. The combination of scalarization techniques and Q-learning algorithm enables MORL to find an optimal Pareto frontier and outperform heuristic strategies as benchmarks. Moreover, the authors investigate the impact of decision time on the performance of the reinforcement learning strategies, highlighting the need for enhanced knowledge of the flow for longer decision times.
We consider the problem of two active particles in 2D complex flows with the multi-objective goals of minimizing both the dispersion rate and the control activation cost of the pair. We approach the problem by means of multi-objective reinforcement learning (MORL), combining scalarization techniques together with a Q-learning algorithm, for Lagrangian drifters that have variable swimming velocity. We show that MORL is able to find a set of trade-off solutions forming an optimal Pareto frontier. As a benchmark, we show that a set of heuristic strategies are dominated by the MORL solutions. We consider the situation in which the agents cannot update their control variables continuously, but only after a discrete (decision) time, tau. We show that there is a range of decision times, in between the Lyapunov time and the continuous updating limit, where reinforcement learning finds strategies that significantly improve over heuristics. In particular, we discuss how large decision times require enhanced knowledge of the flow, whereas for smaller tau all a priori heuristic strategies become Pareto optimal.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available