Journal
THEORETICAL AND COMPUTATIONAL FLUID DYNAMICS
Volume 30, Issue 6, Pages 497-510Publisher
SPRINGER
DOI: 10.1007/s00162-016-0392-y
Keywords
Closed-loop control; Reinforcement learning; Machine learning
Categories
Ask authors/readers for more resources
This work discusses a closed-loop control strategy for complex systems utilizing scarce and streaming data. A discrete embedding space is first built using hash functions applied to the sensor measurements from which a Markov process model is derived, approximating the complex system's dynamics. A control strategy is then learned using reinforcement learning once rewards relevant with respect to the control objective are identified. This method is designed for experimental configurations, requiring no computations nor prior knowledge of the system, and enjoys intrinsic robustness. It is illustrated on two systems: the control of the transitions of a Lorenz'63 dynamical system, and the control of the drag of a cylinder flow. The method is shown to perform well.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available