Journal
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING
Volume 236, Issue 16, Pages 3494-3504Publisher
SAGE PUBLICATIONS LTD
DOI: 10.1177/09544100221088361
Keywords
ballistic missile; guidance; maneuvering penetration; deep reinforcement learning; Markov decision process
Categories
Funding
- National Natural Science Foundation of China [12072090]
Ask authors/readers for more resources
This paper proposes a maneuvering penetration guidance strategy that balances both guidance accuracy and penetration capability through deep reinforcement learning. The simulation results show that the strategy has higher penetration probabilities and good robustness, and it can be easily applied on modern flight computers.
In this paper, a ballistic missile terminal penetration scenario is studied, which contains three participants: target, missile, and defender. The ballistic missile attempts to hit the target while evading the defender. A maneuvering penetration guidance strategy that balances both the guidance accuracy and penetration capability is proposed through deep reinforcement learning. Reward shaping and random initialization are applied to improve training speed and generalization, respectively. The proposed strategy is developed based on the twin delayed deep deterministic policy gradient algorithm. It directly maps observations to actions and is an end-to-end guidance scheme that does not require an accurate model. The simulation results show that the proposed strategy has higher penetration probabilities than conventional strategies for different initial heading errors and even for defenders with different guidance laws, which indicates its good robustness and generalization. For different initial heading errors, it has learned different maneuvering modes and has certain intelligence. In addition, it is computationally small, does not consume much memory, and can be easily applied on modern flight computers.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available