4.7 Article

Intelligent Game Strategies in Target-Missile-Defender Engagement Using Curriculum-Based Deep Reinforcement Learning

Related references

Note: Only part of the references are listed.
Article Engineering, Aerospace

Cooperative guidance for active defence based on line-of-sight constraint under a low-speed ratio

S. Liu et al.

Summary: In this study, an active defence cooperative guidance law was designed to enable low-speed and low-maneuverability defence missiles to accurately intercept high-speed and high-maneuverability attack missiles. The proposed guidance law adjusts the geometric relationship between the attack missile, defence missile and aircraft to achieve active defence. Simulations were carried out to verify the effectiveness and robustness of the law.

AERONAUTICAL JOURNAL (2023)

Article Automation & Control Systems

Model-free finite-horizon optimal control of discrete-time two-player zero-sum games

Wei Wang et al.

Summary: In this paper, a Q-function-based finite-time control method is introduced to approximate the solutions of the time-varying Riccati equations in the case of unknown system dynamics. The time-varying Q-function and a model-free method are used to represent and approximate the solutions, respectively. Simulation studies validate the effectiveness of the developed method.

INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE (2023)

Article Engineering, Aerospace

Cooperative differential games guidance laws for multiple attackers against an active defense target

Fei Liu et al.

Summary: This paper discusses a scenario where multiple attackers try to intercept a target with active defense. The paper proposes a game model and an optimization method to design cooperative guidance laws for the attackers. Numerical simulations are conducted to validate the effectiveness of the proposed laws.

CHINESE JOURNAL OF AERONAUTICS (2022)

Article Automation & Control Systems

Model predictive guidance for active aircraft protection from a homing missile

Heng Shi et al.

Summary: This paper introduces a novel guidance law based on model predictive control to protect an aircraft from missiles, converting a three-body engagement into a one-on-one encounter and predicting the interception point effectively. Numerical simulations validate the efficiency and effectiveness of the algorithm.

IET CONTROL THEORY AND APPLICATIONS (2022)

Article Computer Science, Artificial Intelligence

Curriculum Learning: A Survey

Petru Soviany et al.

Summary: Curriculum learning is widely used in machine learning to enhance performance by training models in a meaningful order. However, there are challenges in ranking samples and introducing more difficult data, which require further research.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2022)

Article Engineering, Aerospace

Maneuvering penetration strategies of ballistic missiles based on deep reinforcement learning

Xiaoqi Qiu et al.

Summary: This paper proposes a maneuvering penetration guidance strategy that balances both guidance accuracy and penetration capability through deep reinforcement learning. The simulation results show that the strategy has higher penetration probabilities and good robustness, and it can be easily applied on modern flight computers.

PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING (2022)

Article Computer Science, Artificial Intelligence

Attitude control for hypersonic reentry vehicles: An efficient deep reinforcement learning method

Yiheng Liu et al.

Summary: This paper proposes a deep reinforcement learning anti-disturbance control method for the attitude control problem of hypersonic reentry vehicles. By introducing a compound control framework, a novel value function approximation mechanism, and a result-oriented encoder, the nonlinearities, coupling, and uncertainties in attitude control are effectively addressed. Abundant numerical simulations demonstrate the effectiveness of the proposed method.

APPLIED SOFT COMPUTING (2022)

Article Multidisciplinary Sciences

A hierarchical reinforcement learning method for missile evasion and guidance

Mengda Yan et al.

Summary: This paper proposes a missile manoeuvring algorithm based on a hierarchical PPO reinforcement learning algorithm. The algorithm allows the missile to guide to a target and evade an interceptor simultaneously. The agent consists of low-level agents for basic actions and a high-level agent for control. The algorithm achieves successful results in simulation, demonstrating good adaptability and robustness.

SCIENTIFIC REPORTS (2022)

Article Automation & Control Systems

Evolving and Incremental Value Iteration Schemes for Nonlinear Discrete-Time Zero-Sum Games

Mingming Zhao et al.

Summary: This article presents evolving and incremental value iteration frameworks to address the problem of discrete-time zero-sum games. The evolving scheme regulates the closed-loop system using evolving policy pairs, while a novel incremental VI algorithm is developed to solve regulation and tracking problems in nonlinear zero-sum games. Two simulation examples demonstrate the performance and validity of the proposed frameworks.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Article Engineering, Aerospace

Optimal Cooperative Guidance Strategies for Aircraft Defense with Impact Angle Constraints

Quancheng Li et al.

Summary: This paper studies the use of active defense missiles to enhance the survival chances of combat aircraft under missile attacks. By implementing impact angle constraints, the active defense missile, in cooperation with the aircraft, achieves better defense effects. The research findings show that the two-way cooperative mechanism performs the best and can accommodate different vehicle maximum overload limits.

AEROSPACE (2022)

Article Engineering, Aerospace

Optimal Cooperative Line-of-Sight Guidance for Defending a Guided Missile

Chendi Li et al.

Summary: This article proposes an optimal cooperative guidance law for protecting a target from a guided missile. By formulating a linearized three-body kinematics and introducing the concept of error distance, a generalized linear quadratic optimization problem is established. The guidance command is derived by solving the optimization problem, and the main feature of this guidance law is that it reduces the maneuver capability demand of the defender.

AEROSPACE (2022)

Article Engineering, Aerospace

Optimal Guidance Laws for a Hypersonic Multiplayer Pursuit-Evasion Game Based on a Differential Game Strategy

Haizhao Liang et al.

Summary: This paper investigates the guidance problem in a confrontation between an interceptor, a hypersonic vehicle, and an active defender. Based on the linear-quadratic differential game strategy, the optimal guidance scheme for each adversary is proposed. The effectiveness of the proposed guidance strategies is demonstrated through mathematical analysis and numerical examples. Players in the engagement can improve their performance by employing the proposed optimal guidance approaches.

AEROSPACE (2022)

Article Engineering, Aerospace

Explainable Deep Reinforcement Learning for UAV autonomous path planning

Lei He et al.

Summary: This paper proposes a novel explainable deep neural network-based path planner for autonomous flight of quadrotors in unknown environments, trained using Deep Reinforcement Learning method in simulation. A model explanation method based on feature attribution is introduced to provide easy-to-interpret textual and visual explanations for end-users to understand the behavior triggers.

AEROSPACE SCIENCE AND TECHNOLOGY (2021)

Article Automation & Control Systems

Analysis of Role Switch for Cooperative Target Defense Differential Game

Li Liang et al.

Summary: This article discusses a TAD game with a non-suicidal faster attacker aiming to capture the target while evading the defender. The analysis focuses on the attacker's chances of winning the game within the game framework, presenting three stages with corresponding control strategies and conditions for switching stages. The cooperation between the target and defender, influenced by different capture radii, also plays a significant role in the outcome of the game.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2021)

Article Operations Research & Management Science

The Complete Differential Game of Active Target Defense

Eloy Garcia et al.

Summary: This paper explores the optimal strategies in the Target-Attacker-Defender differential game when the Attacker wins, and studies the properties of the value function and state feedback strategies, proving it as the solution to the Hamilton-Jacobi-Isaacs equation. Through synthesis and verification, a correct solution suitable for the differential game is obtained.

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2021)

Article Engineering, Aerospace

Robust multi-agent differential games with application to cooperative guidance

Fei Liu et al.

Summary: This paper investigates robust multi-agent differential games and their application to cooperative guidance. By designing a set of saddle point strategies, a method to stabilize uncertain systems is proposed, and the effectiveness of the modified solution is proven.

AEROSPACE SCIENCE AND TECHNOLOGY (2021)

Review Engineering, Aerospace

Review of advanced guidance and control algorithms for space/ aerospace vehicles

Runqi Chai et al.

Summary: The design of advanced guidance and control systems for space/aerospace vehicles has been a major focus worldwide, utilizing robust and stochastic control methods as well as optimization theory and AI-based controllers. These approaches have shown to improve system performance and provide reliable guidance and control commands for the vehicles.

PROGRESS IN AEROSPACE SCIENCES (2021)

Article Engineering, Aerospace

Cooperative Active Aircraft Protection Guidance Using Line-of-Sight Approach

Shashi Ranjan Kumar et al.

Summary: This article proposes sliding-mode-control-based guidance strategies for a team consisting of aircraft and a defending interceptor against an attacker, based on the line-of-sight guidance concept. The nonlinear framework considered helps circumvent performance degradation under large heading angle errors. The knowledge of the bound on attacker acceleration is shown to be sufficient to ensure interception of an attacking interceptor.

IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS (2021)

Article Automation & Control Systems

Event-Triggered Adaptive Dynamic Programming for Zero-Sum Game of Partially Unknown Continuous-Time Nonlinear Systems

Shan Xue et al.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2020)

Article Engineering, Aerospace

Guidance strategies for interceptor against active defense spacecraft in two-on-two engagement

Haizhao Liang et al.

AEROSPACE SCIENCE AND TECHNOLOGY (2020)

Article Engineering, Aerospace

Optimal guidance against active defense ballistic missiles via differential game strategies

Haizhao Liang et al.

CHINESE JOURNAL OF AERONAUTICS (2020)

Article Engineering, Aerospace

Adaptive guidance and integrated navigation with reinforcement meta-learning

Brian Gaudet et al.

ACTA ASTRONAUTICA (2020)

Article Engineering, Aerospace

Reinforcement learning for angle-only intercept guidance of maneuvering targets

Brian Gaudet et al.

AEROSPACE SCIENCE AND TECHNOLOGY (2020)

Article Computer Science, Artificial Intelligence

Cooperative control for multi-player pursuit-evasion games with reinforcement learning

Yuanda Wang et al.

NEUROCOMPUTING (2020)

Article Computer Science, Information Systems

Robust Control of Unknown Observable Nonlinear Systems Solved as a Zero-Sum Game

Mircea-Bogdan Radac et al.

IEEE ACCESS (2020)

Article Mathematics, Interdisciplinary Applications

Pursuit in the Presence of a Defender

Eloy Garcia et al.

DYNAMIC GAMES AND APPLICATIONS (2019)

Article Automation & Control Systems

A differential game for cooperative target defense

Li Liang et al.

AUTOMATICA (2019)

Review Chemistry, Multidisciplinary

Review of Artificial Intelligence Adversarial Attack and Defense Technologies

Shilin Qiu et al.

APPLIED SCIENCES-BASEL (2019)

Article Engineering, Aerospace

Guidance laws for attacking defended target

Qilong Sun et al.

CHINESE JOURNAL OF AERONAUTICS (2019)

Article Engineering, Aerospace

Cooperative Missile Guidance for Active Defense of Air Vehicles

Eloy Garcia et al.

IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS (2018)

Article Engineering, Aerospace

Optimal Strategies for Multiple Unmanned Aerial Vehicles in a Pursuit/Evasion Differential Game

Xiaoqian Wei et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2018)

Article Computer Science, Artificial Intelligence

Iterative adaptive dynamic programming methods with neural network implementation for multi-player zero-sum games

He Jiang et al.

NEUROCOMPUTING (2018)

Article Computer Science, Artificial Intelligence

Adaptive Dynamic Programming for Discrete-Time Zero-Sum Games

Qinglai Wei et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2018)

Article Automation & Control Systems

Differential game strategy in three-player evasion and pursuit scenarios

Sun Qilong et al.

JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS (2018)

Article Engineering, Aerospace

Cooperative Differential Games Guidance Laws for Imposing a Relative Intercept Angle

Vitaly Shaferman et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2017)

Article Engineering, Aerospace

Weapon-Target-Allocation Strategies in Multiagent Target-Missile-Defender Engagement

Vitaly Shalumov et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2017)

Article Computer Science, Artificial Intelligence

Iterative Adaptive Dynamic Programming for Solving Unknown Nonlinear Zero-Sum Game Based on Online Data

Yuanheng Zhu et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2017)

Article Engineering, Aerospace

Evasion and pursuit guidance law against defended target

Naiming Qi et al.

CHINESE JOURNAL OF AERONAUTICS (2017)

Article Engineering, Aerospace

Game-Based Safe Aircraft Navigation in the Presence of Energy-Bleeding Coasting Missile

David Alkaher et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2016)

Article Engineering, Aerospace

Stochastic Cooperative Interception Using Information Sharing Based on Engagement Staggering

Vitaly Shaferman et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2016)

Article Engineering, Aerospace

Vector Guidance Approach to Three-Player Conflict in Exoatmospheric Interception

Sergey Rubinsky et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2015)

Article Engineering, Aerospace

Cooperative Optimal Guidance Laws for Imposing a Relative Intercept Angle

Vitaly Shaferman et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2015)

Article Engineering, Aerospace

Three-Player Pursuit and Evasion Conflict

Sergey Rubinsky et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2014)

Article Engineering, Aerospace

Modified Command to Line-of-Sight Intercept Guidance for Aircraft Defense

Takeshi Yamasaki et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2013)

Article Engineering, Aerospace

Linear Quadratic Optimal Cooperative Strategies for Active Aircraft Protection

Oleg Prokopov et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2013)

Article Engineering, Aerospace

Cooperative Differential Games Strategies for Active Aircraft Protection from a Homing Missile

Andrey Perelman et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2011)

Article Engineering, Aerospace

Line-of-Sight Interceptor Guidance for Defending an Aircraft

Ashwini Ratnoo et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2011)

Article Engineering, Aerospace

Optimal Cooperative Pursuit and Evasion Strategies Against a Homing Missile

Tal Shima

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2011)

Article Engineering, Aerospace

Cooperative Multiple-Model Adaptive Guidance for an Aircraft Defending Missile

Vitaly Shaferman et al.

JOURNAL OF GUIDANCE CONTROL AND DYNAMICS (2010)