4.7 Article

Dynamic Target Tracking of Autonomous Underwater Vehicle Based on Deep Reinforcement Learning

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Engineering, Marine

An Overview of Underwater Vision Enhancement: From Traditional Methods to Recent Deep Learning

Kai Hu et al.

Summary: This paper focuses on the importance of underwater video images in human exploration and development of the ocean, analyzes the imaging principle and quality issues of underwater images, and introduces existing enhancement methods and technologies. It also presents standard underwater datasets and evaluation indexes, and discusses possible future developments in this area.

JOURNAL OF MARINE SCIENCE AND ENGINEERING (2022)

Article Chemistry, Analytical

Modeling and Trajectory Tracking Model Predictive Control Novel Method of AUV Based on CFD Data

Han Bao et al.

Summary: A novel model predictive control method based on genetic algorithm and ant colony optimization is proposed to optimally solve the problem of standard MPC with constraints. This method is applied to the dynamic trajectory tracking control of autonomous underwater vehicles, and has been verified to be effective and robust through simulation and stability analysis.

SENSORS (2022)

Article Engineering, Marine

An AUV Target-Tracking Method Combining Imitation Learning and Deep Reinforcement Learning

Yubing Mao et al.

Summary: This study aims to address the issues of sparse reward and local convergence in using a reinforcement learning algorithm as an AUV controller. By combining the GAIL algorithm with multi-agent approach, the MAG algorithm is proposed, allowing the AUV to learn directly from expert demonstrations and overcoming the slow initial training problem. The parallel training of multi-agents reduces sample correlation and prevents local convergence. Additionally, a reward function is designed to assist in training. The results of the Unity simulation platform test demonstrate the strong decision-making ability of the proposed algorithm in the tracking process.

JOURNAL OF MARINE SCIENCE AND ENGINEERING (2022)

Article Engineering, Marine

GPU-Accelerated Multi-Objective Optimal Planning in Stochastic Dynamic Environments

Rohit Chowdhury et al.

Summary: The importance of autonomous marine vehicles is increasing in various ocean science and engineering applications. Multi-objective optimization is crucial for planning optimal routes in dynamic ocean environments, and our developed path planner can compute optimal operating curves in a fraction of the time of existing solvers. This solution also serves as a benchmark for other approximate AI algorithms, improving their explainability.

JOURNAL OF MARINE SCIENCE AND ENGINEERING (2022)

Article Engineering, Marine

Formation Control of Multiple Autonomous Underwater Vehicles under Communication Delay, Packet Discreteness and Dropout

Liang Li et al.

Summary: This paper proposes a formation control scheme for multiple AUVs under communication delay, packet discreteness and dropout. The communication delay is estimated and the states of the AUV are predicted to solve the problems of packet discreteness and dropout. A stable follower controller is designed using the leader-follower approach based on input-output feedback linearization. Simulation results and field tests demonstrate the effectiveness and practicality of the proposed formation control scheme.

JOURNAL OF MARINE SCIENCE AND ENGINEERING (2022)

Article Engineering, Marine

Improved RRT Algorithm for AUV Target Search in Unknown 3D Environment

Juan Li et al.

Summary: This paper proposes an improved rapidly exploring random trees (RRT) algorithm to solve the problem of target search and interception in an unknown three-dimensional environment. The algorithm combines rolling planning and node screening for path planning in the unknown environment, and utilizes a search decision function and numerical differential prediction method for target search and interception.

JOURNAL OF MARINE SCIENCE AND ENGINEERING (2022)

Article Engineering, Marine

Underwater Image Enhancement Based on Local Contrast Correction and Multi-Scale Fusion

Farong Gao et al.

Summary: The proposed method addresses low contrast and color distortion in underwater images through local contrast correction and multi-scale fusion.

JOURNAL OF MARINE SCIENCE AND ENGINEERING (2021)

Article Automation & Control Systems

Enhancing continuous control of mobile robots for end-to-end visual active tracking

Alessandro Devo et al.

Summary: This study focuses on visual active tracking, proposing a novel DRL-based system that improves performance and accelerates training through continuous action policies and additional objective functions and a Heuristic Trajectory Generator.

ROBOTICS AND AUTONOMOUS SYSTEMS (2021)

Article Chemistry, Multidisciplinary

Underwater Image Mosaic Algorithm Based on Improved Image Registration

Yinsen Zhao et al.

Summary: The paper presents an underwater panoramic image mosaic algorithm based on IIR, which enhances image quality through image enhancement and improved image registration. The results demonstrate that the method can effectively improve registration accuracy and fusion effect, with significant practical significance in the field of cruise research.

APPLIED SCIENCES-BASEL (2021)

Review Engineering, Marine

AUV Trajectory Tracking Models and Control Strategies: A Review

Daoliang Li et al.

Summary: AUV trajectory tracking control faces challenges such as environmental disturbances and system constraints, further research on dynamic characteristics and control methods is needed to enhance underwater task performance.

JOURNAL OF MARINE SCIENCE AND ENGINEERING (2021)

Article Engineering, Electrical & Electronic

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

Yujian Ye et al.

IEEE TRANSACTIONS ON SMART GRID (2020)

Article Engineering, Civil

Graph-Search and Differential Equations for Time-Optimal Vessel Route Planning in Dynamic Ocean Waves

Gianandrea Mannarini et al.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2020)

Article Engineering, Marine

AUV path following controlled by modified Deep Deterministic Policy Gradient

Yushan Sun et al.

OCEAN ENGINEERING (2020)

Article Automation & Control Systems

Fixed-Wing UAVs flocking in continuous spaces: A deep reinforcement learning approach

Chao Yan et al.

ROBOTICS AND AUTONOMOUS SYSTEMS (2020)

Article Computer Science, Information Systems

Deep Interactive Reinforcement Learning for Path Following of Autonomous Underwater Vehicle

Qilei Zhang et al.

IEEE ACCESS (2020)

Article Computer Science, Artificial Intelligence

Composite learning adaptive sliding mode control for AUV target tracking

Yuyan Guo et al.

NEUROCOMPUTING (2019)

Article Computer Science, Artificial Intelligence

Multi Pseudo Q-Learning-Based Deterministic Policy Gradient for Tracking Control of Autonomous Underwater Vehicles

Wenjie Shi et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2019)

Article Engineering, Marine

Reinforcement Learning Based Obstacle Avoidance for Autonomous Underwater Vehicle

Prashant Bhopale et al.

JOURNAL OF MARINE SCIENCE AND APPLICATION (2019)

Article Automation & Control Systems

Adaptive low-level control of autonomous underwater vehicles using deep reinforcement learning

Ignacio Carlucho et al.

ROBOTICS AND AUTONOMOUS SYSTEMS (2018)

Article Automation & Control Systems

Handbook of Marine Craft Hydrodynamics and Motion Control [Bookshelf]

IEEE CONTROL SYSTEMS MAGAZINE (2016)

Article Engineering, Marine

Modeling and control of autonomous underwater vehicle (AUV) in heading and depth attitude via self-adaptive fuzzy PID controller

Mohammad Hedayati Khodayari et al.

JOURNAL OF MARINE SCIENCE AND TECHNOLOGY (2015)

Article Computer Science, Artificial Intelligence

Towards docking for small scale underwater robots

Stefano Mintchev et al.

AUTONOMOUS ROBOTS (2015)

Article Automation & Control Systems

Two-step gradient-based reinforcement learning for underwater robotics behavior learning

Andres El-Fakdi et al.

ROBOTICS AND AUTONOMOUS SYSTEMS (2013)

Article Automation & Control Systems

Model-based output feedback control of slender-body underactuated AUVs: Theory and experiments

Jon E. Refsnes et al.

IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY (2008)