4.8 Article

Deep-Reinforcement-Learning-Based Joint 3-D Navigation and Phase-Shift Control for Mobile Internet of Vehicles Assisted by RIS-Equipped UAVs

Related references

Note: Only part of the references are listed.
Article Engineering, Electrical & Electronic

RIS-Assisted UAV for Fresh Data Collection in 3D Urban Environments: A Deep Reinforcement Learning Approach

Xiaokun Fan et al.

Summary: This paper proposes using reconfigurable intelligent surfaces (RIS) to assist unmanned aerial vehicles (UAVs) in overcoming signal blockages caused by urban buildings, ensuring real-time data collection. By jointly optimizing UAV trajectory, IoTD scheduling, and RIS phase shifts, the age of information (AoI) of all devices is minimized. A deep reinforcement learning (DRL) algorithm called SAC-AO-RIS is designed to learn stable policies for UAV trajectory and IoTD scheduling, while an alternating optimization (AO) algorithm is used for solving RIS phase shifts. Simulation results demonstrate the effectiveness and superiority of the proposed scheme.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2023)

Article Computer Science, Information Systems

Joint Multi-UAV Path Planning and LoS Communication for Mobile-Edge Computing in IoT Networks With RISs

Andrey V. V. Savkin et al.

Summary: This article proposes a joint path planning and communication scheduling problem for a team of unmanned aerial vehicles (UAVs) performing computing tasks for IoT devices on uneven terrain. Reconfigurable intelligent surfaces (RISs) are deployed to improve wireless communication between UAVs and IoT devices. The objective is to develop an algorithm that maximizes computing tasks performed by the UAVs and minimizes their energy consumption. An effective path planning algorithm is proposed and its asymptotic optimality is mathematically proven.

IEEE INTERNET OF THINGS JOURNAL (2023)

Article Automation & Control Systems

Consensus-Based Autonomous Navigation of a Team of RIS-Equipped UAVs for LoS Wireless Communication With Mobile Nodes in High-Density Areas

Mohsen Eskandari et al.

Summary: This paper proposes a framework for optimal navigation of RIS-outfitted UAVs to maintain line-of-sight wireless links with ground vehicles in dense urban areas. The framework optimizes the trajectories of the UAVs considering energy efficiency, communication channel gains, and constraints associated with motion and line-of-sight service. A consensus-based coordinating approach is adopted to cover all mobile targets under good quality of service. Simulation results demonstrate the effectiveness of the method.

IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING (2023)

Article Computer Science, Artificial Intelligence

Model Predictive Control-Based 3D Navigation of a RIS-Equipped UAV for LoS Wireless Communication With a Ground Intelligent Vehicle

Mohsen Eskandari et al.

Summary: This paper proposes a reconfigurable intelligent surface (RIS)-equipped unmanned aerial vehicle (RISeUAV) to provide uninterrupted line-of-sight communication for intelligent vehicles. A two-stage method is used to plan the optimal trajectory considering energy consumption, speed/acceleration constraints, and communication performance. Simulation results show the accuracy and effectiveness of the proposed method.

IEEE TRANSACTIONS ON INTELLIGENT VEHICLES (2023)

Article Computer Science, Information Systems

Phase and 3-D Placement Optimization for Rate Enhancement in RIS-Assisted UAV Networks

Maham Misbah et al.

Summary: This letter proposes a conjugate gradient and particle swarm optimization (CG-PSO) scheme to jointly optimize the phase shifts of reconfigurable intelligent surface (RIS) and altitudes of assisted aerial base station (ABS) in order to improve the system sum-rate performance. The problem is divided into sub-problems and solved using an alternative optimization method. The results show that the proposed CG-PSO scheme significantly improves the sum rate compared to the baseline schemes.

IEEE WIRELESS COMMUNICATIONS LETTERS (2023)

Article Engineering, Civil

Joint Communication and Trajectory Optimization for Multi-UAV Enabled Mobile Internet of Vehicles

Xin Liu et al.

Summary: This paper proposes a multi-UAV enabled mobile IoV model and maximizes system throughput by joint optimization of vehicle communication scheduling, UAV power allocation, and UAV trajectory. The research results show that the model has excellent performance through joint communication and trajectory optimization.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Engineering, Electrical & Electronic

Multi-Agent Reinforcement Learning Aided Intelligent UAV Swarm for Target Tracking

Zhaoyue Xia et al.

Summary: This study proposes a cooperative multi-agent reinforcement learning scheme for UAVs to intelligently track targets based on target states, while also introducing energy-saving strategies and spatial information entropy to enhance system performance.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2022)

Article Computer Science, Information Systems

Deep-Reinforcement-Learning-Based Optimal Transmission Policies for Opportunistic UAV-Aided Wireless Sensor Network

Yitong Liu et al.

Summary: In this article, a joint optimization approach for UAV scheduling and power control in wireless sensor networks is proposed to maximize network data transmission. Deep reinforcement learning is utilized to solve the optimization problem. Simulation results demonstrate the superiority of the proposed method compared to benchmark policies.

IEEE INTERNET OF THINGS JOURNAL (2022)

Article Computer Science, Information Systems

Deployment of Heterogeneous UAV Base Stations for Optimal Quality of Coverage

Hailong Huang et al.

Summary: This article studies the quality of coverage of deploying flying base stations mounted on unmanned aerial vehicles (UAV-BSs) after disasters or during some occasional events. The authors propose a decentralized deployment algorithm for a Line-of-Sight (LoS) scenario and discuss its application in Non-LoS (NLoS) scenarios. Computer simulations and comparisons with a benchmark method confirm the effectiveness of the proposed algorithms in terms of the quality of coverage.

IEEE INTERNET OF THINGS JOURNAL (2022)

Article Engineering, Electrical & Electronic

Millimeter Wave Communications With an Intelligent Reflector: Performance Optimization and Distributional Reinforcement Learning

Qianqian Zhang et al.

Summary: This paper proposes a novel framework for optimizing the downlink multi-user communication of a millimeter wave base station with the assistance of a reconfigurable intelligent reflector (IR). The proposed approach optimizes the precoding transmission of the base station and the reflection coefficient of the IR to maximize the downlink rates towards multiple users. In the imperfect CSI scenario, a distributional reinforcement learning (DRL) approach is utilized to learn the optimal IR reflection and maximize the downlink capacity. The simulation results demonstrate the effectiveness of the proposed approach in improving the downlink sum-rate and the prediction accuracy of the downlink rate.

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (2022)

Article Engineering, Civil

Intelligent and Reliable Millimeter Wave Communications for RIS-Aided Vehicular Networks

Madyan Alsenwi et al.

Summary: This paper investigates the use of reconfigurable intelligent surfaces (RISs) to overcome the limitations of mmWave communications. The results show that utilizing RIS can effectively address the issue of link blockages in mmWave communications and improve network performance.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Engineering, Electrical & Electronic

Millimeter Wave Reflection Pattern Codebook Design for RIS-Assisted V2V Communications

Jiho Song et al.

Summary: We propose a reflection pattern (RP) design for reconfigurable intelligent surface (RIS)-assisted vehicle-to-vehicle (V2V) communication systems. Our design considers passive reflecting elements at the RIS and the difference between incident and reflection channels. Numerical results show that the proposed RP codebook achieves higher link gain compared to previously reported codebooks.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2022)

Article Engineering, Civil

Throughput Maximization for RIS-UAV Relaying Communications

Xin Liu et al.

Summary: In this study, a reconfigurable intelligent surface (RIS) assisted unmanned aerial vehicle (UAV) relaying communications system is considered. By optimizing the UAV trajectory, RIS passive beamforming, and source power allocation, better performance and flexibility can be achieved. The results indicate that trajectory optimization can improve the throughput of the communication system.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Proceedings Paper Automation & Control Systems

Autonomous Guidance of an Aerial Drone for Maintaining an Effective Wireless Communication Link with a Moving Node Using an Intelligent Reflecting Surface

Mohsen Eskandari et al.

Summary: The paper introduces an AD equipped with IRS that enhances the spectrum efficiency of 5G networks, maintaining a continuous wireless link with a moving node, particularly suitable for vehicles in urban environments. Simulation results validate the effectiveness of the proposed method.

2022 14TH INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2022) (2022)

Article Automation & Control Systems

A Multi-Agent Deep Reinforcement Learning Approach for Practical Decentralized UAV Collision Avoidance

Nicholas Thumiger et al.

Summary: This letter proposes an improved deep reinforcement learning controller for the decentralized collision avoidance problem. The controller outperforms existing techniques by incorporating 'long-short term memory cells' and a reward function inspired from gradient-based approaches, especially in environments with varying numbers of agents. The testing results in simulation and a real-world drone environment demonstrate that the proposed controller significantly outperforms the predominant classical approach in the literature.

IEEE CONTROL SYSTEMS LETTERS (2022)

Article Engineering, Electrical & Electronic

Wireless Communications With Reconfigurable Intelligent Surface: Path Loss Modeling and Experimental Measurement

Wankai Tang et al.

Summary: This article develops free-space path loss models for RIS-assisted wireless communications in different scenarios by studying the physics and electromagnetic nature of RISs, validated through extensive simulation results and experimental measurements. The models reveal the relationships between the path loss and various factors, paving the way for further theoretical studies and practical applications in the field.

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (2021)

Article Automation & Control Systems

Trajectory Planning and Tracking Strategy Applied to an Unmanned Ground Vehicle in the Presence of Obstacles

Xiaobin Zhou et al.

Summary: This article presents a strategy of trajectory planning and tracking for unmanned ground vehicles in dynamic environments, ensuring safety with a global optimal trajectory predefined by an artificial fish swarm algorithm (AFSA) and local trajectory planning with a trial-based forward search (TFS) algorithm based on the Markov chain. The proposed multiconstrained model predictive controller (MMPC) calculates command signals for the vehicle to track the reference trajectory smoothly. Results demonstrate the effectiveness of the algorithm in simulations and experiments with static and dynamic obstacles, showcasing enhanced storage efficiency and convergence rate in comparison to dynamic programming.

IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING (2021)

Article Engineering, Electrical & Electronic

Optimizing Age of Information Through Aerial Reconfigurable Intelligent Surfaces: A Deep Reinforcement Learning Approach

Moataz Samir et al.

Summary: The study explores the benefits of integrating UAVs with reconfigurable intelligent surface elements to relay information from IoTDs to the BS passively. An optimization problem was formulated to minimize the expected sum Age-of-Information by optimizing the UAV altitude, communication schedule, and RIS phases-shift. A proximal policy optimization algorithm was developed to solve this mixed-integer non-convex optimization problem, with numerical results showing superiority in terms of AoI compared to other algorithms.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2021)

Article Engineering, Electrical & Electronic

Machine Learning Empowered Trajectory and Passive Beamforming Design in UAV-RIS Wireless Networks

Xiao Liu et al.

Summary: This study proposes a novel framework for integrating RIS in UAV-enabled wireless networks to enhance service quality. By jointly designing UAV movement, RIS phase shifts, power allocation policy, and dynamic decoding order, the energy consumption minimizing problem is solved with a D-DQN algorithm. Numerical results show significant advantages in efficiency and energy consumption compared to traditional Q-learning algorithms.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2021)

Article Engineering, Civil

Deep Learning Based Autonomous Vehicle Super Resolution DOA Estimation for Safety Driving

Liangtian Wan et al.

Summary: This paper introduces a novel system architecture for vehicle location systems, using massive MIMO or RIS and multiple autonomous vehicles. The deep unfolding technique is used for estimating location parameters of autonomous vehicles with higher accuracy compared to traditional GPS methods. Simulation results show that the proposed SBLNet outperforms state-of-the-art methods in terms of estimation accuracy and success probability, especially in scenarios with fast moving autonomous vehicles.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2021)

Article Engineering, Electrical & Electronic

Jamming Mitigation via Aerial Reconfigurable Intelligent Surface: Passive Beamforming and Deployment Optimization

Xiao Tang et al.

Summary: The correspondence highlights the potential of reconfigurable intelligent surface (RIS) in anti-jamming communications, focusing on an aerial RIS (ARIS) deployed in the air to mitigate jamming attacks and enhance legitimate transmissions. Through joint optimization of ARIS deployment and passive beamforming, the problem is solved using an alternating optimization framework, with simulation results demonstrating the effectiveness of ARIS in mitigating jamming attacks.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2021)

Article Engineering, Electrical & Electronic

Reconfigurable Intelligent Surfaces for Localization: Position and Orientation Error Bounds

Ahmed Elzanaty et al.

Summary: This paper discusses the localization performance limits and the impact of signal propagation conditions when using reconfigurable intelligent surfaces in smart radio environments for communication and localization. Numerical results show that the proposed scheme can achieve remarkable performance even in asynchronous signaling, with a proposed phase design that approaches the numerical optimal phase design minimizing the CRLB.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2021)

Article Computer Science, Information Systems

Cascaded Channel Estimation for Large Intelligent Metasurface Assisted Massive MIMO

Zhen-Qing He et al.

IEEE WIRELESS COMMUNICATIONS LETTERS (2020)

Article Computer Science, Information Systems

Reconfigurable Intelligent Surface Assisted UAV Communication: Joint Trajectory Design and Passive Beamforming

Sixian Li et al.

IEEE WIRELESS COMMUNICATIONS LETTERS (2020)

Article Computer Science, Information Systems

UAV Communications for 5G and Beyond: Recent Advances and Future Trends

Bin Li et al.

IEEE INTERNET OF THINGS JOURNAL (2019)

Article Engineering, Electrical & Electronic

Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication

Chongwen Huang et al.

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (2019)

Article Telecommunications

Placement Optimization of UAV-Mounted Mobile Base Stations

Jiangbin Lyu et al.

IEEE COMMUNICATIONS LETTERS (2017)

Article Engineering, Electrical & Electronic

Enabling Communication Technologies for Smart Cities

Ibrar Yaqoob et al.

IEEE COMMUNICATIONS MAGAZINE (2017)

Article Engineering, Electrical & Electronic

Wireless Communications with Unmanned Aerial Vehicles: Opportunities and Challenges

Yong Zeng et al.

IEEE COMMUNICATIONS MAGAZINE (2016)

Article Multidisciplinary Sciences

Human-level control through deep reinforcement learning

Volodymyr Mnih et al.

NATURE (2015)

Article Engineering, Electrical & Electronic

Millimeter Wave Channel Modeling and Cellular Capacity Evaluation

Mustafa Riza Akdeniz et al.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2014)

Article Automation & Control Systems

A resource allocation algorithm for multivehicle systems with nonholonomic constraints

Sivakumar Rathinam et al.

IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING (2007)

Article Robotics

Randomized kinodynamic planning

SM LaValle et al.

INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH (2001)