4.7 Article

Hybrid Reinforcement Learning for STAR-RISs: A Coupled Phase-Shift Model Based Beamformer

Related references

Note: Only part of the references are listed.
Article Engineering, Electrical & Electronic

Simultaneously Transmitting and Reflecting (STAR) RIS Aided Wireless Communications

Xidong Mu et al.

Summary: This paper investigates the novel concept of simultaneously transmitting and reflecting reconfigurable intelligent surfaces (RISs) and proposes practical operating protocols for RISs. The joint optimization of active beamforming and passive transmission and reflection beamforming can effectively reduce power consumption and improve the performance of unicast and multicast transmission.

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (2022)

Article Telecommunications

Reconfigurable Intelligent Surface (RIS) Assisted Wireless Coverage Extension: RIS Orientation and Location Optimization

Shuhao Zeng et al.

Summary: This letter analyzes the coverage of a downlink RIS-assisted network with one base station (BS) and one user equipment (UE). An RIS placement optimization problem is formulated to maximize the cell coverage by optimizing the RIS orientation and horizontal distance. A coverage maximization algorithm (CMA) is proposed to solve the problem, with a closed-form optimal RIS orientation obtained, and numerical results verifying the analysis.

IEEE COMMUNICATIONS LETTERS (2021)

Article Engineering, Electrical & Electronic

Deep Reinforcement Learning-Based Intelligent Reflecting Surface for Secure Wireless Communications

Helin Yang et al.

Summary: This paper investigates an intelligent reflecting surface (IRS)-aided wireless secure communication system, utilizing deep reinforcement learning to optimize beamforming strategies for enhancing system secrecy rate and QoS satisfaction probability. Post-decision state (PDS) and prioritized experience replay (PER) schemes are applied to improve learning efficiency and secrecy performance against multiple eavesdroppers in dynamic environments.

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (2021)

Article Engineering, Electrical & Electronic

Ultra-Reliable Indoor Millimeter Wave Communications Using Multiple Artificial Intelligence-Powered Intelligent Surfaces

Mehdi Naderi Soorki et al.

Summary: This paper proposes a novel framework for ensuring ultra-reliable mmWave communications using multiple AI-enabled RISs to change signal propagation direction and improve coverage. It introduces a risk-sensitive episodic return to optimize expected bitrate and mitigate mmW link blockage, and utilizes deep RNN controllers for near optimal solutions.

IEEE TRANSACTIONS ON COMMUNICATIONS (2021)

Article Engineering, Electrical & Electronic

Semi-Passive 3D Positioning of Multiple RIS-Enabled Users

Kamran Keykhosravi et al.

Summary: The application of RIS in multi-user passive localization scenarios shows great potential for high accuracy and solving data association problems. This study introduces a new method that utilizes RIS and time-of-arrival measurements for accurate estimation of users' 3D positions.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2021)

Article Computer Science, Hardware & Architecture

Reconfigurable Intelligent Surfaces: Potentials, Applications, and Challenges for 6G Wireless Networks

Sarah Basharat et al.

Summary: Reconfigurable intelligent surfaces (RISs) have emerged as an energy-efficient and cost-effective technology to support future wireless communication needs. By introducing phase-shift in impinging signals, RISs create favorable propagation channels between transmitters and receivers using low-cost passive reflecting elements. This article provides a comprehensive overview of RISs for sixth-generation (6G) wireless networks, addressing performance gains, practical challenges, and integration with emerging communication technologies.

IEEE WIRELESS COMMUNICATIONS (2021)

Article Telecommunications

Unsupervised Learning-Based Joint Active and Passive Beamforming Design for Reconfigurable Intelligent Surfaces Aided Wireless Networks

Haobo Song et al.

Summary: This letter proposes a deep learning based approach for joint active and passive beamforming design in a reconfigurable intelligent surface (RIS) aided multi-user multiple-input single-output (MISO) downlink system. The approach significantly reduces computational complexity and shows satisfactory performance in simulations.

IEEE COMMUNICATIONS LETTERS (2021)

Article Multidisciplinary Sciences

A reconfigurable intelligent surface with integrated sensing capability

Idban Alamzadeh et al.

Summary: The article introduces a reconfigurable reflective metasurface with integrated sensing capabilities, which can couple a portion of the incident wave to sensing waveguides by modifying meta-atoms. It also proposes a method to reduce the required number of sensors, which can benefit wireless communication, wireless power transfer, RF sensing, and smart sensors.

SCIENTIFIC REPORTS (2021)

Article Engineering, Electrical & Electronic

RIS Enhanced Massive Non-Orthogonal Multiple Access Networks: Deployment and Passive Beamforming Design

Xiao Liu et al.

Summary: A novel framework is proposed for the deployment and passive beamforming design of a reconfigurable intelligent surface (RIS) with the aid of non-orthogonal multiple access (NOMA) technology. Machine learning approaches are utilized to tackle the joint problem of deployment and design of RIS, with promising simulation results.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2021)

Article Engineering, Electrical & Electronic

Optimizing Age of Information Through Aerial Reconfigurable Intelligent Surfaces: A Deep Reinforcement Learning Approach

Moataz Samir et al.

Summary: The study explores the benefits of integrating UAVs with reconfigurable intelligent surface elements to relay information from IoTDs to the BS passively. An optimization problem was formulated to minimize the expected sum Age-of-Information by optimizing the UAV altitude, communication schedule, and RIS phases-shift. A proximal policy optimization algorithm was developed to solve this mixed-integer non-convex optimization problem, with numerical results showing superiority in terms of AoI compared to other algorithms.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2021)

Article Engineering, Electrical & Electronic

Dynamic Offloading for Multiuser Muti-CAP MEC Networks: A Deep Reinforcement Learning Approach

Chao Li et al.

Summary: In this paper, a multiuser mobile edge computing network is studied where tasks can be partially offloaded to multiple computational access points. A novel offloading strategy based on DQN is proposed, allowing users to dynamically fine-tune the offloading proportion to optimize system performance. Simulation results demonstrate the advantages of the proposed DQN-based offloading strategy over conventional methods.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2021)

Article Computer Science, Information Systems

Cost-Efficient RIS-Aided Channel Estimation via Rank-One Matrix Factorization

Wei Zhang et al.

Summary: A reconfigurable intelligent surface (RIS) is composed of massive meta-elements, which can enhance the performance of future wireless communication systems. This letter introduces a cost-efficient channel estimation method using rank-one matrix factorization (MF), which significantly reduces training overhead compared to directly estimating the cascaded channel.

IEEE WIRELESS COMMUNICATIONS LETTERS (2021)

Article Telecommunications

Coverage Characterization of STAR-RIS Networks: NOMA and OMA

Chenyu Wu et al.

Summary: This study investigates the novel concept of STAR-RIS for two-user communication networks, optimizing coverage range through resource allocation and transmission/reflection coefficients. Results indicate significant coverage extension compared to conventional RISs, particularly in NOMA scenarios.

IEEE COMMUNICATIONS LETTERS (2021)

Article Telecommunications

Deep Multi-Stage CSI Acquisition for Reconfigurable Intelligent Surface Aided MIMO Systems

Shen Gao et al.

Summary: This letter proposes a deep learning-based approach to reduce the pilot overhead when estimating the RIS relayed wireless channel, ensuring reliable estimation accuracy.

IEEE COMMUNICATIONS LETTERS (2021)

Article Telecommunications

STAR-RISs: Simultaneous Transmitting and Reflecting Reconfigurable Intelligent Surfaces

Jiaqi Xu et al.

Summary: This letter investigates simultaneous transmitting and reflecting reconfigurable intelligent surfaces (STAR-RISs), which extend coverage to 360 degrees compared to conventional reflecting-only RISs. A general hardware model and channel models are presented for STAR-RISs, showing superior diversity gain compared to conventional RISs through numerical simulations. Full diversity order is achievable on both sides of the STAR-RIS.

IEEE COMMUNICATIONS LETTERS (2021)

Article Automation & Control Systems

An Ergodic Measure for Active Learning From Equilibrium

Ian Abraham et al.

Summary: This article introduces a novel method for robotic systems to incorporate stability through ergodic exploration, while maintaining Lyapunov attractiveness with respect to equilibrium tasks and actively generating data distributions for learning tasks. The proposed method enables robotic systems to achieve online adaptive learning without human intervention.

IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING (2021)

Article Computer Science, Information Systems

Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled Wireless Networks: A Tutorial

Amal Feriani et al.

Summary: Deep Reinforcement Learning (DRL) has made significant advances in solving sequential decision-making problems in various fields, especially in wireless communications. The tutorial focuses on the role of DRL with an emphasis on deep Multi-Agent Reinforcement Learning (MARL) in AI-enabled wireless networks. It presents mathematical frameworks for single-agent RL and MARL, emphasizes the application of RL beyond the model-free perspective, and highlights the potential applications in future wireless networks. The state-of-the-art of MARL in Mobile Edge Computing (MEC), Unmanned Aerial Vehicles (UAV) networks, and cell-free massive MIMO is overviewed, along with identifying promising future research directions.

IEEE COMMUNICATIONS SURVEYS AND TUTORIALS (2021)

Article Engineering, Electrical & Electronic

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

Chongwen Huang et al.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2020)

Article Engineering, Electrical & Electronic

Capacity Characterization for Intelligent Reflecting Surface Aided MIMO Communication

Shuowen Zhang et al.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2020)

Article Engineering, Electrical & Electronic

Intelligent Reflecting Surface: Practical Phase Shift Model and Beamforming Optimization

Samith Abeywickrama et al.

IEEE TRANSACTIONS ON COMMUNICATIONS (2020)

Article Telecommunications

Reconfigurable Intelligent Surfaces for Wireless Communications: Principles, Challenges, and Opportunities

Mohamed A. ElMossallamy et al.

IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING (2020)

Article Engineering, Electrical & Electronic

Beyond Intelligent Reflecting Surfaces: Reflective-Transmissive Metasurface Aided Communications for Full-Dimensional Coverage Extension

Shuhang Zhang et al.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2020)

Article Engineering, Electrical & Electronic

Exploiting Intelligent Reflecting Surfaces in NOMA Networks: Joint Beamforming Optimization

Xidong Mu et al.

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (2020)

Article Computer Science, Information Systems

Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks

Jingjing Wang et al.

IEEE COMMUNICATIONS SURVEYS AND TUTORIALS (2020)

Article Computer Science, Information Systems

Toward Smart Wireless Communications via Intelligent Reflecting Surfaces: A Contemporary Survey

Shimin Gong et al.

IEEE COMMUNICATIONS SURVEYS AND TUTORIALS (2020)

Article Engineering, Electrical & Electronic

Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication

Chongwen Huang et al.

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (2019)

Article Computer Science, Information Systems

Deep Deterministic Policy Gradient (DDPG)-Based Energy Harvesting Wireless Communications

Chengrun Qiu et al.

IEEE INTERNET OF THINGS JOURNAL (2019)

Article Computer Science, Information Systems

Sixty Years of Coherent Versus Non-Coherent Tradeoffs and the Road From 5G to Wireless Futures

Chao Xu et al.

IEEE ACCESS (2019)

Article Engineering, Electrical & Electronic

Deep Reinforcement Learning A brief survey

Kai Arulkumaran et al.

IEEE SIGNAL PROCESSING MAGAZINE (2017)

Article Engineering, Electrical & Electronic

Passive Metasurface for Reflectionless and Arbitary Control of Electromagnetic Wave Transmission

Bo O. Zhu et al.

IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION (2015)