4.8 Article

Collaboration-Aware Relay Selection for AUV in Internet of Underwater Network: Evolving Contextual Bandit Learning Approach

Related references

Note: Only part of the references are listed.
Article Computer Science, Information Systems

Adaptive Relay Selection Strategy in Underwater Acoustic Cooperative Networks: A Hierarchical Adversarial Bandit Learning Approach

Haihong Zhao et al.

Summary: To address the challenges in relay selection for underwater acoustic cooperative networks, a hierarchical adversarial multi-armed bandit learning framework with an online reward estimation layer is proposed. The framework includes an adaptive Kalman filter estimator to handle noisy observations and an online prediction mechanism for relays. An adaptive exploration structure based on estimate error variance is developed to balance between exploration and exploitation. The algorithm, called HABL, integrates reward estimation, information prediction, adaptive exploration, and decision making to maximize learning efficiency. Extensive simulations demonstrate the effectiveness of HABL. Overall, it is rated 8 out of 10 for its importance.

IEEE TRANSACTIONS ON MOBILE COMPUTING (2023)

Article Computer Science, Information Systems

Novel Vehicular Compatibility-Based Ad Hoc Message Routing Scheme in the Internet of Vehicles Using Machine Learning

Farooque Hassan Kumbhar et al.

Summary: The sixth-generation cellular networks incorporate artificial intelligence and machine learning to enable proactive communications and predictive decision making, promoting the Internet of Vehicles concept. The existing vehicular communications face challenges in unreliable communication links due to multihop ad hoc communications and high mobility environment. This study highlights the importance of communication route compatibility and proposes a machine learning and analytical compatibility-based ad hoc routing protocol to estimate and predict compatibility time for route selection.

IEEE INTERNET OF THINGS JOURNAL (2022)

Article Engineering, Electrical & Electronic

Partial Expert-Based Adversarial Relay Learning Strategy for Underwater Acoustic Sensor Networks

Haihong Zhao et al.

Summary: In this paper, an innovative Partial Expert-based Reinforcement Adversarial Learning (PER-AL) strategy is proposed to improve system capacity performance in underwater acoustic sensor networks. The algorithm adapts to underwater conditions and detects the optimal relay within a short time, significantly improving the total network capacity.

IEEE SENSORS JOURNAL (2022)

Article Computer Science, Information Systems

An efficient and intelligent routing strategy for vehicular delay tolerant networks An efficient routing strategy for VDTN

Amit Kumar Singh et al.

Summary: The vehicular delay-tolerant network is a real-life application area that uses vehicular nodes and roadside units for communication. The dynamic topology and challenges such as incomplete data transfer and packet loss are key aspects of this network.

WIRELESS NETWORKS (2021)

Article Engineering, Electrical & Electronic

Sleeping Contextual/Non-Contextual Thompson Sampling MAB for mmWave D2D Two-Hop Relay Probing

Ehab Mahmoud Mohamed et al.

Summary: This paper introduces a novel relay broadcasting scheme using a single player multi-armed bandit (MAB) problem to maximize the achievable spectral efficiency, improves performance by identifying and removing sleeping relays, and enhances the algorithm by utilizing WiFi information as contexts.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2021)

Article Computer Science, Information Systems

Optimal Cooperative Relaying and Power Control for IoUT Networks With Reinforcement Learning

Yuhan Su et al.

Summary: This article investigates the cooperative communication problem in underwater environments and proposes a reinforcement learning-based underwater relay selection strategy to optimize system performance, improve communication efficiency, and reduce the number of iterations needed for convergence.

IEEE INTERNET OF THINGS JOURNAL (2021)

Article Computer Science, Information Systems

Convergence of Broadband and Broadcast/Multicast in Maritime Information Networks

Jun Du et al.

Summary: The fifth-generation wireless networks have been mainly focusing on terrestrial applications, neglecting maritime communications due to lack of infrastructure. A new maritime information network is proposed to meet oceanic communication needs, incorporating convergence techniques for efficient resource allocation. The study introduces a Software Defined Networking (SDN) based Maritime Giant Cellular Network (MagicNet) architecture, supporting maritime monitoring and marine sensing.

TSINGHUA SCIENCE AND TECHNOLOGY (2021)

Article Computer Science, Information Systems

Two-Hop Relay Probing in WiGig Device-to-Device Networks Using Sleeping Contextual Bandits

Ehab Mahmoud Mohamed et al.

Summary: The study introduces intelligent relaying technology to address coverage and blockage issues in mmWave communication systems. By leveraging the online learning tool S-CMAB and the multi-band capability of WiGig devices, the relay performance is improved and both system throughput and energy efficiency are optimized.

IEEE WIRELESS COMMUNICATIONS LETTERS (2021)

Article Automation & Control Systems

Online Residential Demand Response via Contextual Multi-Armed Bandits

Xin Chen et al.

Summary: Residential loads can enhance electricity systems through demand response programs. A major challenge is how to learn and handle unknown customer behaviors. The study formulates residential DR as a contextual multi-armed bandit problem and develops an online learning and selection algorithm for optimal customer selection in DR programs. Simulation results demonstrate the effectiveness of the proposed algorithm in learning uncertain customer behaviors.

IEEE CONTROL SYSTEMS LETTERS (2021)

Article Computer Science, Information Systems

A High-Availability Data Collection Scheme based on Multi-AUVs for Underwater Sensor Networks

Guangjie Han et al.

IEEE TRANSACTIONS ON MOBILE COMPUTING (2020)

Article Automation & Control Systems

Underwater Internet of Things in Smart Ocean: System Architecture and Open Issues

Tie Qiu et al.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2020)

Article Computer Science, Information Systems

AUV-Aided Energy-Efficient Data Collection in Underwater Acoustic Sensor Networks

Xiaoxiao Zhuo et al.

IEEE INTERNET OF THINGS JOURNAL (2020)

Article Engineering, Multidisciplinary

Jamsa: A Utility Optimal Contextual Online Learning Framework for Anti-Jamming Wireless Scheduling Under Reactive Jamming Attack

Pan Zhou et al.

IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING (2020)

Article Telecommunications

Licensed and Unlicensed Spectrum Management for Cognitive M2M: A Context-Aware Learning Approach

Haijun Liao et al.

IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING (2020)

Article Engineering, Electrical & Electronic

Machine Learning for 6G Wireless Networks: Carrying Forward Enhanced Bandwidth, Massive Access, and Ultrareliable/Low-Latency Service

Jun Du et al.

IEEE VEHICULAR TECHNOLOGY MAGAZINE (2020)

Proceedings Paper Engineering, Electrical & Electronic

Contextual-Bandit based MIMO Relay Selection Policy with Channel Uncertainty

Ankit Gupta et al.

ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC) (2020)

Article Computer Science, Information Systems

Value-Based Hierarchical Information Collection for AUV-Enabled Internet of Underwater Things

Ruiyang Duan et al.

IEEE INTERNET OF THINGS JOURNAL (2020)

Article Computer Science, Information Systems

An AUV-Assisted Data Gathering Scheme Based on Clustering and Matrix Completion for Smart Ocean

Mingfeng Huang et al.

IEEE INTERNET OF THINGS JOURNAL (2020)

Article Computer Science, Information Systems

Scalable Adaptive Networking for the Internet of Underwater Things

Nils Morozs et al.

IEEE INTERNET OF THINGS JOURNAL (2020)

Article Computer Science, Information Systems

AUV-Aided Localization for Internet of Underwater Things: A Reinforcement-Learning-Based Method

Jing Yan et al.

IEEE INTERNET OF THINGS JOURNAL (2020)

Article Automation & Control Systems

An Architecture for Using Autonomous Underwater Vehicles in Wireless Sensor Networks for Underwater Pipeline Monitoring

Imad Jawhar et al.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2019)

Article Engineering, Electrical & Electronic

Adaptive Learning-Based Task Offloading for Vehicular Edge Computing Systems

Yuxuan Sun et al.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2019)

Article Engineering, Electrical & Electronic

Prediction-Based Delay Optimization Data Collection Algorithm for Underwater Acoustic Sensor Networks

Guangjie Han et al.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2019)

Article Engineering, Electrical & Electronic

Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks

Yasar Sinan Nasir et al.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2019)

Article Engineering, Electrical & Electronic

CARMA: Channel-Aware Reinforcement Learning-Based Multi-Path Adaptive Routing for Underwater Wireless Sensor Networks

Valerio Di Valerio et al.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2019)

Article Telecommunications

Contextual Multi-Armed Bandit for Cache-Aware Decoupled Multiple Association in UDNs: A Deep Learning Approach

Chen Dai et al.

IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING (2019)

Article Engineering, Electrical & Electronic

To Relay or Not to Relay: Open Distance and Optimal Deployment for Linear Underwater Acoustic Networks

Yuzhou Li et al.

IEEE TRANSACTIONS ON COMMUNICATIONS (2018)

Article Computer Science, Information Systems

Adaptive Relay Selection and Power Allocation for OFDM Cooperative Underwater Acoustic Systems

Abdollah Doosti-Aref et al.

IEEE TRANSACTIONS ON MOBILE COMPUTING (2018)

Article Telecommunications

Relay Selection in Underwater Acoustic Cooperative Networks: A Contextual Bandit Approach

Xinbin Li et al.

IEEE COMMUNICATIONS LETTERS (2017)

Article Engineering, Electrical & Electronic

Practical Rate Adaptation for Very High Throughput WLANs

Arafet Ben Makhlouf et al.

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (2013)

Article Engineering, Electrical & Electronic

Optimal Relay Selection in IEEE 802.16j Multihop Relay Vehicular Networks

Yu Ge et al.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2010)

Article Engineering, Electrical & Electronic

Underwater Acoustic Communication Channels: Propagation Models and Statistical Characterization

Milica Stojanovic et al.

IEEE COMMUNICATIONS MAGAZINE (2009)

Article Engineering, Electrical & Electronic

Semi-distributed user relaying algorithm for amplify-and-forward wireless relay networks

Jun Cai et al.

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (2008)