Robotics

Article Robotics

Robotic pick-and-place of novel objects in clutter with multi-affordance grasping and cross-domain image matching

Andy Zeng, Shuran Song, Kuan-Ting Yu, Elliott Donlon, Francois R. Hogan, Maria Bauza, Daolin Ma, Orion Taylor, Melody Liu, Eudald Romo, Nima Fazeli, Ferran Alet, Nikhil Chavan Dafle, Rachel Holladay, Isabella Morona, Prem Qu Nair, Druck Green, Ian Taylor, Weber Liu, Thomas Funkhouser, Alberto Rodriguez

Summary: This article presents a robotic pick-and-place system that can grasp and recognize various known and novel objects in cluttered environments without requiring task-specific training data for novel objects.

INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH (2022)

Article Robotics

Learning robust perceptive locomotion for quadrupedal robots in the wild

Takahiro Miki, Joonho Lee, Jemin Hwangbo, Lorenz Wellhausen, Vladlen Koltun, Marco Hutter

Summary: Legged robots that can operate autonomously in remote and hazardous environments will greatly increase opportunities for exploration into underexplored areas. However, effectively utilizing exteroceptive and proprioceptive perception for locomotion remains a grand challenge in robotics.

SCIENCE ROBOTICS (2022)

Review Computer Science, Artificial Intelligence

Transfer Learning for EEG-Based Brain-Computer Interfaces: A Review of Progress Made Since 2016

Dongrui Wu, Yifan Xu, Bao-Liang Lu

Summary: This article reviews journal publications on transfer learning approaches in EEG-based BCIs since 2016. TL methods applied to different paradigms and applications, such as motor imagery and event-related potentials, are reviewed in the context of cross-subject/session and cross-device/task settings. Observations and conclusions provide insights for future research directions.

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2022)

Article Robotics

Past, Present, and Future of Aerial Robotic Manipulators

Anibal Ollero, Marco Tognon, Alejandro Suarez, Dongjun Lee, Antonio Franchi

Summary: This article primarily analyzes the evolution and current trends in aerial robotic manipulation, covering different types of aircraft equipped with various robotic manipulators, including cooperative manipulation and multibody design, and finally presenting the vision of future new generation aerial robotic manipulators.

IEEE TRANSACTIONS ON ROBOTICS (2022)

Review Robotics

Robot Operating System 2: Design, architecture, and uses in the wild

Steven Macenski, Tully Foote, Brian Gerkey, Chris Lalancette, William Woodall

Summary: This article discusses the development of the Robot Operating System (ROS) and the importance of ROS 2, as well as its impact on accelerating reliable deployment of robot systems.

SCIENCE ROBOTICS (2022)

Article Computer Science, Artificial Intelligence

Adaptive control of time delay teleoperation system with uncertain dynamics

Siyu Lu, Yuxi Ban, Xia Zhang, Bo Yang, Shan Liu, Lirong Yin, Wenfeng Zheng

Summary: In this paper, a bilateral adaptive control method based on PEB control structure is proposed to study the uncertainty of dynamic parameters and time delay. The stability and tracking performances of the closed-loop constant time delay teleoperation system are analyzed using Lyapunov stability theory. The simulation results show that the proposed method has good control performance.

FRONTIERS IN NEUROROBOTICS (2022)

Article Computer Science, Artificial Intelligence

Control of Time Delay Force Feedback Teleoperation System With Finite Time Convergence

Jingwen Wang, Jiawei Tian, Xia Zhang, Bo Yang, Shan Liu, Lirong Yin, Wenfeng Zheng

Summary: In this paper, a bilateral continuous finite time adaptive terminal sliding mode control method is designed to improve the practicality of the teleoperation system. Through numerical simulation, it is verified that this method can effectively control the convergence of position tracking error in finite time, and has better system performance and stability.

FRONTIERS IN NEUROROBOTICS (2022)

Article Robotics

FAST-LIO2: Fast Direct LiDAD-Inertial Odometry

Wei Xu, Yixi Cai, Dongjiao He, Jiarong Lin, Fu Zhang

Summary: This article presents FAST-LIO2, a fast, robust, and versatile LiDAR-inertial odometry framework. It introduces two key novelties, the direct registration of raw points to the map and the use of an incremental k-dimensional tree data structure for map maintenance. FAST-LIO2 achieves superior performance compared to existing methods and supports various LiDAR configurations and platforms.

IEEE TRANSACTIONS ON ROBOTICS (2022)

Review Automation & Control Systems

Artificial Intelligence-Enabled Sensing Technologies in the 5G/Internet of Things Era: From Virtual Reality/Augmented Reality to the Digital Twin

Zixuan Zhang, Feng Wen, Zhongda Sun, Xinge Guo, Tianyiyi He, Chengkuo Lee

Summary: With the booming development of 5G and IoT, big data-driven product design is on the rise. The digital twin, empowered by AI algorithms, serves as a cutting-edge technology connecting the physical and virtual worlds through the analysis of various sensor data. However, the high-power consumption and battery replacement issues associated with existing sensor technologies remain to be solved. Triboelectric nanogenerators (TENGs) provide a viable platform for self-sustainable and low-power systems. This article focuses on the recent progress of TENG-based intelligent systems, such as wearable electronics, robot-related systems, and smart homes, and explores the potential future development enabled by sensor fusion technology. Lastly, it discusses the application of artificial intelligence in the design of intelligent sensor systems for the 5G and IoT era.

ADVANCED INTELLIGENT SYSTEMS (2022)

Article Robotics

Telerobotic neurovascular interventions with magnetic manipulation

Yoonho Kim, Emily Genevriere, Pablo Harker, Jaehun Choe, Marcin Balicki, Robert W. Regenhardt, Justin E. Vranic, Adam A. Dmytriw, Aman B. Patel, Xuanhe Zhao

Summary: Advances in robotic technology have been applied to various subspecialties of surgery, but the application in endovascular neurosurgery faces technical challenges. Researchers have developed a teleoperated robotic neurointerventional platform based on magnetic manipulation, which enables navigation of narrow and winding pathways and therapeutic procedures. This system improves the safety and efficiency of surgery, reduces radiation exposure to physicians, and opens up the possibility of remote procedural services in stroke care.

SCIENCE ROBOTICS (2022)

Article Robotics

All-printed soft human-machine interface for robotic physicochemical sensing

You Yu, Jiahong Li, Samuel A. Solomon, Jihong Min, Jiaobing Tu, Wei Guo, Changhao Xu, Yu Song, Wei Gao

Summary: Ultrasensitive multimodal physicochemical sensing for autonomous robotic decision-making is demonstrated using an all-printed, mass-producible soft electronic skin-based human-machine interface. The system incorporates custom-developed nanomaterial inks to manufacture flexible physicochemical sensor arrays for electrophysiology recording, tactile perception, and robotic sensing of hazardous materials. The artificial intelligence-powered system enables remote robotic control and in situ threat compound detection in extreme environments, with user-interactive feedback. The technology has potential applications in various fields, including agriculture, security, and public health.

SCIENCE ROBOTICS (2022)

Review Automation & Control Systems

Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learning

Lukas Brunke, Melissa Greeff, Adam W. Hall, Zhaocong Yuan, Siqi Zhou, Jacopo Panerati, Angela P. Schoellig

Summary: This article reviews recent advances in safe learning methods for real-world robotic deployments from both the control theory and reinforcement learning research communities. It focuses on unifying the language and frameworks used in these fields and discusses learning-based control approaches, reinforcement learning approaches, and safety certification methods for control policies.

ANNUAL REVIEW OF CONTROL ROBOTICS AND AUTONOMOUS SYSTEMS (2022)

Article Engineering, Multidisciplinary

An Improved Tunicate Swarm Algorithm with Best-random Mutation Strategy for Global Optimization Problems

Farhad Soleimanian Gharehchopogh

Summary: This paper introduces the Tunicate Swarm Algorithm (TSA) and its improved version QLGCTSA algorithm, which uses different mutating operators to enhance the algorithm's performance. Experimental results show that the QLGCTSA algorithm outperforms other competing optimization algorithms on various optimization problems.

JOURNAL OF BIONIC ENGINEERING (2022)

Article Computer Science, Interdisciplinary Applications

Hybrid robust convolutional autoencoder for unsupervised anomaly detection of machine tools under noises

Shen Yan, Haidong Shao, Yiming Xiao, Bin Liu, Jiafu Wan

Summary: Anomaly detection of machine tools is crucial in the machinery industry. Deep learning has shown potential in this area, but challenges including the lack of labeled data and noise disturbances still exist. This paper proposes a hybrid robust convolutional autoencoder (HRCAE) to address these challenges and achieves better performance in unsupervised anomaly detection compared to other methods.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2023)

Article Robotics

GVINS: Tightly Coupled GNSS-Visual-Inertial Fusion for Smooth and Consistent State Estimation

Shaozu Cao, Xiuyuan Lu, Shaojie Shen

Summary: This article presents GVINS, a system that tightly fuses GNSS, visual, and inertial information for drift-free state estimation. The system utilizes a coarse-to-fine initialization process and a factor graph framework to connect global measurements with local states and constrain system states. Experimental results demonstrate that our system effectively suppresses VIO drift and maintains local accuracy under noisy GNSS measurements.

IEEE TRANSACTIONS ON ROBOTICS (2022)

Article Robotics

Independent Control Strategy of Multiple Magnetic Flexible Millirobots for Position Control and Path Following

Tiantian Xu, Chenyang Huang, Zhengyu Lai, Xinyu Wu

Summary: This article proposes a novel strategy of completely decoupled independent control of magnetically actuated flexible swimming millirobots and verifies its effectiveness through experiments. This strategy enables independent control of robots with different magnetization directions in the same external magnetic field, laying the foundation for multi-robot collaboration to complete tasks.

IEEE TRANSACTIONS ON ROBOTICS (2022)

Review Automation & Control Systems

Smart Tactile Gloves for Haptic Interaction, Communication, and Rehabilitation

Oliver Ozioko, Ravinder Dahiya

Summary: Wearable human machine interfaces like smart gloves have gained significant interest, offering intuitive two-way haptic interfaces and real-time touch-based information. Various smart glove solutions and applications in interaction, rehabilitation, VR/AR, and AAC tasks have been reviewed, with a focus on e-skin technologies and integrated devices providing touch sensing and vibrotactile actuation. Such advancements hold great potential for various application areas and user experiences in robotics, healthcare, and tactile Internet.

ADVANCED INTELLIGENT SYSTEMS (2022)

Article Computer Science, Interdisciplinary Applications

A Survey of Robot Learning Strategies for Human-Robot Collaboration in Industrial Settings

Debasmita Mukherjee, Kashish Gupta, Li Hsin Chang, Homayoun Najjaran

Summary: In response to increased global competition, manufacturers are required to be more flexible in meeting customer demands, leading to the introduction of human operators and robots for their respective strengths, with a growing interest in shared human-robot workspace. Research in industrial human-robot collaboration focuses on human-robot safety, collaboration modes, and robot autonomy and adaptability.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2022)

Review Computer Science, Interdisciplinary Applications

Vision-based holistic scene understanding towards proactive human-robot collaboration

Junming Fan, Pai Zheng, Shufei Li

Summary: This paper provides a systematic review of computer vision-based holistic scene understanding in human-robot collaboration (HRC) scenarios. It emphasizes the cognition of key elements such as objects, humans, and the environment. The paper also discusses the challenges and potential research directions in achieving proactive HRC.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2022)

Article Robotics

Swarm of micro flying robots in the wild

Xin Zhou, Xiangyong Wen, Zhepei Wang, Yuman Gao, Haojia Li, Qianhao Wang, Tiankai Yang, Haojian Lu, Yanjun Cao, Chao Xu, Fei Gao

Summary: In this research, we developed a miniature swarm platform with autonomous planner and onboard perception, localization, and control functions, enabling swarm navigation and coordination in dense forests and other complex environments. The planner meets various task requirements, can work in a timely and accurate manner based on limited information, and obtains high-quality trajectories through spatial-temporal joint optimization.

SCIENCE ROBOTICS (2022)