4.7 Article

VisTac Toward a Unified Multimodal Sensing Finger for Robotic Manipulation

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Chemistry, Multidisciplinary

Soft Robotic Perception System with Ultrasonic Auto-Positioning and Multimodal Sensory Intelligence

Qiongfeng Shi et al.

Summary: A soft robotic perception system with remote object positioning and multimodal cognitive capability is developed by integrating an ultrasonic sensor with flexible triboelectric sensors. The system allows for accurate object positioning and identification, expanding the adaptability of current soft robotic systems in various applications.

ACS NANO (2023)

Article Computer Science, Artificial Intelligence

RGB-D SLAM in Dynamic Environments Using Point Correlations

Weichen Dai et al.

Summary: In this paper, a method for simultaneous localization and mapping (SLAM) is proposed to eliminate the influence of moving objects in dynamic environments. The method utilizes the correlation between map points to separate static scene points and points belonging to different moving objects into different groups. Experimental results demonstrate that the proposed method achieves robust and accurate performance in various environments.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Multidisciplinary Sciences

Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions

Zhongda Sun et al.

Summary: This paper introduces a highly integrated ring for augmented interactions in virtual reality. The ring has multimodal sensing and feedback capabilities, enabling tactile perception and haptic feedback, and can be driven by a low-power wireless platform. By combining multimodal sensing and feedback functions, an interactive metaverse platform with cross-space perception capability is achieved, providing an immersive virtual social experience.

NATURE COMMUNICATIONS (2022)

Article Robotics

DelTact: A Vision-Based Tactile Sensor Using a Dense Color Pattern

Guanlan Zhang et al.

Summary: This paper proposes a new design of a vision-based tactile sensor, DelTact, which achieves high accuracy and low error in contact deformation tracking through optimizing color pattern generation and optical flow algorithm. Experimental results demonstrate that the sensor has low error and high frequency characteristics.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Robotics

Finger-STS: Combined Proximity and Tactile Sensing for Robotic Manipulation

Francois R. Hogan et al.

Summary: This paper introduces and develops novel touch sensing technologies that enable robots to better sense and react to intermittent contact interactions. The Finger-STS sensor provides multimodal feedback for robot localization and guiding tasks.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Proceedings Paper Robotics

Multimodal Proximity and Visuotactile Sensing With a Selectively Transmissive Soft Membrane

Jessica Yin et al.

Summary: This paper presents a novel multimodal visuotactile sensor that combines vision, touch, and proximity depth sensing capabilities. The sensor provides crucial information during the transition of target objects from static contact to dynamic motion, enabling sensor-based control in dynamic manipulation.

2022 IEEE 5TH INTERNATIONAL CONFERENCE ON SOFT ROBOTICS (ROBOSOFT) (2022)

Article Robotics

Cable manipulation with a tactile-reactive gripper

Yu She et al.

Summary: This paper presents a novel perception and control framework for real-time cable following using robotic grippers equipped with vision-based tactile sensors. By combining two tactile-based controllers, the system successfully achieves cable gripping and alignment, preventing the cable from slipping out of the gripper.

INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH (2021)

Article Computer Science, Artificial Intelligence

On the Design and Development of Vision-based Tactile Sensors

Umer Hameed Shah et al.

Summary: This paper reviews the existing designs of vision-based tactile sensors (VBTS) reported in the literature and discusses different design modalities and aspects. The paper aims to investigate current manufacturing trends and component selection criteria for developing a complete VBTS system, as well as identify challenges in VBTS development technology and recommend future research directions to overcome them.

JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS (2021)

Article Chemistry, Multidisciplinary

Artificial Intelligence of Things (AIoT) Enabled Virtual Shop Applications Using Self-Powered Sensor Enhanced Soft Robotic Manipulator

Zhongda Sun et al.

Summary: The rapid advancements in AIoT technology have enabled the development of a digital-twin-based remote interactive system for advanced robotic-enabled industrial automation and virtual shopping. Through the integration of multifunctional perception systems and smart soft robotic manipulators, with the aid of machine learning, the system can automatically recognize objects and provide real-time feedback to users, showing great potential as an advanced human-machine interface.

ADVANCED SCIENCE (2021)

Proceedings Paper Automation & Control Systems

GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Finger

Shaoxiong Wang et al.

Summary: Vision-based tactile sensors have the potential to provide important contact geometry for localizing objectives with visual occlusion. The GelSight Wedge sensor is optimized for compact robot fingers, achieving high-resolution 3D reconstruction and showing flexibility in design. The effectiveness and potential of the reconstructed 3D geometry for pose tracking in 3D space is demonstrated.

2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021) (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Seeing Through your Skin: Recognizing Objects with a Novel Visuotactile Sensor

F. R. Hogan et al.

Summary: This study introduces a new sensor named STS that combines visual imaging with high-resolution tactile sensing for object recognition and metrology. The sensor demonstrates dual sensing capabilities, capturing visual perspectives beyond the contact surface, and is validated for classifying household objects and recognizing fine textures.

2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021) (2021)

Review Engineering, Electrical & Electronic

Visual Sensors Hardware Platforms: A Review

Daniel G. Costa

IEEE SENSORS JOURNAL (2020)

Article Engineering, Electrical & Electronic

A Novel Dynamic-Vision-Based Approach for Tactile Sensing Applications

Fariborz Baghaei Naeini et al.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2020)

Review Engineering, Electrical & Electronic

Visuotactile Sensors With Emphasis on GelSight Sensor: A Review

Alexander C. Abad et al.

IEEE SENSORS JOURNAL (2020)

Proceedings Paper Automation & Control Systems

Low-cost GelSight with UV Markings: Feature Extraction of Objects Using AlexNet and Optical Flow without 3D Image Reconstruction

Alexander C. Abad et al.

2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA) (2020)

Review Chemistry, Analytical

Tactile Image Sensors Employing Camera: A Review

Kazuhiro Shimonomura

SENSORS (2019)

Review Chemistry, Analytical

Recent Progress in Technologies for Tactile Sensors

Cheng Chi et al.

SENSORS (2018)

Review Materials Science, Multidisciplinary

Recent progresses on flexible tactile sensors

Yongbiao Wan et al.

MATERIALS TODAY PHYSICS (2017)

Article Neurosciences

Intracranial Cortical Responses during Visual-Tactile Integration in Humans

Brian T. Quinn et al.

JOURNAL OF NEUROSCIENCE (2014)

Review Engineering, Multidisciplinary

Tactile sensors for robotic applications

Pedro Silva Girao et al.

MEASUREMENT (2013)

Article Engineering, Industrial

Tactile sensing in intelligent robotic manipulation - a review

J Tegin et al.

INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION (2005)

Article Computer Science, Artificial Intelligence

A flexible new technique for camera calibration

ZY Zhang

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2000)