4.8 Article

Decoding lip language using triboelectric sensors with deep learning

Related references

Note: Only part of the references are listed.
Review Multidisciplinary Sciences

Wearable triboelectric sensors for biomedical monitoring and human-machine interface

Xianjie Pu et al.

Summary: The growing advocacy of healthy and quality life has led to the emergence of wearable electronics. The triboelectric sensor (TS) has become a key technology in this field, capable of monitoring vital signs and movements of the human body. Advancements in biomedical monitoring over the past 5 years have focused on pulse, respiration, and pressure monitoring, with potential for novel human-machine interfaces (HMIs). Future trends in biomedical monitoring and HMIs based on TSs will continue to be explored.

ISCIENCE (2021)

Article Multidisciplinary Sciences

Low cost exoskeleton manipulator using bidirectional triboelectric sensors enhanced multiple degree of freedom sensory system

Minglu Zhu et al.

Summary: The authors propose a triboelectric bi-directional sensor-based exoskeleton sensory system for monitoring the movements of human upper limb joints and controlling virtual characters and robotic arms in real-time. This system has the potential to be an economic and advanced human-machine interface for various applications such as robotic automation, healthcare, and training.

NATURE COMMUNICATIONS (2021)

Article Multidisciplinary Sciences

AI enabled sign language recognition and VR space bidirectional communication using triboelectric smart glove

Feng Wen et al.

Summary: The study introduces an artificial intelligence enabled system for sign language recognition and communication, which utilizes a deep learning model to recognize words and sentences in sign language, enabling reverse reconstruction of sentences and identification of new sentence combinations. The results of sign language recognition are projected into virtual space and translated into text and audio, facilitating remote bidirectional communication between signers and non-signers.

NATURE COMMUNICATIONS (2021)

Article Nanoscience & Nanotechnology

An epidermal sEMG tattoo-like patch as a new human-machine interface for patients with loss of voice

Huicong Liu et al.

MICROSYSTEMS & NANOENGINEERING (2020)

Article Neurosciences

Machine translation of cortical activity to text with an encoder-decoder framework

Joseph G. Makin et al.

NATURE NEUROSCIENCE (2020)

Article Engineering, Electrical & Electronic

Sign-to-speech translation using machine-learning-assisted stretchable sensor arrays

Zhihao Zhou et al.

NATURE ELECTRONICS (2020)

Article Multidisciplinary Sciences

Deep learning enabled smart mats as a scalable floor monitoring system

Qiongfeng Shi et al.

NATURE COMMUNICATIONS (2020)

Article Multidisciplinary Sciences

Triboelectric nanogenerator sensors for soft robotics aiming at digital twin applications

Tao Jin et al.

NATURE COMMUNICATIONS (2020)

Article Engineering, Electrical & Electronic

Deep learning-enabled triboelectric smart socks for IoT-based gait analysis and VR applications

Zixuan Zhang et al.

NPJ FLEXIBLE ELECTRONICS (2020)

Review Computer Science, Information Systems

Silent Speech Interfaces for Speech Restoration: A Review

Jose A. Gonzalez-Lopez et al.

IEEE ACCESS (2020)

Article Materials Science, Composites

Ultrasensitive paper-based polyaniline/graphene composite strain sensor for Check sign language expression

Qiuping Qian et al.

COMPOSITES SCIENCE AND TECHNOLOGY (2019)

Article Multidisciplinary Sciences

Learning the signatures of the human grasp using a scalable tactile glove

Subramanian Sundaram et al.

NATURE (2019)

Article Materials Science, Multidisciplinary

On the origin of contact-electrification

Zhong Lin Wang et al.

MATERIALS TODAY (2019)

Article Multidisciplinary Sciences

Transcutaneous ultrasound energy harvesting using capacitive triboelectric technology

Ronan Hinchet et al.

SCIENCE (2019)

Article Multidisciplinary Sciences

A bionic stretchable nanogenerator for underwater sensing and energy harvesting

Yang Zou et al.

NATURE COMMUNICATIONS (2019)

Review Chemistry, Multidisciplinary

Wearable and Implantable Triboelectric Nanogenerators

Zhuo Liu et al.

ADVANCED FUNCTIONAL MATERIALS (2019)

Review Computer Science, Artificial Intelligence

Review on Automatic Lip Reading Techniques

Yuanyao Lu et al.

INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE (2018)

Article Multidisciplinary Sciences

Transparent and attachable ionic communicators based on self-cleanable triboelectric nanogenerators

Younghoon Lee et al.

NATURE COMMUNICATIONS (2018)

Article Multidisciplinary Sciences

Skin-inspired highly stretchable and conformable matrix networks for multifunctional sensing

Qilin Hua et al.

NATURE COMMUNICATIONS (2018)

Review Computer Science, Artificial Intelligence

Survey on automatic lip-reading in the era of deep learning

Adriana Fernandez-Lopez et al.

IMAGE AND VISION COMPUTING (2018)

Article Materials Science, Multidisciplinary

On Maxwell's displacement current for energy and sensors: the origin of nanogenerators

Zhong Lin Wang

MATERIALS TODAY (2017)

Article Acoustics

Direct Speech Reconstruction From Articulatory Sensor Data by Machine Learning

Jose A. Gonzalez et al.

IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING (2017)

Article Health Care Sciences & Services

Recognition of sign language with an inertial sensor-based data glove

Kyung-Won Kim et al.

TECHNOLOGY AND HEALTH CARE (2016)

Article Engineering, Biomedical

A Triboelectric-Based Artificial Basilar Membrane to Mimic Cochlear Tonotopy

Jongmoon Jang et al.

ADVANCED HEALTHCARE MATERIALS (2016)

Review Multidisciplinary Sciences

Deep learning

Yann LeCun et al.

NATURE (2015)

Article Chemistry, Multidisciplinary

Triboelectric-Generator-Driven Pulse Electrodeposition for Micropatterning

Guang Zhu et al.

NANO LETTERS (2012)

Article Chemistry, Physical

Flexible triboelectric generator!

Feng-Ru Fan et al.

NANO ENERGY (2012)

Article Engineering, Biomedical

Isolated word recognition of silent speech using magnetic implants and sensors

J. M. Gilbert et al.

MEDICAL ENGINEERING & PHYSICS (2010)

Article Acoustics

Silent speech interfaces

B. Denby et al.

SPEECH COMMUNICATION (2010)

Article Engineering, Biomedical

Development of a (silent) speech recognition system for patients following laryngectomy

M. J. Fagan et al.

MEDICAL ENGINEERING & PHYSICS (2008)

Article Multidisciplinary Sciences

Reducing the dimensionality of data with neural networks

G. E. Hinton et al.

SCIENCE (2006)