4.6 Review

Technological Solutions for Sign Language Recognition: A Scoping Review of Research Trends, Challenges, and Opportunities

Related references

Note: Only part of the references are listed.
Article Computer Science, Information Systems

PiSLTRc: Position-Informed Sign Language Transformer With Content-Aware Convolution

Pan Xie et al.

Summary: Based on the superiority of the Transformer model in learning long-term dependency, this paper proposes a new model architecture called PiSLTRc, which addresses the issues in sign language understanding by incorporating content-aware and position-aware convolutional layers and injecting relative position information. The experimental results show that the proposed method outperforms the traditional Transformer model on multiple sign language benchmarks.

IEEE TRANSACTIONS ON MULTIMEDIA (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Sign Pose-based Transformer for Word-level Sign Language Recognition

Matyas Bohacek et al.

Summary: This paper presents a word-level sign language recognition system based on the Transformer model. The system aims to be computationally efficient for usage on handheld devices. The recognition is based on estimating the pose of the human body using 2D landmark locations. The proposed system achieves state of the art results on WLASL and LSA64 datasets, with significant improvements in accuracy through pose normalization and augmentation techniques.

2022 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW 2022) (2022)

Article Computer Science, Hardware & Architecture

A pattern recognition model for static gestures in malaysian sign language based on machine learning techniques

Ali H. Alrubayi et al.

Summary: This study presents a pattern recognition model for static gestures in Malaysian Sign Language (MSL) using machine learning techniques, involving two phases of data acquisition and processing to construct an accurate dataset and applying ten different machine learning techniques for gesture recognition.

COMPUTERS & ELECTRICAL ENGINEERING (2021)

Article Engineering, Multidisciplinary

Based on wearable sensory device in 3D-printed humanoid: A new real-time sign language recognition system

M. A. Ahmed et al.

Summary: This study introduces a new real-time sign recognition system based on a wearable sensory glove, which has been tested to effectively recognize complex hand gestures of the Malaysian Sign Language. Through extensive experiments, the system has shown high recognition accuracies for numbers, alphabet letters, and words of MSL, contributing to improving the lifestyle of people with disabilities and bridging the gap between individuals with hearing impairments and the general population.

MEASUREMENT (2021)

Review Computer Science, Artificial Intelligence

Sign Language Recognition: A Deep Survey

Razieh Rastgoo et al.

Summary: Sign language, as a different form of communication language, is crucial for large groups in society, and visual sign language recognition using deep learning approaches has shown significant improvement in recent years. Despite the overall trend indicating increased accuracy, there are still some challenges that need to be addressed in the field of sign language recognition.

EXPERT SYSTEMS WITH APPLICATIONS (2021)

Article Engineering, Electrical & Electronic

Multi-Features Capacitive Hand Gesture Recognition Sensor: A Machine Learning Approach

W. K. Wong et al.

Summary: This research proposed a low-cost gesture recognition device that recognizes gestures by capturing finger capacitance values. The classification of gestures was achieved using machine learning algorithms, with high recognition rates through feature compression and Error Correction Output Code Support Vector Machines comparison analysis.

IEEE SENSORS JOURNAL (2021)

Article Chemistry, Analytical

Intuitive Cognition-Based Method for Generating Speech Using Hand Gestures

Eldad Holdengreber et al.

Summary: The new technology for creating speech does not require prior knowledge of sign language, instead converting hand movements to vocal acoustic sounds, potentially offering a solution for individuals with speech disabilities.

SENSORS (2021)

Article Chemistry, Analytical

Artificial Intelligence Technologies for Sign Language

Ilias Papastratis et al.

Summary: AI technologies are crucial in helping deaf or hearing-impaired people communicate with other communities, facilitating their social inclusion. Recent advancements in technology have enabled the development of various applications to meet the needs of these communities, but challenges still exist. Future research should focus on addressing these challenges to further advance the field.

SENSORS (2021)

Article Computer Science, Artificial Intelligence

Real-time sign language framework based on wearable device: analysis of MSL, DataGlove, and gesture recognition

M. A. Ahmed et al.

Summary: Inspired by using technology to facilitate communication for individuals with hearing and speech impairments, researchers propose a Malaysian Sign Language (MSL) recognition framework. This framework includes three sub-modules for recognizing static isolated signs, and utilizes template-matching algorithms for real-time sign recognition. A DataGlove with 65 data channels is designed to accurately capture both dynamic and static signs of MSL.

SOFT COMPUTING (2021)

Article Engineering, Electrical & Electronic

American Sign Language Recognition Using RF Sensing

Sevgi Z. Gurbuz et al.

Summary: The article proposes the use of RF sensors for remote recognition of ASL, benefiting the Deaf community in human-computer interactions. By studying the linguistic properties of RF ASL data, it is possible to differentiate between sign language and daily activities, as well as design smart environments. Feature-level fusion of RF sensor network data can achieve high accuracy in ASL sign classification.

IEEE SENSORS JOURNAL (2021)

Article Computer Science, Artificial Intelligence

Hand sign language recognition using multi-view hand skeleton

Razieh Rastgoo et al.

EXPERT SYSTEMS WITH APPLICATIONS (2020)

Review Computer Science, Artificial Intelligence

A survey on automatic speech recognition systems for Portuguese language and its variations

Thales Aguiar de Lima et al.

COMPUTER SPEECH AND LANGUAGE (2020)

Proceedings Paper Computer Science, Theory & Methods

Chinese Sign Language Alphabet Recognition Based On Random Forest Algorithm

Simin Yuan et al.

2020 IEEE INTERNATIONAL WORKSHOP ON METROLOGY FOR INDUSTRY 4.0 & IOT (METROIND4.0&IOT) (2020)

Review Computer Science, Artificial Intelligence

A review of hand gesture and sign language recognition techniques

Ming Jin Cheok et al.

INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS (2019)

Review Health Care Sciences & Services

Literature on Wearable Technology for Connected Health: Scoping Review of Research Trends, Advances, and Barriers

Tatjana Loncar-Turukalo et al.

JOURNAL OF MEDICAL INTERNET RESEARCH (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Iterative Alignment Network for Continuous Sign Language Recognition

Junfu Pu et al.

2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) (2019)

Review Computer Science, Artificial Intelligence

Gesture recognition: A review focusing on sign language in a mobile context

Davi Hirafuji Neiva et al.

EXPERT SYSTEMS WITH APPLICATIONS (2018)

Article Computer Science, Artificial Intelligence

Moving object recognition using multi-view three-dimensional convolutional neural networks

Tao He et al.

NEURAL COMPUTING & APPLICATIONS (2017)

Article Computer Science, Artificial Intelligence

Deep learning in vision-based static hand gesture recognition

Oyebade K. Oyedotun et al.

NEURAL COMPUTING & APPLICATIONS (2017)

Article Computer Science, Interdisciplinary Applications

Hand posture and gesture recognition techniques for virtual reality applications: a survey

K. Martin Sagayam et al.

VIRTUAL REALITY (2017)

Article Computer Science, Artificial Intelligence

Automatic recognition of the American sign language fingerspelling alphabet to assist people living with speech or hearing impairments

Luis Quesada et al.

JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING (2017)

Article Computer Science, Artificial Intelligence

Selective temporal filtering and its application to hand gesture recognition

Myung-Cheol Roh et al.

APPLIED INTELLIGENCE (2016)

Article Engineering, Multidisciplinary

Nearest neighbour classification of Indian sign language gestures using kinect camera

Zafar Ahmed Ansari et al.

SADHANA-ACADEMY PROCEEDINGS IN ENGINEERING SCIENCES (2016)

Article Computer Science, Artificial Intelligence

Continuous sign language recognition: Towards large vocabulary statistical recognition systems handling multiple signers

Oscar Koller et al.

COMPUTER VISION AND IMAGE UNDERSTANDING (2015)

Article Medicine, General & Internal

Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement

David Moher et al.

SYSTEMATIC REVIEWS (2015)

Review Health Care Sciences & Services

Scoping reviews: time for clarity in definition, methods, and reporting

Heather L. Colquhoun et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2014)

Article Health Care Sciences & Services

Scoping studies: advancing the methodology

Danielle Levac et al.

IMPLEMENTATION SCIENCE (2010)

Article Medicine, General & Internal

Presbycusis

GA Gates et al.

LANCET (2005)

Article Psychology, Mathematical

SignStream: A tool for linguistic and computer vision research on visual-gestural language data

C Neidle et al.

BEHAVIOR RESEARCH METHODS INSTRUMENTS & COMPUTERS (2001)

Article Engineering, Biomedical

A fuzzy rule-based approach to recognizing 3-D arm movements

MC Su et al.

IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING (2001)

Article Computer Science, Software Engineering

An improved articulated model of the human hand

J McDonald et al.

VISUAL COMPUTER (2001)

Article Computer Science, Artificial Intelligence

Analysis of 3D hand trajectory gestures using stroke-based composite hidden Markov models

IC Kim et al.

APPLIED INTELLIGENCE (2001)

Article Computer Science, Artificial Intelligence

A gesture based interface for human-robot interaction

S Waldherr et al.

AUTONOMOUS ROBOTS (2000)