4.6 Review

Technological Solutions for Sign Language Recognition: A Scoping Review of Research Trends, Challenges, and Opportunities

Journal

IEEE ACCESS
Volume 10, Issue -, Pages 40979-40998

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/ACCESS.2022.3161440

Keywords

Assistive technologies; Gesture recognition; Auditory system; Hidden Markov models; Visualization; Speech recognition; Systematics; Sign language recognition; systematic review; sign language visualization

Funding

  1. Faculty of Computer Science and Engineering
  2. Faculty of Computer Science and Engineering, Saints Cyril and Methodius University in Skopje, Skopje, North Macedonia
  3. FCT/MEC through national funds
  4. FEDER-PT2020 Partnership Agreement [UIDB/50008/2020]
  5. European Cooperation in Science and Technology (COST) through the COST Actions [CA19121, CA16226]

Ask authors/readers for more resources

This paper reviews the technological advancements in sign language recognition, visualization, and synthesis, highlighting the importance of technology developments in image processing and deep learning in driving new applications and tools. Analysis of nearly 2000 papers shows the significant impact of these technological advancements on improving performance metrics in sign language-related tasks.
Sign languages are critical in conveying meaning by the use of a visual-manual modality and are the primary means of communication of the deaf and hard of hearing with their family members and with the society. With the advances in computer graphics, computer vision, neural networks, and the introduction of new powerful hardware, the research into sign languages has shown a new potential. Novel technologies can help people learn, communicate, interpret, translate, visualize, document, and develop various sign languages and their related skills. This paper reviews the technological advancements applied in sign language recognition, visualization, and synthesis. We defined multiple research questions to identify the underlying technological drivers that strive to improve the challenges in this domain. This study is designed in accordance with the PRISMA methodology. We searched for articles published between 2010 and 2021 in multiple digital libraries (i.e., Elsevier, Springer, IEEE, PubMed, and MDPI). To automate the initial steps of PRISMA for identifying potentially relevant articles, duplicate removal and basic screening, we utilized a Natural Language Processing toolkit. Then, we performed a synthesis of the existing body of knowledge and identified the different studies that achieved significant advancements in sign language recognition, visualization, and synthesis. The identified trends based on analysis of almost 2000 papers clearly show that technology developments, especially in image processing and deep learning, are driving new applications and tools that improve the various performance metrics in these sign language-related task. Finally, we identified which techniques and devices contribute to such results and what are the common threads and gaps that would open new research directions in the field.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available