Journal
PATTERN RECOGNITION LETTERS
Volume 30, Issue 6, Pages 623-633Publisher
ELSEVIER
DOI: 10.1016/j.patrec.2008.12.010
Keywords
Sign language recognition; Subunit; Phoneme; Hand motion; Dynamic time warping
Categories
Funding
- EU Marie Curie Incoming International Fellowship [509477]
Ask authors/readers for more resources
Modelling and segmenting subunits is one of the important topics in sign language study. Many scholars have proposed the functional definition to subunits from the view of linguistics while the problem of efficiently implementing it using computer vision techniques is a challenge. On the other hand, a number of subunit segmentation work has been investigated for the task of vision-based sign language recognition whereas their subunits either somewhat lack the linguistic support or are improper. In this paper, we attempt to define and segment subunits using computer vision techniques, which also can be basically explained by sign language linguistics. A subunit is firstly defined as one continuous visual hand action in time and space, which comprises a series of interrelated consecutive frames. Then, a simple but efficient solution is developed to detect the Subunit boundary using hand motion discontinuity. Finally, temporal clustering by dynamic time warping is adopted to merge similar segments and refine the results. The presented work does not need prior knowledge of the types of signs or number of subunits and is more robust to signer behaviour variation. Furthermore, it correlates highly with the definition of syllables in sign language while sharing characteristics of syllables in spoken languages, A set of comprehensive experiments on real-world signing videos demonstrates the effectiveness of the proposed model. (C) 2009 Elsevier B.V. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available