期刊
IMAGE ANALYSIS AND PROCESSING, ICIAP 2022 WORKSHOPS, PT I
卷 13373, 期 -, 页码 235-245出版社
SPRINGER INTERNATIONAL PUBLISHING AG
DOI: 10.1007/978-3-031-13321-3_21
关键词
Synchronization; Motion capture; Hand; Finger; Music beats; Dynamic time warping
This paper proposes an innovative and playful method for assessing the synchronization between hand motion and music using the dynamic time warping algorithm. The preliminary study shows that the tempo of the songs affects the level of synchronization performance.
Thanks to various technological progresses such as musical rhythm estimation and motion capture systems, the evaluation of synchronization performances between motion and music beats is today possible. In this paper, we propose an innovative playful method to assess synchronization between hand motion and music. In this application, the hand gestures are tracked from live webcam motion capture based on MediaPipe open-source framework. Musical beats are estimated from the Librosa library. The synchronization between finger motion and beats is then computed from the dynamic time warping algorithm. A preliminary study was conducted with two different songs mixed with tempo beats at different intensities. The results are encouraging and show different levels of performance according to the tempo of the songs.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据