Journal
FRONTIERS IN NEUROSCIENCE
Volume 10, Issue -, Pages -Publisher
FRONTIERS MEDIA SA
DOI: 10.3389/fnins.2016.00385
Keywords
sonification; movement; learning; sensori-motor; sound design; interactive systems
Categories
Funding
- French National Research Agency (LEGOS project) [ANR-11-BS02-012]
- Labex SMART (French state funds) [ANR-11-IDEX-0004-02]
Ask authors/readers for more resources
This article reports on an interdisciplinary research project on movement sonification for sensori-motor learning. First, we describe different research fields which have contributed to movement sonification, from music technology including gesture-controlled sound synthesis, sonic interaction design, to research on sensori-motor learning with auditory-feedback. In particular, we propose to distinguish between sound-oriented tasks and movement-oriented tasks in experiments involving interactive sound feedback. We describe several research questions and recently published results on movement control, learning and perception. In particular, we studied the effect of the auditory feedback on movements considering several cases: from experiments on pointing and visuo-motor tracking to more complex tasks where interactive sound feedback can guide movements, or cases of sensory substitution where the auditory feedback can inform on object shapes. We also developed specific methodologies and technologies for designing the sonic feedback and movement sonification. We conclude with a discussion on key future research challenges in sensori-motor learning with movement sonification. We also point out toward promising applications such as rehabilitation, sport training or product design.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available