Beyond Correlation: Acoustic Transformation Methods for the Experimental Study of Emotional Voice and Speech

While acoustic analysis methods have become a commodity in voice emotion research, experiments that attempt not only to describe but to computationally manipulate expressive cues in emotional voice and speech have remained relatively rare. We give here a nontechnical overview of voice-transformation techniques from the audio signal-processing community that we believe are ripe for adoption in this context. We provide sound examples of what they can achieve, examples of experimental questions for which they can be used, and links to open-source implementations. We point at a number of methodological properties of these algorithms, such as being specific, parametric, exhaustive, and real-time, and describe the new possibilities that these open for the experimental study of the emotional voice.

Automated summary

While acoustic analysis methods are commonly used in voice emotion research, experiments that computationally manipulate expressive cues in emotional voice and speech are still rare. This article provides a nontechnical overview of voice-transformation techniques that are ripe for adoption in this context, highlighting their potential applications and methodological properties for the study of emotional voice.