Journal
MULTIMEDIA SYSTEMS
Volume 14, Issue 4, Pages 237-253Publisher
SPRINGER
DOI: 10.1007/s00530-008-0141-1
Keywords
multimedia retrieval; spoken document retrieval; speech prosody; story segmentation; topic segmentation
Funding
- National Natural Science Foundation of China [20070699015]
- Natural Science Basic Research Plan in the Shaanxi Province of China [2007F15]
- NPU Aoxiang Star Plan [07XE0150]
- NPU Foundation for Fundamental Research [W018103]
Ask authors/readers for more resources
This paper investigates speech prosody for automatic story segmentation in Mandarin broadcast news. Prosodic cues effectively used in English story segmentation deserve a re-investigation since the lexical tones of Mandarin may complicate the expressions of pitch declination and reset. Our data-oriented study shows that story boundaries cannot be clearly discriminated from utterance boundaries by speaker normalized pitch features due to their large variations across different Mandarin syllable tones. We thus propose to use speaker- and tone-normalized pitch features that can provide clear separations between utterance and story boundaries. Our study also shows that speaker-normalized pause duration is quite effective to separate between story and utterance boundaries, while speaker-normalized speech energy and syllable duration are not effective. Experiments using decision trees for story boundary detection reinforce the difference between English and Chinese, i.e., speaker- and tone-normalized pitch features should be favorably adopted in Mandarin story segmentation. We show that the combination of different prosodic cues can achieve a very high F-measure of 93.04% due to the complementarity between pause, pitch and energy. Analysis of the decision tree uncovered five major heuristics that show how speakers jointly utilize pause duration and pitch to separate speech into stories.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available