An automated piecewise synthesis method for cetacean tonal sounds based on time-frequency spectrogram

Bionic signal waveform design plays an important role in biological research, as well as bionic underwater acoustic detection and communication. Most conventional methods cannot construct high-similarity bionic waveforms to match complex cetacean sounds or easily modify the time-frequency structure of the synthesized bionic signals. In our previous work, we proposed a synthesis and modification method for cetacean tonal sounds, but it requires a lot of manpower to construct each bionic signal segment to match the tonal sound contour. To solve these problems, an automated piecewise synthesis method is proposed. First, based on the time-frequency spectrogram of each tonal sound, the fundamental contour and each harmonic contour of the tonal sound is automatically recognized and extracted. Then, based on the extracted contours, four sub power frequency modulation bionic signal models are combined to match cetacean sound contours. Finally, combining the envelopes of the fundamental frequency and each harmonic, the synthesized bionic signal is obtained. Experimental results show that the Pearson correlation coefficient (PCC) between all true cetacean sounds and their corresponding bionic signals are higher than 0.95, demonstrating that the proposed method can automatically imitate all kinds of simple and complex cetacean tonal sounds with high similarity. (c) 2022 Acoustical Society of America.

Automated summary

An automated piecewise synthesis method is proposed in this study to automatically imitate various simple and complex cetacean tonal sounds with high similarity.