A review of audio-visual interaction on soundscape assessment in urban built environments

The sense of sight or 'visual' plays a crucial role in the perception of soundscape. Since the concept of soundscape is put forward, audio-visual interaction has been incorporated in soundscape research, particularly in urban planning and noise control. The study on audio-visual interactions have not only enhanced and expanded the contents of soundscape assessment, but also helped to develop more comprehensive approaches for the recording and reproduction of audio-visual signals. This paper aims to evaluate the effects of audio-visual interactions on soundscape assessment and noise control through an extensive review of existing literatures. Methodologies of in situ surveys and laboratory experiments are summarized and discussed, which allows a classification system and conceptual framework for soundscape study and design with audio-visual interaction to be constructed. Accordingly, this framework can provide a guideline for the methodologies to be used in future audio-visual assessments of soundscapes and blueprint for how an audio-visual experiment should be designed. (C) 2020 Elsevier Ltd. All rights reserved.