Audio-visual interactions between music and the natural environment: Self-reported assessments and measures of facial expressions

Abstract

The interaction between music and the environment has been widely investigated in various domains; however, the effects of music on the perception of outdoor environments have not been adequately examined. A better understanding of audio-visual interactions between music and the natural environment is important for music psychology, because the field is currently employing natural sounds, yet their pairing remains poorly understood. Furthermore, this understanding is vital for soundscape research, given that individuals are increasingly listening to music on headphones in natural settings. This has practical implications wherever music and the natural environment are paired. This study explored the audio-visual interaction between music and the perception of natural environments. Four types of natural images were presented based on their attractiveness/unattractiveness and visual openness/closedness. At the same time, the participants listened to sad or happy music. Both self-reported assessment data and data obtained through automated software analysis of emotional facial expressions represented in the form of emotional engagement were analysed. The results showed that, compared to listening to sad music or no music, exposure to happy music resulted in an increase in self-reported environmental preference. However, sad music did not significantly decrease self-reported environmental preference or self-reported pleasant feelings compared to the control no-music condition. Analysis of the engagement in facial emotional expressions showed that sad music decreased engagement compared to the no-music condition in all types of environments; however, when listening to happy music, the participants’ engagement was lower in unattractive environments but not in attractive environments compared to when they did not listen to any music.