Project description
In this line of research, we explore the intriguing world of cross-modal associations involving auditory stimuli by examining how people from different cultures perceive connections between music and images, shapes, colours, emotions, and words. Participants from across the world will help understand how musical features, such as timbre and melodic contour, are associated with non-auditory features.
This research could provide insights into how universal elements of music perception, cultural, and musical background shape our experience of music. By delving into the intricate relationships between sound, images, and language, the project seeks to enhance our understanding of human perception and cultural diversity in the realm of music.
In June 2025, the Research Council of Finland funded FRAMES: Fine-gRaining Audiovisual cross-Modal corrESpondences, a project based on this research.
The first publication related to this research (pre-FRAMES) can be found here (open access):
Di Stefano, N.*, Ansani, A., Schiavio, A.*, & Spence, C. (2024). Prokofiev was (almost) right: A cross-cultural investigation of auditory-conceptual associations in Peter and the Wolf. Psychonomic Bulletin & Review, 31, 1735–1744.https://doi.org/10.3758/s13423-023-02435-7
The second publication can be found here (open access):
Di Stefano, N., Ansani, A., Schiavio, A., Saarikallio, S., & Spence, C. (2025). Audiovisual Associations in Saint-Saëns’ Carnival of the Animals: A Cross-Cultural Investigation on the Role of Timbre. Empirical Studies of the Arts, 43(2), 1162-1180. https://doi.org/10.1177/02762374241308810
And here's the third (open access):
Di Stefano, N., Ansani, A., Focaroli, V., Borsella, R., Formenti, G., Velardi, A., Schiavio, A., & Spence, C. (2026). Auditory-conceptual associations in Peter and the Wolf and Carnival of the Animals: Evidence from 6-9 year-old children. Psychonomic Bulletin & Review, 33(1). https://doi.org/10.3758/s13423-025-02804-4
We have also published (open access) in collaboration with Dr. R. D. Wanke (Centre for Interdisciplinary Studies; University of Coimbra, Portugal):
Wanke, R., Ansani, A., Di Stefano, N., & Spence, C. (2025). Exploring auditory morphodynamics: Audiovisual associations in sound-based music. i-Perception, 16(4). https://doi.org/10.1177/20416695251338718
Furthermore, four articles are currently under review. In one, we attempted to cross-culturally map the 12 musical intervals onto several extra-auditory dimensions (e.g., gustatory, spatial & physical attributes, emotional/affective, tactile, colour, and shape). In the second one, we explored the cross-modal associations of the same compositions in children with Williams Syndrome. In the third one, some physical properties of static stimuli were successfully mapped onto some auditory features. Lastly, in the fourth article, we explore some associations between trait creativity and increased association scores in an audiovisual task.
- Ansani, A.*, Di Stefano, N.*, Schiavio, A., Saarikallio, S., Toiviainen, P., Brattico, E., & Spence, C. (in review). Consonance and dissonance shape the multisensory and emotional mappings of musical intervals across Western and Eastern cultures.
- Di Stefano, N., Ansani, A., Alfieri, P., Schiavio, A., & Spence, C. (in review). Auditory-conceptual associations in individuals with Williams Syndrome.
- Ansani, A.*, & Wanke, R*. (in review). Audiovisual Correspondences Through Morphodynamics: Mapping Auditory Spectrotemporal Patterns to Material Properties.
- Schiavio, A., Ansani, A., Di Stefano, N., Kempf, A., Spence, C., & Benedek, M. (in review). Higher creativity is linked to increased association scores in an audiovisual task.
Note. Equal contributions are indicated with an asterisk (*)
