Abstract
This paper presents a preliminary study on the relation between audio-video streams and high-level information related to expressive nuances. A violinist was asked to play three musical excerpts several times, each one inspired by one of nine different expressive intentions. Perceptual tests was carried out using both audio-only and audio-visual recordings of the performances. The results demonstrate that the visual component aids the subjects to better recognize the different expressive intentions of the musical performances, showing that the fusion of audio-visual information can significantly improve the degree of recognition given by single means.
Chapter PDF
Similar content being viewed by others
References
Bigand, E., Vieillard, S., Madurell, F., Marozeau, J., Dacquet, A.: Multidimensional scaling of emotional responses to music: The effect of musical expertise and of the duration of the excerpts. Cognition and Emotion 19(8), 1113–1139 (2005)
Camurri, A., De Poli, G., Leman, M., Volpe, G.: Communicating expressiveness and affect in multimodal interactive systems. IEEE Multimedia 12(1), 43–53 (2005)
Canazza, S., De Poli, G., Rodà, A.: Analysis of expressive intentions in piano performance. Journal of ITC Sangeet Research Academy 16, 23–62 (2002)
Castellano, G., Mortillaro, M., Camurri, A., Volpe, G., Scherer, K.: Automated analysis of body movement in emotionally expressive piano performances. Music Perception 26(2), 103–119 (2008)
Dahl, S., Friberg, A.: Visual perception of expressiveness in musician’s body movements. Music Perception 24, 433–454 (2007)
Downie, J.S.: Music information retrieval. Annual Review of Information Science and Technology 37, 295–340 (2003)
Juslin, P.N., Sloboda, J.A.: Music and emotion. Theory and research. Oxford University Press, Oxford (2001)
Kirke, A., Miranda, E.R.: A survey of computer systems for expressive music performance. ACM Computing Surveys 42(1) (2009)
Mion, L., De Poli, G.: Score-independent audio features for description of music expression. IEEE Trans. Speech, Audio, and Language Process. 16(2), 458–466 (2008)
Orio, N.: Music retrieval: A tutorial and review. Foundations and Trends in Information Retrieval 1(1), 1–90 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Visentini, I., Rodà, A., Canazza, S., Snidaro, L. (2011). Audio-Video Analysis of Musical Expressive Intentions. In: Maino, G., Foresti, G.L. (eds) Image Analysis and Processing – ICIAP 2011. ICIAP 2011. Lecture Notes in Computer Science, vol 6979. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24088-1_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-24088-1_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24087-4
Online ISBN: 978-3-642-24088-1
eBook Packages: Computer ScienceComputer Science (R0)