Aspects of multisensory perception: The integration of visual and auditory information processing in musical experiences.

UNCG Author/Contributor (non-UNCG co-authors, if there are any, appear on document)
Donald A. Hodges, Professor Emeritus (Creator)
The University of North Carolina at Greensboro (UNCG )
Web Site:

Abstract: One of the requirements for being a successful musical conductor is to be able to locate sounds instantaneously in time and space. Because this requires the integration of auditory and visual information, the purpose of this study was to examine multisensory processing in conductors and a matched set of control subjects. Subjects participated in a series of behavioral tasks, including pitch discrimination, temporal-order judgment (TOJ), and target localization. Additionally, fMRI scans were done on a subset of subjects who performed a multisensory TOJ task. Analyses of behavioral data indicate that, in the auditory realm, conductors were more accurate in both pitch discrimination and TOJs as well as in locating targets In space. Furthermore, these same subjects also demonstrated a benefit from the combination of auditory and visual information that was not observed in control subjects when locating visual targets. Finally, neural substrates in BA 37, 39/40 were identified as potential areas underlying the conductors' superior multisensory TOJs. Data collection and analyses are ongoing and will lead to an improved understanding of multisensory integration in a complex, musical behavior.

Additional Information

The Neurosciences and Music II: From Perception to Performance, Annals of the New York Academy of Sciences, Vol. 1060; 175-185.
Language: English
Date: 2006
multisensory processing; auditory-visual discrimination; temporal-order judgments

Email this document to