Zusammenfassung
Das Kapitel gibt einen ersten Überblick über den Kenntnisstand zur gemeinsamen Verarbeitung der Information aus verschiedenen Sinnen beim Menschen. Behandelt werden Prozesse der multisensorischen Integration redundanter Information und der multisensorischen Kombination, das Problem der Zuordnung zusammengehöriger Information aus verschiedenen Sinnen, Mechanismen des Abgleichs zwischen den Sinnen, die Rolle der Aufmerksamkeit sowie die neurophysiologischen Grundlagen multisensorischer Verarbeitung. Anhand von Beispielen aus Ergonomie und Klinik wird die Anwendbarkeit der Erkenntnisse verdeutlicht.
Schlüsselwörter: Multisensorisch; Multimodal; Intersensorisch; Redundante Information; Signalintegration; Adaptation; Rekalibrierung; Crossmodale Aufmerksamkeit; Multisensorische Areale
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Literatur
Adams, W. J., Graf, E. W., & Ernst, M. O. (2004). Experience can change the ’light-from-above’ prior. Nature Neuroscience, 7(10), 1057–1058.
Alais, & Burr, D. (2004). The ventriloquist effect results from near-optimal bimodal integration. Current Biology, 14(3), 257–262.
Allman, B. L., Keniston, L. P., & Meredith, M. A. (2009). Not just for bimodal neurons anymore: The contribution of unimodal neurons to cortical multisensory processing. Brain Topography, 21, 157–167.
Alsius, A., Navarra, J., & Soto-Franco, S. (2007). Attention to touch weakens audiovisual speech integration. Experimental Brain Research, 183, 399–404.
Amedi, A., Malach, R., Hendler, T., Peled, S., & Zohary, E. (2001). Visuo-haptic object-related activation in the ventral visual pathway. Nature Neuroscience, 4, 324–330.
Amedi, A., Kriegstein, K. von, Atteveldt, N. M. van, Beauchamp, M. S., & Naumer, M. J. (2005). Functional imaging of crossmodal identification and object recognition. Experimental Brain Research, 166, 559–571.
Atkins, J. E., Jacobs, R. A., & Knill, D. C. (2003). Experience-dependent visual cue recalibration based on discrepancies between visual and haptic percepts. Vision Research, 43, 2603–2613.
Atteveldt, N. van, Formisano, E., Goebel, R., & Blomert, L. (2004). Integration of letters and speech sounds in the human brain. Neuron, 43, 271–282.
Avillac, M., Hamed, B. S., & Duhamel, J. R. (2007). Multisensory integration in the ventral intraparietal area of the macaque monkey. Journal of Neuroscience, 27(8), 1922–1932.
Barraclough, N. E., Xiao, D., Baker, C. I., Oram, M. W., & Perrett, D. I. (2005). Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. Journal of Cognitive Neuroscience, 17(3), 377–391.
Barrett, A. M., Goedert, K. M., & Basso, J. C. (2012). Prism adaptation for spatial neglect after stroke: Translational practice gaps. Nature Reviews Neurology, 8(10), 567–577.
Bedford, F. L. (1999). Keeping perception accurate. Trends in Cognitive Sciences, 3, 4–12.
Beers, R. J. van, Sittig, A. C., & Gon, J. J. D. van der (1999). Integration of proprioceptive and visual position information: An experimentally supported model. Journal of Neurophysiology, 81(3), 1355–1364.
Behrmann, M., Watt, S., Black, S. E., & Barton, J. J. S. (1997). Impaired visual search in patients with unilateral neglect: An oculographic analysis. Neuropsychologia, 35, 1445–1458.
Bell, A. H., Meredith, M. A., Opstal, A. J. van, & Munoz, D. P. (2005). Crossmodal integration in the primate superior colliculus underlying the preparation and initiation of saccadic eye movements. Journal of Neurophysiology, 93(6), 3659–3673.
Bernstein, I. H., & Edelstein, B. A. (1971). Effects of some variations in auditory input upon visual choice reaction time. Journal of Experimental Psychology, 87, 242–247.
Bertelson, P., & Aschersleben, G. (1998). Automatic visual bias of perceived auditory location. Psychonomic Bulletin & Review, 5(3), 482–489.
Bertelson, P., & Radeau, M. (1981). Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Perception & Psychophysics, 29, 578–584.
Bertelson, P., Vroomen, J., Gelder, B. de, & Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception & Psychophysics, 62, 321–332.
Bertelson, P., Frissen, I., Vroomen, J., & Gelder, B. de (2006). The aftereffects of ventriloquism: Patterns of spatial generalization. Perception & Psychophysics, 68, 428–436.
Bisiach, E., & Luzzatti, C. (1978). Unilateral neglect of representational space. Cortex, 14, 129–133.
Blanke, O. (2009). Multisensory brain mechanisms of bodily self-consciousness. Nature Reviews Neuroscience, 13, 556–571.
Bremmer, F., Klam, F., Duhamel, J. R., Hamed, B. S., & Graf, W. (2002). Visual-vestibular interactive responses in the macaque ventral intraparietal area (VIP). European Journal of Neuroscience, 16, 1569–1586.
Bresciani, J. P., Dammeier, F., & Ernst, M. O. (2008). Tri-modal integration of visual, tactile and auditory signals for the perception of sequences of events. Brain Research Bulletin, 75(6), 753–760.
Bresciani, J. P., Ernst, M. O., Drewing, K., Bouyer, G., Maury, V., & Kheddar, A. (2005). Feeling what you hear: Auditory signals can modulate tactile taps perception. Experimental Brain Research, 162, 172–180.
Brosch, M., Selezneva, E., & Scheich, H. (2005). Nonauditory events of a behavioral procedure activate auditory cortex of highly trained monkeys. Journal of Neuroscience, 25(29), 6797–6806.
Bruns, P., Liebnau, R., & Röder, B. (2011). Cross-modal training induces changes in spatial representations early in the auditory processing pathway. Psychological Science, 22, 1120–1126.
Budinger, E., Heil, P., Hess, A., & Scheich, H. (2006). Multisensory processing via early cortical stages: Connections of the primary auditory cortical field with other sensory systems. Neuroscience, 143, 1065–1083.
Calvert, G. A., & Thesen, T. (2004). Multisensory integration: Methodological approaches and emerging principles in the human brain. Journal of Physiology-Paris, 98(1–3), 191–205.
Calvert, G. A., Campbell, R., & Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology, 10(11), 649–657.
Cappe, C., Morel, A., Barone, P., & Rouiller, E. M. (2009). The thalamocortical projection systems in primate: An anatomical support for multisensory and sensorimotor interplay. Cerebral Cortex, 19, 2025–2037.
Cellini, C., Kaim, L., & Drewing, K. (2013). Visual and Haptic integration in the estimation of softness of deformable objects. i-Perception, 4, 516–531.
Chen, L. H., & Vroomen, J. (2013). Intersensory binding across space and time: A tutorial review. Attention, Perception & Psychophysics, 75(5), 790–811.
Clower, D. M., & Boussaoud, D. (2000). Selective use of perceptual recalibration versus visuomotor skill acquisition. Journal of Neurophysiology, 84(5), 2703–2708.
Cohen, Y. E., & Andersen, R. A. (2000). Reaches to sounds encoded in an eye-centered reference frame. Neuron, 27(3), 647–652.
Colin, C., Radeau, M., Deltenre, P., & Morais, J. (2001). Rules of intersensory integration in spatial scene analysis and speechreading. Psychologica Belgica, 41, 131–144.
Corbetta, M., Kincade, M. J., Lewis, C., Snyder, A. Z., & Sapir, A. (2005). Neural basis and recovery of spatial attentional deficits in spatial neglect. Nature Neuroscience, 8, 1424–1425.
Cressman, E. K., & Henriques, D. Y. (2010). Reach adaptation and proprioceptive recalibration following exposure to misaligned sensory input. Journal of Neurophysiology, 103, 1888–1895.
Diederich, A., & Colonius, H. (2004). Bimodal and trimodal multisensory enhancement: Effects of stimulus onset and intensity on reaction time. Perception & Psychophysics, 66, 1388–1404.
Diller, L., & Weinberg, J. (1977). Hemi-inattention in rehabilitation: The evolution of a rational remediation program. Advances in Neurology, 18, 63–82.
DiLuca, M., Machulla, T., & Ernst, M. O. (2009). Recalibration of multisensory simultaneity: Cross-modal transfer coincides with a change in perceptual latency. Journal of Vision, 9, 1–16.
Dogangil, G., Davies, B. L., & Rodriguez y Baena, F. (2010). A review of medical robotics for minimally invasive soft tissue surgery. Journal of Engineering in Medicine, 224(5), 653–679.
Drewing, K., & Kaim, L. (2009). Haptic shape perception from force and position signals varies with exploratory movement direction and the exploring finger. Attention, Perception & Psychophysics, 71(5), 1174–1184.
Driver, J., & Noesselt, T. (2008). Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments. Neuron, 57, 11–23.
Driver, J., & Spence, C. (2004). Crossmodal spatial attention: Evidence from human performance. In C. Spence, & J. Driver (Hrsg.), Crossmodal Space and Crossmodal Attention (S. 179–220). Oxford: Oxford University Press.
Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 429–433.
Ernst, M. O., & Bülthoff, H. H. (2004). Merging the senses into a robust percept. Trends in Cognitive Sciences, 8(4), 162–169.
Evans, K. K., & Treisman, A. (2010). Natural cross-modal mappingsbetween visual and auditory features. Journal of Vision, 10(1), 1–12.
Fairhall, S. L., & Macaluso, E. (2009). Spatial attention can modulate audiovisual integration at multiple cortical and subcortical sites. European Journal of Neuroscience, 29, 1247–1257.
Falchier, A., Schroeder, C., Hackett, T., Lakatos, P., Nascimento-Silva, S., Ulbert, I., Karmos, G., & Smiley, J. (2009). Projection from visual areas V2 and prostriata to caudal auditory cortex in the monkey. Cerebral Cortex, 20(7), 1529–1538.
Ferre, M., Buss, M., Aracil, R., Melchiorri, C., & Balaguer, C. (Hrsg.). (2007). Advances in Telerobotics. Berlin: Springer.
Frassinetti, F., Angeli, V., Meneghello, F., Avanzi, S., & Ladavas, E. (2002). Long-lasting amelioration of visuospatial neglect by prism adaptation. Brain, 125, 608–623.
Freides, D. (1974). Human information processing and sensory modality :Cross-modal functions, information complexity, memory, and deficit. Psychological Bulletin, 81(5), 284–310.
Fruhmann-Berger, M., & Karnath, H. O. (2005). Spontaneous eye and head position in patients with spatial neglect. Journal of Neurology, 252, 1194–1200.
Fu, K. M. G., Johnston, T. A., Shah, A. S., Arnold, L., Smiley, J., Hackett, T. A., Garraghty, P. E., & Schroeder, C. E. (2003). Auditory cortical neurons respond to somatosensory stimulation. Journal of Neuroscience, 23, 7510–7515.
Fujisaki, W., Shimojo, S., Kashino, M., & Nishida, S. (2004). Recalibration of audiovisual simultaneity. Nature Neuroscience, 7, 773–778.
Gallace, A., & Spence, C. (2006). Multisensory synesthetic interactions in the speeded classification of visual size. Perception & Psychophysics, 68, 1191–1203.
Geisler, W. S. (2003). Ideal Observer Analysis. In L. M. Chalupa, & J. S. Werner (Hrsg.), The Visual Neurosciences (S. 825–837). Cambridge: MIT Press.
Gepshtein, S., Burge, J., Ernst, M. O., & Banks, M. S. (2005). The combination of vision and touch depends on spatial proximity. Journal of Vision, 5, 1013–1023.
Ghazanfar, A. A., & Schroeder, C. E. (2006). Is the neocortex essentially multisensory? Trends in Cognitive Science, 10, 278–285.
Ghazanfar, A. A., Maier, J. X., Hoffman, K. L., & Logothetis, N. K. (2005). Multisensory integration of dynamic faces and voices in rhesusmonkey auditory cortex. Journal of Neuroscience, 25(20), 5004–5012.
Gray, R., Spence, C., Ho, C., & Tan, H. Z. (2013). Efficient multimodal cuing of spatial attention. Proceedings of IEEE, 101(9), 2113–2122.
Hagen, M. C., Franzén, O., McGlone, F., Essick, G., Dancer, C., & Pardo, J. V. (2002). Tactile motion activates the human middle temporal/V5 (MT/VT) complex. European Journal of Neuroscience, 16(5), 957–964.
Harris, C. S. (1965). Perceptual adaptation to inverted, reversed, and displaced vision. Psychological Review, 72(6), 419–444.
Hartline, P. H., Vimal, R. L., King, A. J., Kurylo, D. D., & Northmore, D. P. (1995). Effects of eye position on auditory localization and neural representation of space in superior colliculus of cats. Experimental Brain Research, 104, 402–408.
Hay, J. C., & Pick, H. L. (1966). Visual and proprioceptive adaptation to optical displacement of the visual stimulus. Journal of Experimental Psychology, 71, 150–158.
Helbig, H. B., & Ernst, M. O. (2008). Visual-haptic cue weighting is independent of modality-specific attention. Journal of Vision, 8(1), 1–16.
Held, R. (1965). Plasticity in sensory-motor systems. Scientific American, 213(5), 84–94.
Helmholtz, H. v (1909). Handbuch der physiologischen Optik (3. Aufl.). Leipzig: Leonard Voss.
Henriques, D. Y., & Cressman, E. K. (2012). Visuomotor adaptation and proprioceptive recalibration. Journal of Motor Behavior, 44(6), 435–444.
Hikosaka, K. (1993). The polysensory region in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. Biomedical Research, 14, 41–45.
Ho, & Spence, C. (2005). Assessing the effectiveness of various auditory cues in capturing a driver’s visual attention. Journal of Experimental Psychology: Applied, 11(3), 157–174.
Ho, & Spence, C. (2008). The multisensory driver: Implications for ergonomic car interface design. Hampshire: Ashgate Publishing.
Ho, C., Tan, H. Z., & Spence, C. (2005). Using spatial vibrotactile cues to direct visual attention in driving scenes. Transportation Research Part F: Traffic Psychology and Behavior, 8(6), 397–412.
Ho, C., Tan, H. Z., & Spence, C. (2006). The differential effect of vibrotactile and auditory cues on visual spatial attention. Ergonomics, 49(7), 724–738.
Ho, C., Reed, N., & Spence, C. (2007). Multisensory in-car warning signals for collision avoidance. Human Factors, 49(6), 1107–1114.
Huang, R. S., Chen, C. F., Tran, A. T., Holstein, K. L., & Sereno, M. I. (2012). Mapping multisensory parietal face and body areas in humans. Proceedings of the National Academy of Sciences, 109(44), 18114–18119.
Husain, M., Mannan, S., Hodgson, T., Wojciulik, E., Driver, J., & Kennard, C. (2001). Impaired spatial working memory across saccades contributes to abnormal search in parietal neglect. Brain, 124, 941–952.
Kadunce, D. C., Vaughan, J. W., Wallace, M. T., & Stein, B. E. (2001). The influence of visual and auditory receptive field organization on multisensory integration in the superior colliculus. Experimental Brain Research, 139, 303–310.
Kaplan, R. F., Verfaellie, M., Meadows, M. E., Caplan, L. R., Pessin, M. S., & DeWitt, L. D. (1991). Changing attentional demands in left hemispatial neglect. Archives of Neurology, 48, 1263–1266.
Karnath, H. O. (2006). Neglect. In H. O. Karnath, & P. Thier (Hrsg.), Neuropsychologie (S. 213–222). Berlin: Springer.
Kayser, C., Petkov, C. I., Augath, M., & Logothetis, N. K. (2005). Integration of touch and sound in auditory cortex. Neuron, 48, 373–384.
Kerkhoff, G. (1998). Cognitive neurovisual rehabilitation: A cross-over study in patients with neglect and hemianopia. European Journal of Neuroscience, 10, 375.
Kerkhoff, G., & Schenk, T. (2012). Rehabilitation of neglect: An update. Neuropsychologia, 50(6), 1072–1079.
Klemen, J., & Chambers, C. D. (2012). Current perspectives and methods in studying neural mechanisms of multisensory interactions. Neuroscience and Biobehavioral Reviews, 36, 111–133.
Koelewijn, T., Bronkhorst, A., & Theeuwes, J. (2010). Attention and the multiple stages of multisensory integration: A review of audiovisual studies. Acta Psychologica, 134(3), 372–384.
Köhler, W. (1929). Gestalt psychology. New York: Liveright.
Ladavas, E., Bonifazi, S., Catena, L., & Serino, A. (2011). Neglect rehabilitation by prism adaptation: Different procedures have different impacts. Neuropsychologia, 49, 1136–1145.
Landy, M. S., Maloney, L. T., Johnston, E. B., & Young, M. (1995). Measurement and modeling of depth cue combination: In defense of weak fusion. Vision Research, 35(3), 389–412.
Lee, J. D., McGehee, D. V., Brown, T. L., & Marshall, D. (2006). Effects of adaptive cruise control and alert modality on driver performance. Transportation Research Record, 1980, 49–56.
Lieberman, J., & Breazeal, C. (2007). TIKL: Development of a wearable vibrotactile feedback suit for improved human motor learning. Robotics, IEEE Transactions on, 23(5), 919–926.
Logothetis, N. K., & Pfeuffer, J. (2004). On the nature of the BOLD fMRI contrast mechanism. Magnetic Resonance Imagingm, 22(10), 1517–1531.
Lubbe, R. H. J. van der, & Postma, A. (2005). Interruption from irrelevant auditory and visual onsets even when attention is in a focused state. Experimental Brain Research, 164(4), 464–471.
Macaluso, E., Frith, C. D., & Driver, J. (2000). Modulation of human visual cortex by crossmodal spatial attention. Science, 289, 1206–1208.
Marks, L. E., Ben-Artzi, E., & Lakatos, S. (2003). Cross-modal interactions in auditory and visual discrimination. International Journal of Psychophysiology, 50, 125–145.
Matusz, P. J., & Eimer, M. (2011). Multisensory enhancement of attentional capture in visual search. Psychonomic Bulletin & Review, 18(5), 904–909.
Mayer, H., Nagy, I., Knoll, A., Braun, E. A., Bauernschmitt, R., & Lange, R. (2007). Haptic feedback in a telepresence system for endoscopic heart surgery. Presence: Teleoperators and Virtual Environments, 16(5), 459–470.
McDonald, J. J., Teder-Salejarvi, W. A., Di Russo, F., & Hillyard, S. A. (2003). Neural substrates of perceptual enhancement by cross-modal spatial attention. Journal of Cognitive Neuroscience, 15, 10–19.
McDonald, J. J., Teder-Salejarvi, W. A., & Hillyard, S. A. (2000). Involuntary orienting of sound improves visual perception. Nature, 407, 906–908.
McGurk, H., & MacDonald, J. (1976). Hearing Lips and seeing voices. Nature, 264, 746–748.
Meredith, M. A., & Stein, B. E. (1986). Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology, 56, 640–662.
Meredith, M. A., & Stein, B. E. (1996). Spatial determinants of multisensory integration in cat superior colliculus neurons. Journal of Neurophysiology, 75(5), 1843–1857.
Middelweerd, M. J., & Plomp, R. (1987). The effect of speechreading on the speech-reception threshold of sentences in noise. Journal of the Acoustical Society of America, 82, 2145–2147.
Miller, J. O. (1991). Channel interaction and the redundant targets effect in bimodal divided attention. Journal of Experimental Psychology: Human Perception and Performance, 17, 160–169.
Miller, L. M., & D’Esposito, M. (2005). Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. Journal of Neuroscience, 25, 5884–5893.
Mohebbi, R., Gray, R., & Tan, H. Z. (2009). Driver reaction time to tactile and auditory read-end collision warnings while talking on a cell phone. Human Factors: Journal of the Human Factors and Ergonomics Society, 51, 102–110.
Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Cognitive Brain Research, 14, 115–128.
Morrell, F. (1972). Visual system’s view of acoustic space. Nature, 238, 44–46.
Mudd, S. A. (1963). Spatial stereotypes of four dimensions of pure tone. Journal of Experimental Psychology, 66, 347–352.
Müsseler, J., & Sutter, C. (2009). Perceiving one’s own movements when using a tool. Consciousness and Cognition, 18, 359–365.
Newell, F. N., Bülthoff, H. H., & Ernst, M. O. (2003). Cross-modal perception of actively explored objects. In H. S. Oakley, & S. O’Modhrain (Hrsg.), Proceedings EuroHaptics 2003 (S. 291–299). Dublin: Trinity College Dublin.
Newport, R., & Schenk, T. (2012). Prisms and neglect: What have we learned? Neuropsychologia, 50(6), 1080–1091.
Nitsch, V., & Färber, B. (2013). A meta-analysis of the effects of haptic interfaces on task performance with teleoperation systems. IEEE Transactions on Haptics, 6(4), 387–398.
Noppeney, U. (2011). Characterization of multisensory integration with fMRI: Experimental design, statistical analysis, and interpretation. In M. M. Murray, & M. T. Wallace (Hrsg.), The neural bases of multisensory processes (S. 233–252). Boca Raton: CRC Press.
Nys, G. M. S., Zandvoort, M. J. E. van, Kort, P. L. M. de, Jansen, B. P. W., Haan, E. H. F. de, & Kappelle, L. J. (2007). Cognitive disorders in acute stroke: Prevalence and clinical determinants. Cerebrovascular Diseases, 23, 408–416.
Parise, & Spence, C. (2009). When birds of a feather flock together: Synesthetic correspondences modulate audiovisual integration in non-synesthetes. PLoS ONE, 4, e5664.
Peck, C. K., Baro, J. A., & Warder, S. M. (1995). Effects of eye position on saccadic eye movements and on the neuronal responses to auditory and visual stimuli in cat superior colliculus. Experimental Brain Research, 103, 227–242.
Pekkola, J., Ojanen, V., Autti, T., Jääskeläinen, I. P., Möttönen, R., Tarkiainen, A., & Sams, M. (2005). Primary auditory cortex activation by visual speech: An fMRI study at 3 T. Neuroreport, 16(2), 125–128.
Perrault Jr., T. J., Vaughan, J. W., Stein, B. E., & Wallace, M. T. (2005). Superior colliculus neurons use distinct operational modes in the integration of multisensory stimuli. Journal of Neurophysiology, 93(5), 2575–2586.
Pietrini, P., Furey, M. L., Ricciardi, E., Gobbini, M. I., Wu, W. H. C., Cohen, L., Guazelli, M., & Haxby, J. V. (2004). Beyond sensory images: Object-based representation in the human ventral pathway. Proceedings of the National Academy of Sciences, 101(15), 5658–5663.
Prewett, M. S., Johnson, R. C., Saboe, K. N., Elliott, L. R., & Coovert, M. D. (2010). Managing workload in human-robot interaction: A review of empirical studies. Computers in Human Behavior, 26(5), 840–856.
Radeau, M., & Bertelson, P. (1974). The after-effects of ventriloquism. Quarterly Journal of Experimental Psychology, 26, 63–71.
Ramachandran, V. S., & Hubbard, E. M. (2001). Synaesthesia – A window into perception, thought and language. Journal of Consciousness Studies, 8, 3–34.
Redding, G. M., & Wallace, B. (1988). Components of prism adaptation in terminal and concurrent exposure – Organization of the eye-hand coordination loop. Perception & Psychophysics, 44, 59–68.
Redding, G. M., & Wallace, B. (1993). Adaptive coordination and alignment of eye and hand. Journal of Motor Behavior, 25, 75–88.
Redding, G. M., Rossetti, Y., & Wallace, B. (2005). Applications of prism adaptation: a tutorial in theory and method. Neuroscience & Biobehavioral Reviews, 29(3), 431–444.
Rock, I., & Victor, J. (1964). Vision and touch: An experimentally created conflict between the two senses. Science, 143, 594–596.
Rockland, K. S., & Ojima, H. (2003). Multisensory convergence in calcarine visual areas in macaque monkey. International Journal of Psychophysiology, 50, 19–26.
Rosas, P., Wichmann, F. A., & Wagemans, J. (2007). Texture and object motion in slant discrimination: Failure of reliability-based weighting of cues may be evidence for strong fusion. Journal of Vision, 7, 1–21.
Rosenblum, L. D. (2010). See what I’m saying: The extraordinary powers of our five senses. New York: W. W. Norton & Company Inc.
Rosenthal, O., Shimojo, S., & Shams, L. (2009). Sound-induced flash illusion is resistant to feedback training. Brain Topography, 21, 185–192.
Rossetti, Y., Koga, S., & Mano, T. (1993). Prismatic displacement of vision induces transient changes in the timing of eye-hand coordination. Perception & Psychophysics, 54, 355–364.
Rossetti, Y., Rode, G., Pisella, L., Farne, A., Li, L., Boisson, D., & Perenin, M. T. (1998). Prism adaptation to a rightward optical deviation rehabilitates left hemispatial neglect. Nature, 395, 166–169.
Rousseaux, M., Bernati, T., Saj, A., & Kozlowski, O. (2006). Ineffectiveness of prism adaptation on spatial neglect signs. Stroke, 37, 542–543.
Rowland, B., Quessy, S., Stanford, T. R., & Stein, B. E. (2007a). Multisensory integration shortens physiological response latencies. Journal of Neuroscience, 27, 5879–5884.
Rowland, B., Stanford, T. R., & Stein, B. E. (2007b). A model of the neural mechanisms underlying multisensory integration in the superior colliculus. Perception, 36, 1431–1443.
Santangelo, V., Fagioli, S., & Macaluso, E. (2010). The costs of monitoring simultaneously two sensory modalities decrease when dividing attention in space. NeuroImage, 49(3), 2717–2727.
Santangelo, V., & Spence, C. (2007). Multisensory cues capture spatial attention regardless of perceptual load. Journal of Experimental Psychology. Human Perception and Performance, 33, 1311–1321.
Sapir, E. (1929). A study in phonetic symbolism. Journal of Experimental Psychology, 12, 225–239.
Sarter, N. B. (2006). Multimodal information presentation: Design guidance and research challenges. International Journal of Industrial Ergonomics, 36, 439–445.
Scheef, L., Boecker, H., Daamen, M., Fehse, U., Landsberg, M. W., Granath, D. O., Mechling, H., & Effenberg, A. O. (2009). Multimodal motion processing in area V5/MT: Evidence from an artificial class of audio-visual events. Brain Research, 1252, 94–104.
Schroeder, C. E., & Foxe, J. J. (2002). The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Cognitive Brain Research, 14, 187–198.
Sereno, M. I., & Huang, R. S. (2006). A human parietal face area contains aligned head-centered visual and tactile maps. Nature Neuroscience, 9, 1337–1343.
Sereno, M. I., & Huang, R. S. (2014). Multisensory maps in parietal cortex. Current Opinion in Neurobiology, 24, 39–46.
Serino, A., Barbiani, M., Rinaldesi, M. L., & Ladavas, E. (2009). Effectiveness of prism adaptation in neglect rehabilitation a controlled trial study. Stroke, 40, 1392–1398.
Shams, L., Kamitani, Y., & Shimojo, S. (2000). Illusions: What you see is what you hear. Nature, 408, 788.
Shore, D. I., Barnes, M. E., & Spence, C. (2006). The temporal evolution of the crossmodal congruency effect. Neuroscience Letters, 392, 96–100.
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013). Augmented visual, auditory, haptic, and multimodal feedback in motor learning. Psychonomic Bulletin & Review, 20, 21–53.
Silver, M. A., & Kastner, S. (2009). Topographic maps in human frontal and parietal cortex. Trends in Cognitive Sciences, 13(11), 488–495.
Slutsky, D., & Recanzone, G. H. (2001). Temporal and spatial dependency of the ventriloquism effect. Neuroreport, 12, 7–10.
Spence, C. (2011). Crossmodal correspondences: A tutorial review. Attention, Perception & Psychophysics, 73, 971–995.
Spence, C., & Driver, J. (1997). Audiovisual links in exogenous covert spatial orienting. Perception & Psychophysics, 59(1), 1–22.
Spence, C., Nicholls, M. E. R., Gillespie, N., & Driver, J. (1998). Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision. Perception & Psychophysics, 60(4), 544–557.
Spence, C., Pavani, F., & Driver, J. (2000). Crossmodal links between vision and touch in covert endogenous spatial attention. Journal of Experimental Psychology: Human Perception and Performance, 26(4), 1298–1319.
Stein, B. E., & Meredith, M. A. (1993). Merging of the senses. Cambridge: MIT Press.
Stein, B. E., & Stanford, T. R. (2008). Multisensory integration: Current issues from the perspective of the single neuron. Nature Reviews Neuroscience, 9(4), 255–266.
Stein, B. E., Stanford, T. R., Wallace, M. T., Vaughan, J. W., & Jiang, W. (2004). Crossmodal spatial interactions in subcortical and cortical circuits. In C. Spence, & J. Driver (Hrsg.), Crossmodal Space and Crossmodal Attention (S. 25–50). Oxford: Oxford University Press.
Stein, B. E., Burr, D., Constantinidis, C., Laurienti, P. J., Meredith, M. A., Perrault, T. J., Ramachandran, R., Röder, B., Rowland, B. A., Sathian, K., Schroeder, C. E., Shams, L., Stanford, T. R., Wallace, M. T., Yu, L., & Lewkowicz, D. J. (2010). Semantic confusion regarding the development of multisensory integration: a practical solution. European Journal of Neuroscience, 31, 1713–1720.
Stevenson, R. A., Geoghegan, M. L., & James, T. W. (2007). Superadditive BOLD activation in superior temporal sulcus with threshold non-speech objects. Experimental Brain Research, 179, 85–95.
Stricanne, B., Andersen, R. A., & Mazzoni, P. (1996). Eyecentered, head-centered, and intermediate coding of remembered sound locations in area LIP. Journal of Neurophysiology, 76, 2071–2076.
Sutter, C., Sülzenbrück, S., Rieger, M., & Müsseler, J. (2013). Limitations of distal effect anticipation when using tools. New Ideas in Psychology, 31, 247–257.
Talsma, D., & Woldorff, M. G. (2005). Selective attention and multisensory integration: Multiple phases of effects on the evoked brain activity. Journal of Cognitive Neuroscience, 17, 1098–1114.
Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010). The multifaceted interplay between attention and multisensory integration. Trends in Cognitive Sciences, 14(9), 400–410.
Turton, A. J., O’Leary, K., Gabb, J., Woodward, R., & Gilchrist, I. D. (2010). A single blinded randomised controlled pilot trial of prism adaption for improving self-care in stroke patients with neglect. Neuropsychological Rehabilitation, 20, 180–196.
Van Erp, J. B. F., & Veen, H. A. H. C. van (2004). Vibrotactile in-vehicle navigation system. Transportation Ressearch Part F: Traffic Psychology and Behavior, 7, 247–256.
Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2008). Pip and pop: Nonspatial auditory signals improve spatial visual search. Journal of Experimental Psychology: Human Perception and Performance, 34, 1053–1065.
Vroomen, J., & Keetels, M. (2006). The spatial constraint in intersensory pairing: No role in temporal ventriloquism. Journal of Experimental Psychology: Human Perception & Performance, 32, 1063–1071.
Vroomen, J., & Keetels, M. (2010). Perception of intersensory synchrony: A tutorial review. Attention, Perception, & Psychophysics, 72, 871–884.
Wallace, M. T., Ramachandran, R., & Stein, B. E. (2004). A revised view of sensory cortical parcellation. Proceedings of the National Academy of Sciences, 101, 2167–2172.
Ward, L. M., McDonald, J. J., & Lin, D. (2000). On asymmetries in cross-modal spatial attention orienting. Perception & Psychophysics, 62(6), 1258–1264.
Watkins, S., Shams, L., Tanaka, S., Haynes, J. D., & Rees, G. (2006). Sound alters activity in human V1 in association with illusory visual perception. NeuroImage, 31(3), 1247–1256.
Welch, R. B. (1978). Perceptual modification: Adapting to altered sensory environments. New York: Academic Press.
Welch, R. B., & Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 88(3), 638–667.
Wickens, C. (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3(2), 159–177.
Wozny, D., Beierholm, U., & Shams, L. (2008). Human trimodal perception follows optimal statistical inference. Journal of Vision, 8(3), 1–11.
Zhang, M., Weisser, V. D., Stilla, R., Prather, S. C., & Sathian, K. (2004). Multisensory cortical processing of object shape and its relation to mental imagery. Cognitive, Affective & Behavioral Neuroscience, 4(2), 251–259.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Drewing, K. (2017). Multisensorische Informationsverarbeitung. In: Müsseler, J., Rieger, M. (eds) Allgemeine Psychologie. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-53898-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-53898-8_4
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-53897-1
Online ISBN: 978-3-642-53898-8
eBook Packages: Psychology (German Language)