Abstract
An experiment examined cross-modal interference and congruence in speeded classification: Subjects had to identify compound (visual-auditory) stimuli as either low or high in spatial position (visual judgment) or low or high in pitch (auditory judgment), in 16 conditions, each of which combined one of four possible pairs of tones, varying in frequency difference, with one of four possible pairs of dots, varying in positional difference. Both classification by position and classification by pitch revealed Garner interference (poorer performance than baseline, with orthogonal variation in the irrelevant dimension) and congruence effects (better performance with congruent than with incongruent stimulus combinations), but pitch classification showed more. Furthermore, the size of the pitch difference strongly affected classification by pitch and less strongly affected classification by position, but the size of the position difference affected neither. The findings are consistent with the view that Garner interference and congruence effects are closely related, perhaps arising from a common source, and suggest that the asymmetries could depend in part on the degree of dimensional overlap between stimuli and responses.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Ashby, F. G., &Maddox, W. T. (1994). A response time theory of separability and integrality in speeded classification.Journal of Mathematical Psychology,38, 423–466.
Callaghan, T. C., Lasaga, M. I., &Garner, W. R. (1986). Visual texture segregation based on orientation and hue.Perception & Psychophysics,39, 32–38.
Carrell, T. D., Smith, L. B., &Pisoni, D. B. (1981). Some perceptual dependencies in speeded classification of vowel color and pitch.Perception & Psychophysics,29, 1–10.
Clark, H. H., &Brownell, H. H. (1975). Judging up and down.Journal of Experimental Psychology: Human Perception & Performance,1, 339–352.
Cohen, J. D., Dunbar, K., &McClelland, J. L. (1990). On the control of automatic processes: A parallel distributed processing account of the Stroop effect.Psychological Review,97, 332–361.
Colavita, F. B. (1974). Human sensory dominance.Perception & Psychophysics,16, 409–412.
Colavita, F. B., Tomko, R., &Weisberg, D. (1976). Visual prepotency and eye orientation.Bulletin of the Psychonomic Society,8, 25–26.
Colavita, F. B., &Weisberg, D. (1979). A further investigation of visual dominance.Perception & Psychophysics,25, 345–347.
Egeth, H. E., &Sager, L. C. (1977). On the locus of visual dominance.Perception & Psychophysics,22, 77–86.
Eriksen, B. A., &Eriksen, C. W. (1974). Effects of noise letters upon the identification of a target letter in a nonsearch task.Perception & Psychophysics,16, 143–149.
Flowers, J. H., &Wilcox, N. (1982). The effect of flanking context on visual classification: The joint contribution of interactions at different processing levels.Perception & Psychophysics,32, 581–591.
Foard, C. F., &Kemler Nelson, D. G. (1984). Holistic and analytic modes of processing: The multiple determinants of perceptual analysis.Journal of Experimental Psychology: General,113, 94–111.
Garner, W. R. (1974).The processing of information and structure. Potomac, MD: Erlbaum.
Garner, W. R. (1976). Interaction of stimulus dimensions in concept and choice processes.Cognitive Psychology,8, 98–123.
Garner, W. R., &Felfoldy, G. L. (1970). Integrality of stimulus dimensions in various types of information processing.Cognitive Psychology,1, 225–241.
Grice, G. R. (1968). Stimulus intensity and response evocation.Psychological Review,75, 359–373.
Hamers, J. F., &Lambert, W. E. (1972). Bilingual interdependencies in auditory perception.Journal of Verbal Learning & Verbal Behavior,11, 303–310.
Haussmann, R. E. (1992). Tachistoscopic presentation and millisecond timing on the IBM PC/XT/AT and PS/2: A Turbo Pascal unit to provide general-purpose routines for CGA, Hercules, EGA, and VGA monitors.Behavior Research Methods, Instruments, & Computers,24, 303–310.
Kornblum, S., Hasbroucq, T., &Osman, A. (1990). Dimensional overlap: Cognitive basis for stimulus-response compatibility—A model and taxonomy.Psychological Review,97, 253–270.
Link, S. W. (1992).The wave theory of difference and similarity. Hillsdale, NJ: Erlbaum.
Lockhead, G. R. (1972). Processing dimensional stimuli: A note.Psychological Review,79, 410–419.
Lockhead, G. R. (1979). Holistic versus analytic process models: A reply.Journal of Experimental Psychology: Human Perception & Performance,5, 746–755.
Logan, G. D. (1980). Attention and automaticity in Stroop and priming tasks: Theory and data.Cognitive Psychology,12, 523–553.
Lupker, S. J., &Katz, A. N. (1982). Can automatic picture processing influence word judgments?Journal of Experimental Psychology: Learning, Memory, & Cognition,8, 418–434.
Marks, L. E. (1974). On associations of light and sound: The mediation of brightness, pitch, and loudness.American Journal of Psychology,87, 173–188.
Marks, L. E. (1975). On colored-hearing synesthesia: Cross-modal translations of sensory dimensions.Psychological Bulletin,82, 303–331.
Marks, L. E. (1978).The unity of senses: Interrelations among the modalities. New York: Academic Press.
Marks, L. E. (1982a). Bright sneezes and dark coughs, loud sunlight and soft moonlight.Journal of Experimental Psychology: Human Perception & Performance,8, 177–193.
Marks, L. E. (1982b). Synesthetic perception and poetic metaphor.Journal of Experimental Psychology: Human Perception & Performance,8, 15–23.
Marks, L. E. (1987). On cross-modal similarity: Auditory-visual interactions in speeded discrimination.Journal of Experimental Psychology: Human Perception & Performance,13, 384–394.
Marks, L. E. (1988). Magnitude estimation and sensory matching.Perception & Psychophysics,43, 511–525.
Marks, L. E. (1989). On cross-modal similarity: The perceptual structure of pitch, loudness, and brightness.Journal of Experimental Psychology: Human Perception & Performance,15, 419–433.
Marks, L. E. (1992). The slippery context effect in psychophysics: Intensive, extensive, and qualitative continua.Perception & Psychophysics,51, 187–198.
Marks, L. E. (1994, July).Representations of space: Encoding and recoding. Paper presented at Attention and Performance XVI, Kyoto, Japan.
Marks, L. E., Hammeal, R. J., &Bornstein, M. H. (1987). Perceiving similarity and comprehending metaphor.Monographs of the Society for Research in Child Development,52(1, Series No. 251), 1–93.
McClain, L. (1983a). Effects of response type and set size on Stroop color-word performance.Perceptual & Motor Skills,56, 735–743.
McClain, L. (1983b). Stimulus-response compatibility affects auditory Stroop interference.Perception & Psychophysics,33, 266–270.
Melara, R. D. (1989). Dimensional interaction between color and pitch.Journal of Experimental Psychology: Human Perception & Performance,115, 212–231.
Melara, R. D., &Marks, L. E. (1990a). Dimensional interaction in language processing: Investigating directions and levels of crosstalk.Journal of Experimental Psychology: Learning, Memory, & Cognition,16, 539–554.
Melara, R. D., &Marks, L. E. (1990b). Interaction among auditory dimensions: Timbre, pitch, and loudness.Perception & Psychophysics,48, 169–178.
Melara, R. D., &Marks, L. E. (1990c). Processes underlying dimensional interactions: Correspondences between linguistic and nonlinguistic dimensions.Memory & Cognition,18, 477–495.
Melara, R. D., Marks, L. E., &Lesko, K. E. (1992). Optional processes in similarity judgments.Perception & Psychophysics,51, 123–133.
Melara, R. D., Marks, L. E., &Potts, B. C. (1993). Early-holistic processing or dimensional similarity?Journal of Experimental Psychology: Human Perception & Performance,19, 1114–1120.
Melara, R. D., &Mounts, J. R. W. (1994). Contextual influences on interactive processing: Effects of discriminability, quantity, and uncertainty.Perception & Psychophysics,56, 73–90.
Melara, R. D., &O’Brien, T. P. (1987). Interaction between synesthetically corresponding dimensions.Journal of Experimental Psychology: General,116, 323–336.
Mullennix, J. W., &Pisoni, D. B. (1990). Stimulus variability and processing dependencies in speech perception.Perception & Psychophysics,47, 379–390.
Petrusic, W. M. (1992). Semantic effects and theories of the comparison process.Journal of Experimental Psychology: Human Perception & Performance,18, 962–986.
Pieters, J. M. (1981). Ear asymmetry in an auditory spatial Stroop task as a function of handedness.Cortex,17, 369–379.
Pomerantz, J. R. (1983). Global and local precedence: Selective attention in form and motion perception.Journal of Experimental Psychology: General,112, 515–540.
Pomerantz, J. R. (1986). Visual form perception: An overview. In E. C. Schwab & H. C. Busbaum (Eds.),Pattern recognition by humans and machines: Visual perception (pp. 1–30). New York: Academic Press.
Pomerantz, J. R., Pristach, E. A., &Carson, C. E. (1989). Attention and object perception. In E. B. Shepp & S. Ballesteros (Eds.),Object perception: Structure and process (pp. 53–89). Hillsdale, NJ: Erlbaum.
Posner, M. I. (1964). Information reduction in the analysis of sequential tasks.Psychological Review,71, 491–504.
Posner, M. I., Nissen, M. J., &Klein, R. M. (1976). Visual dominance: An information-processing account of its origins and significance.Psychological Review,83, 157–171.
Posner, M. I., Rafal, R. D., Choate, L. S., &Vaughan, J. (1985). Inhibition of return: Neural basis and function.Cognitive Neuropsychology,2, 211–228.
Redding, G. M., &Gerjets, D. A. (1977). Stroop effect: Interference and facilitation with verbal and manual responses.Perceptual & Motor Skills,45, 11–17.
Repp, B., &Lin, H. (1990). Integration of segmental and tonal information in speech perception: A cross-linguistic study.Journal of Phonetics,18, 481–495.
Roffler, S. K., &Butler, R. A. (1968). Localization of tonal stimuli in the vertical plane.Journal of the Acoustical Society of America,43, 1260–1266.
Rosinki, R. R., Golinkoff, R. M., &Kukish, K. S. (1975). Automatic semantic processing in a picture-word interference task.Child Development,46, 247–253.
Shepard, R. N. (1964). Attention and the metric structure of the stimulus space.Journal of Mathematical Psychology,1, 54–87.
Shor, R. E. (1970). The processing of conceptual information on spatial directions from pictorial and linguistic symbols.Acta Psychologica,32, 346–365.
Shor, R. E. (1975). An auditory analog of the Stroop test.Journal of General Psychology,93, 281–288.
Smith, J. D., &Kemler Nelson, D. G. (1984). Overall similarity in adults’ classification: The child in all of us.Journal of Experimental Psychology: General,113, 137–159.
Stroop, J. R. (1935). Studies of interference in serial verbal reactions.Journal of Experimental Psychology,18, 643–662.
Vickers, D. (1970). Evidence for an accumulator model of psychophysical discrimination.Ergonomics,13, 37–58.
Virzi, R. A., &Egeth, H. E. (1985). Toward a translational model of Stroop interference.Memory & Cognition,13, 304–319.
Yeh, Y.-Y., &Eriksen, C. W. (1984). Name codes and features in the discrimination of letter forms.Perception & Psychophysics,36, 225–233.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by Grant DC 00271 from the National Institutes of Health to L.E.M.
Rights and permissions
About this article
Cite this article
Ben-Artzi, E., Marks, L.E. Visual-auditory interaction in speeded classification: Role of stimulus difference. Perception & Psychophysics 57, 1151–1162 (1995). https://doi.org/10.3758/BF03208371
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03208371