Abstract
Recent technological advances now make possible the full integration of sound in instructional software. Sounds may gain and focus learner attention, reduce distracting stimuli, and make learning more engaging. In addition, they may help learners condense, elaborate on, and organize details, highlighting inter connections among new pieces of information and making connections to preexisting knowledge. Thus, sound may hold great promise for moderating acquisition, processing, and retrieval “noise” in instructional software. Unfortunately, interface and instructional design guides almost completely ignore sound, and research suggests many promising instructional uses remain largely unexplored. This paper explores information-processing and communication theoretical foundations for sound's systematic use in the instructional communication system and proposes a framework for a program of research on instructional software's use of sound.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Aborn, M. & Rubenstein, H. (1952). Information theory and immediate recall.Journal of Experimental Psychology, 44, 260–266.
Alessi, S.M., & Trollip, S.R. (1985)Computer-based instruction: Methods and development. Englewood Cliffs, NJ: Prentice-Hall.
Alessi, S.M., & Trollip, S.R. (1991).Computer-based instruction: Methods and development (2nd ed.), Englewood Cliffs, NJ: Prentice-Hall.
Anderson, J.R. (1995a).Learning and memory: An integrated approach, New York: Wiley & Sons.
Anderson, J.R. (1995b).Cognitive psychology and its implications (4th ed.). New York: Freeman.
Atkinson, R.C., & Shiffrin, R.M. (1968). Human memory: A proposed system and its control processes. In K.W. Spence & J.T. Spence (Eds.)The psychology of learning and motivation: Advances in research and theory (Vol. 2, pp. 89–195. New York: Academic.
Banathy, B. (1996). Systems inquiry and its application in education. In D. Jonassen (Ed.),Handbook of research for educational communications and technology (pp. 74–92). New York: Macmillan Library Reference.
Barron, A.E., & Atkins, D. (1994). Audio instruction in multimedia education: Is textual redundancy important.Journal of Educational Multimedia and Hypermedia, 3(3/4)a, 295–306.
Bateson, G. (1978).Mind and nature: A necessary unity. New York: E.P. Dutton.
Berger, C.R. (1987). Communicating under uncertainty. In M.E. Roloff & G.R. Miller (Eds.)Interpersonal processes: New directions in communication research (pp. 39–62). Newbury Park, CA: Sage.
Berlo, D. (1960).The process of communication. San Francisco: Rinehart.
Berlyne, D.E. (1957a). Uncertainty and conflict: A point of contact between information-theory and behavior-theory concepts.Psychological Review, 64, 329–339.
Berlyne, D.E. (1957b). Conflict and choice time.British Journal of Psychology, 48, 106–118.
Berlyne, D.E. (1957c). Conflict and information-theory variables as determinants of human perceptual curiosity.Journal of Experimental Psychology, 53, 399–404.
Berlyne, D.E. (1958). The influence of complexity and novelty in visual figures on orienting responses.Journal of Experimental Psychology, 55, 289–296.
Bernstein, I.H., Clark, M.H., & Edelstein, B.A. (1969a). Effects of an auditory signal on visual reaction time.Journal of Experimental Psychology, 80, 567–569.
Bernstein, I.H., Clark, M.H., & Edelstein, B.A. (1969b). Intermodal effects in choice reaction time.Journal of Experimental Psychology, 81, 405–407.
Bernstein, I.H., & Edelstein, B.A. (1971). Effects of some variations in auditory input upon visual choice reaction time.Journal of Experimental Psychology, 87, 241–247.
Bickford, P. (1997).Interface design: The art of developing easy-to-use software. Boston: AP Professional.
Blattner, M., Sumikawa, D., & Greenberg, R. (1989). Earcons and icons: Their structure and common design principles.Human-computer Interaction, 4, 11–44.
Bloom, B. (Ed.). (1956).Taxonomy of educational objectives. Handbook I: The classification of educational goals. New York: David McKay.
Boring, E.G. (1950).A history of experimental psychology. New York: Appleton-Century-Crofts.
Broadbent, D.E. (1958).Perception and communication. New York: Pergamon.
Carpenter, C.R. (1953). A theoretical orientation for instructional film research.AV Communication Review, 1, 38–52.
Cates, W.M., Bishop, M.J., & Hung, W. (2000, February).Characterization versus narration: Empirical investigations of drama's role in multimedia instructional software. A paper presented at the annual convention of the Association for Educational Communications and Technology, Long Beach, CA.
Cherry, E.C., & Taylor, W.K. (1953). Some further experiments on the recognition of speech with one, and with two ears.The Journal of the Acoustical Society of America, 26, 554–559.
Clark, C. (1932). Sound motion pictures as an aid in classroom teaching.School Review, 40, 669–681.
Cooper, A. (1995).About face: The essentials of user interface design. Foster City, CA: IDG Books.
Einbecker, W.F. (1933). Comparison of verbal accompaniments to film.School Review, 41, 185–192.
Emmert, P., & Donaghy, W.C. (1981).Human communication: Elements and contexts Reading, MA: Addison-Wesley.
Engelkamp, J., & Zimmer, H. (1994).Human memory: A multimodal approach. Seattle, WA: Hogrefe & Huber.
Fiske, J. (1990)Introduction to communication studies (2nd ed.), London: Routledge.
Gagné, R.M. (1985)The conditions of learning and theory of instruction (4th ed.). New York: Holt, Rinehart, and Winston.
Gagné, R.M., & Driscoll, M.P. (1988).Essentials of learning for instruction (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall.
Galitz, W.O. (1997).The essential guide to user interface design: An introduction to GUI design principles and techniques. New York: Wiley & Sons.
Gaver, W. (1986). Auditory icons: Using sound in computer interfaces.Human-computer Interaction, 2, 167–177.
Gaver, W. (1993). What in the world do we hear? An ecological approach to auditory source perception.Ecological Psychology, 5, 1–29.
Glass, A.L., Holyoak, K.J., & Santa, J.L. (1979).Cognition. Reading, MA: Addison-Wesley.
Glasser, W. (1969).Schools without failure. New York: Harper & Row.
Goodlad, J. (1984).A place called school: Prospects for the future, New York: McGraw-Hill.
Grabe, M. (1986). Attentional processes in education. In G. Phye & T. Andre (Eds.),Cognitive classroom learning: Understanding, thinking, and problem solving (pp. 49–82). Orlando, FL: Academic.
Hannafin, M.J., & Peck, K. (1988).The design, development, and evaluation of instructional software. New York: Macmillan.
Hansen, J.E. (1936). The verbal accompaniment of the film—The recorded voice vs. the classroom teacher.Journal of Experimental Education, 5, 1–6.
Harmon, R. (1988)Film producing: Low-budget films that sell. Hollywood: Samuel French Trade.
Harris, J.E. (1982). External memory aids. In U. Neisser (Ed.),Memory observed: Remembering in natural contexts (pp. 337–342). San Francisco: Freeman.
Harrison, R.P. (1972). Nonverbal behavior: An approach to human communication. In R.W. Budd & B.D. Ruben (Eds.),Approaches to human communication (pp. 253–268). Rochelle Park, NJ: Hayden.
Hartman, F.R. (1961a). Recognition learning under multiple channel presentation and testing conditions.AV Communication Review, 9, 24–43.
Hartman, F.R. (1961b). Single and multiple channel communication: A review of research and a proposed model.AV Communication Review, 9, 235–262.
Hawkins, J.M., & Allen, R. (Eds.). (1991).The Oxford encyclopedic English dictionary. Oxford, Clarendon.
Heit, E. (1997). Knowledge and concept learning. In K. Lamberts & D. Shanks (Eds.),Knowledge, concepts, and categories (pp. 7–41). Cambridge, MA: MIT.
Hernandez-Peon, R. (1961). Recular mechanisms of sensory control. In W. A. Rosenblith (Ed.),Sensory communication (pp. 497–517). New York: Wiley.
Hewes, D.E. (1995). Cognitive processing of problematic messages: Reinterpreting to “unbias” texts. In D.E. Hewes (Ed.),The cognitive bases of interpersonal communication (pp. 113–138). Hillsdale, NJ: Erlbaum.
Hoban, C.F. (1949).Some aspects of learning from films (Incidental Report No. 2). State College, PA: Pennsylvania State College, Instructional Film Research Program.
Holt, J.C. (1969).The underachieving school. New York: Pitman.
Jonassen, D.H. (Ed.). (1988).Instructional designs for microcomputer courseware. Hillsdale, NJ: Erlbaum.
Keller, J.M. (1987).When machines teach: Designing computer courseware. New York: Harper and Row.
Ketcham, C.H., & Heath, R.W. (1962). Teaching effectiveness of sound with pictures that do not embody the material being taught.AV Communication Review, 10, 89–93.
Kohfeld, D.L. (1971). Simple reaction time as a function of stimulus intensity in decibels of light and sound.Journal of Experimental Psychology, 88, 251–257.
Kramer, E.J., & Lewis, T.R. (1951). Comparison of visual and non-visual learning.Journal of Communication, 1(2), 16–20.
Krendl, K.A., Ware, W.H., Reid, K.A., & Warren, R. (1996). Learning by any other name: Communication research traditions in learning and media. In D.H. Jonassen (Ed.),Handbook of research for educational communications and technology: A project of the Association for Educational Communications and Technology (pp. 93–111). New York: Macmillan Library Reference U.S.A.
Leonard, A. (1955). Factors which influence channel capacity. In H. Quastler (Ed.)Information theory and psychology: Problems and methods (pp. 306–315). Glencoe, IL: The Free Press.
Lumsdaine, A.A., & Gladstone, A.I. (1958). Overt practice and audio-visual embellishments. In M.A. May & A.A. Lumsdaine (Eds.),Learning from films. New Haven, CT: Yale University.
Luskin, B. (1997). The best time to plant a tree was twenty-five years ago.T.H.E. Journal [On-line serial],24(11). Available: www.thejournal.com/magazine/97/jun/feature5.html.
MacKay, D.G. (1973). Aspects of the theory of comprehension, memory and attention.Quarterly Journal of Experimental Psychology, 25, 22–40.
Mandel, T. (1997).The elements of user interface design. New York: Wiley & Sons.
Mann, B.L. (1995). Focusing attention with temporal sound.Journal of Research on Computing in Education, 27(4), 402–424.
McAdams, S. (1993). Recognition of sound sources and events. In S. McAdams & E. Bigand (Eds.),Thinking in sound (pp. 146–198). New York: Oxford University.
McAdams, S., & Bigand, E. (1993). Introduction to auditory cognition. In S. McAdams & E. Bigand (Eds.),Thinking in sound (pp. 1–9). New York: Oxford University.
Miller, N.E. (1957). Graphic communication and the crisis in education.AV Communication Review 5, 1–120.
Miller, G.A., Heise, G.A., & Lichten, W. (1951). The intelligibility of speech as a function of the context of the test materials.Journal of Experimental Psychology, 41, 329–335.
Nelson, T.O. (1971). Savings and forgetting from long-term memory.Journal of Verbal Learning and Verbal Behavior, 10, 568–576.
Newman, D. (1990). Opportunities for research on the organizational impact of school computers.Educational Researcher, 19(3), 8–13.
Norman, D.A. (1982).Learning and memory. San Francisco: Freeman.
Ormrod, J.E. (1990).Human learning: Principles, theories, and educational applications. New York: Macmillan.
Paivio, A. (1971).Imagery and verbal processes. New York: Holt, Rinehart, and Winston (Reprinted 1979, Hillsdale, NJ: Erlbaum).
Paivio, A. (1986).Mental representations: A dual encoding approach. New York: Oxford University Press.
Pask, G. (1975).Conversation, cognition and learning: A cybernetic theory and methodologh. New York: Elsevier.
Perkins, M. (1983).Sensing the world. Indianapolis: Hackett.
Phye, G.D. (1997). Learning and remembering: The basis for personal knowledge construction. In G.D. Phye (Ed.),Handbook of academic learning: Construction of knowledge (pp. 47–64). San Diego: Academic.
Posner, M.I., Nissen, M.J., & Klein, R.M. (1976). Visual dominance: An information-processing account of its origins and significance.Psychological Review, 83, 157–171.
Postman, L. (1961). The present state of interference theory. In C.N. Cofer (Ed.),Verbal learning and verbal behavior (pp. 152–179). New York: McGraw-Hill.
Reeves, T.C. (1991). Ten commandments for the evaluation of interactive multimedia in higher education.Journal of Computing in Higher Education, 2, 84–113.
Reeves, T.C. (1993a). Pseudoscience in computer-based instruction: The case of learner control research.Journal of Computer-Based Instruction, 20(2), 39–46.
Reeves, T.C. (1993b). Evaluating interactive multimedia. In D. Gayeski (Ed.),Multimedia for learning: Development, application, evaluation (pp. 97–112). Englewood Cliffs, NJ: Educational Technology.
Reeves, T.C., (1995, February).Questioning the questions of instructional technology research. Invited Peter Dean Lecture presented for the Division of Learning and Performance Environments at the 1995 annual convention of the Association for Educational Communications and Technology, Anaheim, CA.
Resnick, L.B. (Ed.). (1989).Knowing, learning, and instruction: Essays in honor of Robert Glaser, Hillsdale, NJ: Erlbaum.
Reza, F.M. (1994).An introduction to information theory. New York: Dover. (Original work published 1961)
Rubenstein, H., & Aborn, M. (1954). Immediate recall as a function of degree of organization and length of study period.Journal of Experimental Psychology, 48, 146–152.
Rutter, M., Maughan, B., Montimore, P., Ouston, J., & Smith, A. (1979).Fifteen thousand hours: Secondary schools and their effects on children. Cambridge, MA: Harvard University.
Salomon, G. (1994).Interaction of media, cognition, and learning. Hillsdale, NJ: Erlbaum. (Original work published in 1979)
Savenye, W., & Robinson, R. (1996). Qualitative research issues and methods: An introduction for educational technologists. In D.H. Jonassen (Ed.),Handbook of research for educational communications and technology: A project of the Association for Educational Communications and Technology (pp. 1171–1195). New York: Macmillan Library Reference U.S.A.
Severin, W.J. (1967a). Another look at cue summation.AV Communication Review, 15, 233–245.
Severin, W.J. (1967b). The effectiveness of relevant pictures in multiple-channel communications.AV Communication Review, 15, 386–401.
Shannon, C.E., & Weaver, W. (1969).The mathematical theory of communication, Urbana: The University of Illinois.
Shih, Y., & Alessi, S. (1996). Effects of text versus voice on learning in multimedia courseware.Journal of Educational Multimedia and Hypermedia, 5(2), 203–218.
Silberman, C.E. (1970).Crisis in the classroom: The remaking of American education. New York: Random House.
Spaulding, S. (1956). Communication potential of pictorial illustration.AV Communication Review, 4, 31–46.
Thomas, F., & Johnston, R. (1984). The Disney sounds. In W. Rawls (Ed.),Disney animation: The illusion of life (pp. 145–161) New York: Abbeville.
Thomson, D.M., & Tulving, E. (1970). Associative encoding and retrieval: Weak and strong cues.Journal of Experimental Psychology, 86, 255–262.
Travers, R.M.W. (1964a). The transmission of information to human receivers.AV Communication Review, 12, 373–385.
Travers, R.M.W. (Ed.). (1964b).Research and theory related to audiovisual information transmission. Salt Lake City, UT: Bureau of Educational Research, University of Utah.
Tulving, E. (1972). Episodic and semantic memory. In E. Tulving & W. Donaldson (Eds.)Organization of memory (pp. 381–403). New York: Academic.
Tulving, E. (1983).Elements of episodic memory. New York: Oxford University Press.
Tulving, E., & Thomson, D.M. (1973). Encoding specificity and retrieval processes in episodic memory.Psychological Review, 80, 352–373.
Van Mondfrans, A.P., & Travers, R.M.W. (1964). Learning of redundant materials presented through two sensory modalities.Perceptual and Motor Skills, 19, 743–751.
Westfall, L.H. (1934).A study of verbal accompaniments to educational motion pictures. New York: Teachers College, Columbia University.
Wickelgren, W.A. (1976). Memory storage dynamics. In W.K. Estes (Ed.),Handbook of learning and cognitive processes (Vol. 4, pp. 321–361). Hillsdale, NJ: Erlbaum.
Wickens, C. (1984).Engineering psychology and human performance. Columbus, OH: Merrill.
Wilde, D.J., & Beightler, C.S. (1967).Foundations of optimization. Englewood Cliffs, NJ: Prentice-Hall.
Winn, W.D. (1993). Perception principles. In M. Fleming & W.H. Levie (Eds.),Instructional message design: Principles from the behavioral and cognitive sciences (2nd ed., pp. 55–126). Englewood Cliffs, NJ: Educational Technology.
Wundt, W.M. (1897).Outlines of psychology. (C.H. Judd, Trans.). New York: Stechert. (Original work published 1896)
Yost, W.A. (1993). Overview: Psychoacoustics. In W.A. Yost, A.N. Popper, & R.R. Fay (Eds.),Human psychophysics (pp. 1–12). New York: Springer-Verlag.
Author information
Authors and Affiliations
Additional information
MJ is assistant progressor in the Educational Technology program at Lehigh University, and Ward teaches instructional design and interface design and coordinates the Educational Technology program there.
Rights and permissions
About this article
Cite this article
Bishop, M.J., Cates, W.M. Theoretical foundations for sound's use in multimedia instruction to enhance learning. ETR&D 49, 5–22 (2001). https://doi.org/10.1007/BF02504912
Issue Date:
DOI: https://doi.org/10.1007/BF02504912