Summary
This chapter examines the experimental tradition in educational research. With it an attempt is made to provide a sense of the background assumptions and everyday details that are involved in the process of experimental research. Of course a chapter cannot be comprehensive and this chapter is not intended to be prescriptive. Rather it is intended to be a guide an approach to thinking about experimental paradigms. Thus issues and examples are selected that are particularly relevant and helpful in the role of an experimental researcher and a teacher.
The chapter is divided into several sections. The first section will spend some time providing a historical and epistemological framework for understanding the tradition of experimental research. The second section will define experimental research in its formal sense but will also provide some feel for the ways in which the formal version of experimental research has been adapted and the implications of those adaptations for altering and limiting the conclusions that can be drawn from the research. The third section pays more attention to the specific steps associated with developing an experimental research study. It will provide a perspective on the development and refinement of a research question discuss the details of selecting (or creating) relevant outcome measures and conceptualizing appropriate comparison groups (control conditions). Then a discussion of the original question will be re-addressed to reflect on its evolution as we have been working on the details. The final section will focus on the strengths and weaknesses of some specific research designs which are commonly used in education.
Before beginning, however, a note on the philosophy of the chapter. The concept of an unbiased opinion is an oxymoron. This is as true in the domain of experimental research as it is anywhere else. Biases are inherent in every aspect of the experimental process including: what question is asked, the method of research used, the types of comparisons made, and the interpretations that arise. The point of this chapter is not to provide efforts to eliminate those biases. This is impossible and therefore a fool’s errand. Rather, the intent is to highlight some ofthe biases, to make them explicit, and to provide some framework for helping the researcher make his or her own decisions about what biases will be acceptable for the intended purpose. Similarly, it is important to realize that no experiment is ideal. There are compromises inherent in every design. Thus, this chapter is not a recipe for developing the “right” research design. Rather the discussion will describe the strengths and weaknesses ofeach design and leave it as an exercise for the reader to determine which combination of strengths and weakness is optimal for his or her currentpurposes. This perspective is not meant to sound cynical or to be discouraging. There is no doubt that experimental research is a powerful and useful tool for expanding and refining knowledge. But like any powerful tool, it must be used with caution, respect, and awareness. It is with this perspective in mind that the following sections are written.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Abel, U., & Koch, A. (1999). The role of randomisation in clinical studies: Myths and beliefs.Journal of Clinical Epidemiology 52487–497.
Anastakis D. J., Regehr G., Reznick R. K., Cusimano M., Mumaghan J., Brown M., & Hutchison C. (1999). Assessment of technical skills transfer from the bench training model to the human model.American Journal of Surgery 177167–170.
Arbuthnott, J. (1710). An argument for Divine Providence, taken from the constant regularity observed in the births of both sexes.Philosophical Transactions of the Royal Society 23186–190.
Bakan, D. (1967).On method: toward a reconstruction of psychological investigation.San Francisco: JosseyBass.
Barrows, H. S., & Tamblyn, R. M. (1980).Problem-based learning: an approach to medical education.New York: Springer.
Beaven, E. S. (1935). Discussion on Dr. Neyman’s Paper.Journal of the Royal Statistical Society2, 159–161. Bordage, G., & Zacks, R. (1984). The structure of medical knowledge in the memories of medical students and general practitioners: Categories and prototypes.Medical Education 18406–416.
Bordage, G. E., & Williams, R. G. (1992). Theory and practice in medical education.Professions Education Researcher Quarterly 12December.
Boring, E. G. (1954). The nature and history of experimental control.American Journal of Psychology 67573–389.
Campbell, D. T., & Stanley, J. D. (1966).Experimental and quasi-experimental designs for research.Chicago: Rand McNally.
Cohen, J. (1994). The earth is round (p<.05).American Psychologist 49997–1003.
Colliver, J. A., & Verhulst, S. J. (1996). Medical research and qualitative methods: a rational approach.Academic Medicine 71211.
Colliver, J. A. (1999a). Pragmatic consequences of research in professions education: An overview of research presented at the 1998 Division I paper sessions. Presented at the annual meeting of the American Educational Research Association.
Colliver, J. A. (1999b). Constructivism with a dose of pragmatism: A cure for what ails educational research.Advances in Health Sciences Education 4187–190.
Colliver, J. A. (2000). Effectiveness of problem-based learning curricula: research and theory.Academic Medicine 75259–266.
Conant, J. B. (1947).On understanding science.New Haven: Yale.
Custers, E. J. F. M., Regehr, G., & Norman, G. R. (1996). Mental representations of medical diagnostic knowledge: a review.Academic Medicine 71S55–S61.
Dolmans, D. H., Wolfhagen, I. H., & Schmidt, H. G. (1996). Effects of tutor expertise on student performance in relation to prior knowledge and level of curricular structure.Academic Medicine 711008–1011.
Doucet, M. D., Purdy, R. A., Kaufman, D. M., & Langille, D. B. (1998). Comparison of problem-based learning and lecture format in continuing medical education on headache diagnosis and management.Medical Education 32590–596.
Eagle, C. J., Harasym, P. H., & Mandin, H. (1992). Effects of tutors with case expertise on problem-based learning issues.Academic Medicine 67465–469.
Fisher, R. A. (1925).Statistical methods for research workers.London: Oliver and Boyd.
Fisher, R. A. (1935).The design of experiments.Edinburgh: Oliver and Boyd.
Gallagher, A. G., McClure, N., McGuigan, J., Crothers, I., & Browning, J. (1999). Virtual reality training in laparoscopie surgery: a preliminary assessment of minimally invasive surgical trainer virtual reality (MIST VR).Endoscopy 31310–313.
Gavarret, J. (1840).Principes Généraux de Statistique Médicale.[No publisher given] (Paris).
Gehlbach, S. H., Wilkinson, W. E., Hammond, W. E., Clapp, N. E., Finn, A. L., Taylor, W. J.&Rodell, M.S. (1984). Improving drug prescribing in a primary care practice.Medical Care22, 193–201.
Goodman, S. N. (1993). P values, hypothesis tests, and likelihood: implications for epidemiology of a neglected historical debate.American Journal of Epidemiology 137485–496.
Hacking, I. (1965).Logic of statistical inference.Cambridge: Cambridge University Press.
Hogben, L. (1957).Statistical theory.London: Allen and Unwin.
James, W. (1890).Principles of psychology.New York: Henry Holt.
Kaufman, D.&Lee, S. (1993). Formative evaluation of a multimedia CAL program in an ophthalmology clerkship.Medical Teacher 15327–340.
Kuhn, T. S. (1962).The structure of scientific revolutions.Chicago: University of Chicago Press.
Lechner, S. K., Lechner, K. M., & Thomas, G. A. (1999). Evaluation of a computer-aided learning program in removable partial denture framework designing.Journal of Prosthodontics 8100–105.
McGaghie, W. C., McCrimmon, D. R., Boerger, R. L., & Ravitch, M. M. (1994). Agreement among medical experts about the structure of concepts in pulmonary physiology.Academic Medicine 69578-S80.
Medical Research Council (1948). Streptomycin treatment of pulmonary tuberculosis.British Medical Journal 2769–782.
Morrison, R. S. (1960). “Gradualness, gradualness, gradualness” (I.P.Pavlov).American Psychologist 15187–197.
Neisser, U. (1967).Cognitive psychology.New York: Appleton-Century-Crofts.
Neyman, J., & Pearson, E. S. (1933). On the problem of the most efficient tests of statistical hypotheses.Philosophical Transactions of the Royal Society A 231289–337.
Norman, G. R., & Schmidt, H. (1999). Of what practical use is a baby? Perspectives on educational research as a scientific enterprise.Professions Education Researcher Quarterly 20October.
Norman, G. R., & Schmidt, H. G. (1992). The psychological basis of problem-based learning: a review of evidence.Academic Medicine 67557–565.
Norman, G. R. (1999) Editorial - Is the cure worse than the disease?Advances in Health Sciences Education 4107–109.
Norman, G. R., Rosenthal, D., Brooks, L. R., & Muzzin, L. J. (1989). The development of expertise in dermatology.Archives of Dermatology 1251063–1068.
Norman, G. R., Brooks, L. R., & Allen, S. W. (1989). Recall by expert medical practitioners and novices as a record of processing attention.Journal of Experimental Psychology: Learning Memory and Cognition 151166–1174.
Papa, F. J., Stone, R. C., & Aldrich, D. G. (1996). Further evidence of the relationship between case typicality and diagnostic performance: Implications for medical education.Academic Medicine 71S10–S12.
Pavlov, I. (1927).Conditioned reflexes.Oxford, England: Oxford Press.
Pearson, K. (1900). On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. Philosophical Magazine, Series V 1157–175.
Plutchik, R. (1968).Foundations of experimental research.New York: Harper and Row.
Rowe, J. L. (1989). The effectiveness of a computer-assisted instruction program upon learning the X-ray machine circuit.Radiology Technology 61115–118.
Royall, R. M. (1997).Statistical evidence: A likelihood paradigm.New York: International Thomson Publishing.
Schmidt, G., Machiels-Bongaerts, M., Hermans, H., Ten Cate, Th. J., Venekamp, R., & Boshuizen, H. P. A. (1996). The development of diagnostic competence: comparison of a problem-based, an integrated and a conventional medical curriculum.Academic Medicine 71(6)658–664.
Schuwirth, L. W. T., Verhoeven, B. H., Scherpbier, A. J. J. A., Mom, E. M. A., Cohen-Schotanus, J., Van Rossum, H. J. M., & Van der Vleuten, C. P. M. (1999). An inter-and intra-university comparison with short case-based testing.Advances in Health Sciences Education4(3), 233–244.
Scott, J. P. (1955). The place of observation in biological and psychological science.American Psychologist 1061–64.
Silver, M., & Wilkerson, L. A. (1991). Effects of tutors with subject expertise on the problem-based tutorial process.Academic Medicine 66298–300.
Skinner, B. F. (1938).The behavior of organisms.New York: Appleton-Century-Crofts.
Skipper, J. K., Jr., Guenther, A. L., & Nass, G. (1967). The sacredness of.05: a note concerning the uses of statistical levels of significance in social science.American Sociologist 216–18.
Student (1908). The probable error of a mean.Biometrika 61–25.
Thorndike, E. L. (1898). Animal intelligence: An experimental study of the associative processes in animals.Psychological Monographs 2(Whole No. 8).
Thorndike, E. L. (1903).Educational psychology.New York: Scientific Press.
Venn, J. (1888). Cambridge anthropometry.Journal of the Anthropological Institute 18140–154.
Verhoeven, B. H., Verwijnen, G. M., Scherpbier, A. J. J. A., Holdrinet, R. S. G., Oeseburg, B., Bulte, J. A., & Van der Vleuten, C. P. M. (1998). An analysis of progress test results of PBL and non-PBL students.Medical Teacher20(4), 310–316.
Watson, J. B. (1925).Behaviorism.New York: Norton.
Yates, F. (1951). The influence of Statistical Methods for Research Workers on the development of the science of statistics.Journal of the American Statistical Association 4619–34.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Regehr, G. (2002). The Experimental Tradition. In: Norman, G.R., et al. International Handbook of Research in Medical Education. Springer International Handbooks of Education, vol 7. Springer, Dordrecht. https://doi.org/10.1007/978-94-010-0462-6_2
Download citation
DOI: https://doi.org/10.1007/978-94-010-0462-6_2
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-010-3904-8
Online ISBN: 978-94-010-0462-6
eBook Packages: Springer Book Archive