Skip to main content
SpringerLink
Log in

NERVE, InterPLAY, and Design-Based Research: Advancing Experiential Learning and the Design of Virtual Patient Simulation

  • Living reference work entry
  • Latest version View entry history
  • First Online:
Learning, Design, and Technology

Abstract

Systematic reviews and meta-analyses of randomized controlled studies conclude that virtual patient simulations (VPs) are consistently associated with higher learning outcomes compared to other educational methods, such as lectures, handouts, textbooks, and standardized patients (e.g., Consorti et al., Comput Educ 59(3):1001–1008, 2012; Cook and Triola Med Educ 43(4):303–311, 2009; McGaghie et al., Acad Med J Assoc Am Med Colleges 86(6):706, 2011). However, we cannot assume that students will learn by simply giving them access to the simulations. The instructional features that are integrated before, during, and after the simulations may affect student learning as much as or more so than the simulations. The strategy used to integrate the simulation into the curriculum and evaluate student performance may also have a significant effect on its use and learning. Here, we document the design, development, and testing of NERVE (a VPs created to develop medical students’ ability to examine, interview, and diagnose patients with cranial nerve disorders) in one definitive source and elaborate on what went on in each team members’ mind as the system evolved. Specifically, we examine the skills, knowledge, and dispositions called upon and the key lessons learned by team members during the last year of research and development. Concluding remarks related the individual accounts and discuss common findings to shed further insights on the team’s experience.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Similar content being viewed by others

References

  • Adams, E., Rodgers, C., Harrington, R., Young, M., & Sieber, V. (2011). How we created virtual patient cases for primary care-based learning. Medical Teacher, 33(4), 273–278.

    Article  Google Scholar 

  • Agency for Healthcare Research and Quality (AHRQ). (2013). PAR-11-024 advances in patient safety through simulation research. http://grants.nih.gov/grants/guide/pa-files/PAR-11-024.html. Accessed January 20.

  • Atkinson, T., & Hirumi, A. (2010). The game brain. In A. Hirumi (Ed.), Playing games in school: Using simulations and videogames for primary and secondary education (p. 63). Eugene, WA: International Society for Technology in Education.

    Google Scholar 

  • Bateman, J., Allen, M. E., Kidd, J., Parsons, N., & Davies, D. (2012). Virtual patients design and its effect on clinical reasoning and student experience: A protocol for a randomised factorial multi-centre study. Medical Education, 12(1), 62.

    Google Scholar 

  • Bateman, J., Allen, M. E., Samani, D., Kidd, J., & Davies, D. (2013). Virtual patient design: Exploring what works and why. A grounded theory study. Medical Education, 47(6), 595–606.

    Article  Google Scholar 

  • Berman, N., Fall, L., Smith, S., Levine, D., Maloney, C., Potts, M., … Foster-Johnson, L. (2009). Integration strategies for using virtual patients in clinical clerkships. Academic Medicine, 84(7), 943–949.

    Article  Google Scholar 

  • Botezatu, M., Hult, H., Tessma, M. K., & Fors, U. G. (2010). As time goes by: Stakeholder opinions on the implementation and use of a virtual patient simulation system. Medical Teacher, 32(11), e509–e516.

    Article  Google Scholar 

  • Cendan, J., & Lok, B. (2012). The use of virtual patients in medical school curricula. Advances in Physiology Education, 36(1), 48–53.

    Article  Google Scholar 

  • Churchill, D. (2007). Towards a useful classification of learning objects. Educational Technology Research and Development, 55(5), 479–497.

    Article  Google Scholar 

  • Cobb, P., Confrey, J., diSessa, A., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research. Educational Researcher, 32(1), 9–13.

    Article  Google Scholar 

  • Colder, B. (2011). Emulation as an integrating principle for cognition. Frontiers in Computational Neuroscience, 5(54), 1–12.

    Google Scholar 

  • Consorti, F., Mancuso, R., Nocioni, M., & Piccolo, A. (2012). Efficacy of virtual patients in medical education: A meta-analysis of randomized studies. Computers & Education, 59(3), 1001–1008.

    Article  Google Scholar 

  • Cook, D., & Triola, M. (2009). Virtual patients: A critical literature review and proposed next steps. Medical Education, 43(4), 303–311.

    Article  Google Scholar 

  • Cook, D. A. (2014). How much evidence does it take? A cumulative meta-analysis of outcomes of simulation-based education. Medical Education, 48(8), 750–760.

    Article  Google Scholar 

  • Cook, D. A., Erwin, P. J., & Triola, M. M. (2010). Computerized virtual patients in health professions education: A systematic review and meta-analysis. Academic Medicine, 85, 15890–11602.

    Google Scholar 

  • Cooke, S. F. (2006). Plasticity in the human central nervous system. Brain, 129(Pt 7), 1659–1673.

    Article  Google Scholar 

  • Dewey, J. (1938). Logic: The theory of inquiry. New York: Holt, Rinehart and Winston.

    Google Scholar 

  • de Jong, T., & von Joolingen, W. R. (1998). Scientific discovery learning with computer simulations of conceptual domains. Review of Educational Research, 68(3), 179–201.

    Article  Google Scholar 

  • Edelbring, S. (2010). A three-fold framework for relating to innovations and technology in education: Learning from, with and about technology. In A. Bromage, L. Clouder, J. Thistlethwaite, & F. Gordon (Eds.), Interprofessional E-learning and collaborative work: Practices and technologies (pp. 23–33). Hershey, PA: IGI Global.

    Chapter  Google Scholar 

  • Edelbring, S., Broström, O., Henriksson, P., Vassiliou, D., Spaak, J., Dahlgren, L. O., & Zary, N. (2012). Integrating virtual patients into courses: Follow-up seminars and perceived benefit. Medical Education, 46(4), 417–425.

    Article  Google Scholar 

  • Edelbring, S., Dastmalchi, M., Hult, H., Lundberg, I. E., & Dahlgren, L. O. (2011). Experiencing virtual patients in clinical learning: A phenomenological study. Advances in Health Sciences Education, 16(3), 331–345.

    Article  Google Scholar 

  • Fischer, M., Hege, I., Hörnlein, A., Puppe, F., Tönshoff, B., & Huwendiek, S. (2007). Virtual patients in medical education: A comparison of various strategies for curricular integration. Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen, 102(10), 648–653.

    Article  Google Scholar 

  • Fullan, M. (1993). Change forces: Probing the depth of educational reform. London, UK: Falmer.

    Google Scholar 

  • Georg, C., & Zary, N. (2014). Web-based virtual patients in nursing education: Development and validation of theory-anchored design and activity models. Journal of Medical Internet Research, 16(4), e105. http://doi.org/10.2196/jmir.2556.

    Article  Google Scholar 

  • Gibbons, A. S., McConkie, M., Seo, K. K., & Wiley, D. A. (2009). Simulation approach to instruction. In C. M. Reigeluth & A. A. Carr-Chellman (Eds.), Instructional-design theories and models: building a common knowledge base (Vol. III, pp. 167–193). New York, NY: Routledge.

    Google Scholar 

  • Gormley, G. J., Mcglade, K., Thomson, C., Mcgill, M., & Sun, J. (2011). A virtual surgery in general practice: Evaluation of a novel undergraduate virtual patient learning package. Medical Teacher, 33(10), 522–527.

    Article  Google Scholar 

  • Haag, M., Singer, R., Bauch, M., Heid, J., Hess, F., & Leven, F. (2007). Challenges and perspectives of computer-assisted instruction in medical education. Lessons learned from seven years of experience with the CAMPUS system. Methods of Information in Medicine, 46(1), 67.

    Article  Google Scholar 

  • Hall, G. E., & Hord, S. M. (2001). Implementing change: Patterns, principles and potholes. Boston, MA: Allyn and Bacon.

    Google Scholar 

  • Harden, R. M., Grant, J., Buckley, E. G., & Hart, I. R. (1999). BEME guide no. 1: Best evidence medical education. Medical Teacher, 21(6), 553–562.

    Article  Google Scholar 

  • Harrison, M., Short, C., & Roberts, C. (2003). Reflecting on reflective learning: The case of geography, earth and environmental sciences. Journal of Geography in Higher Education, 27(2), 133–152.

    Article  Google Scholar 

  • Hirumi, A., Johnson, K., Kleinsmith, A., Reyes, R., Rivera-Gutierrez, D., Kubovec, S., … Cendan, J. (in press). Advancing virtual patient simulations and experiential learning with InterPLAY: Examining how theory informs design and design informs theory. Journal of Applied Instructional Design.

    Google Scholar 

  • Hirumi, A., Johnson, T., Reyes, R. J., Lok, B., Johnsen, K., Rivera-Gutierrez, D. J., et al. (2016). Advancing virtual patient simulations through design research and InterPLAY: Part II – testing and integration. Educational Technology, Research & Development. https://doi.org/10.1007/s11423-016-9461-6

  • Hirumi, A., Kleinsmith, A., Johnsen, K., Kubovec, S., Eakins, M., Bogert, K., et al. (2016). Advancing virtual patient simulations through design research and InterPLAY: Part I – Design and development. Educational Technology, Research & Development, 64(4), 763–785.

    Article  Google Scholar 

  • Huwendiek, S., & De Leng, B. A. (2010). Virtual patient design and curricular integration evaluation toolkit. Medical Education, 44(5), 519.

    Article  Google Scholar 

  • Huwendiek, S., De Leng, B. A., Kononowicz, A. A., Kunzmann, R., Muijtjens, A. M., Van Der Vleuten, C. P., … Dolmans, D. H. (2015). Exploring the validity and reliability of a questionnaire for evaluating virtual patient design with a special emphasis on fostering clinical reasoning. Medical Teacher, 37(8), 775–782.

    Article  Google Scholar 

  • Huwendiek, S., Duncker, C., Reichert, F., De Leng, B. A., Dolmans, D., van der Vleuten, C. P., & Tönshoff, B. (2013). Learner preferences regarding integrating, sequencing and aligning virtual patients with advancing virtual patient simulations through design other activities in the undergraduate medical curriculum: A focus group study. Medical Teacher, 35(11), 920–929.

    Article  Google Scholar 

  • Huwendiek, S., Reichert, F., Bosse, H. M., De Leng, B. A., Van Der Vleuten, C. P., Haag, M., & Tönshoff, B. (2009). Design principles for virtual patients: A focus group study among students. Medical Education, 43(6), 580–588.

    Article  Google Scholar 

  • Illeris, K. (2014). Transformative learning and identity. [electronic resource]. Abingdon, Oxon: Routledge.

    Google Scholar 

  • Issenberg, S. B., McGaghie, W. C., Petrusa, E., Gordon, D. L., & Scalese, R. J. (2005). Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review. Medical Teacher, 27(1), 10–28.

    Article  Google Scholar 

  • Johnson, T. R., Lyons, R., Chuah, J., Kooper, R., Lok, B., & Cendan, J. C. (2013). Optimal learning in a virtual patient simulation of cranial nerve palsies: The interaction between social learning context and student aptitude. Medical Teacher, 35(1), 899–907.

    Article  Google Scholar 

  • Johnson, T. R., Lyons, R., Kooper, R., Johnsen, K. J., Lok, B. C., & Cendan, J. C. (2014). Virtual patient simulations and optimal social learning context: A replication of an aptitude-treatment interaction effect. Medical Teacher, 36(6), 486–494.

    Article  Google Scholar 

  • Keller, J. M. (1987). Development and use of the ARCS model of instructional design. Journal of instructional development, 10(3), 2–10.

    Article  Google Scholar 

  • Keller, J. M. (2010). Motivation design for learning and performance: The ARCS model approach. New York: Springer.

    Google Scholar 

  • Kleinsmith, A., Rivera-Gutierrez, D., Finney, G., Cendan, J. C., & Lok, B. (2015). Understanding empathy training with virtual patients. Computers in Human Behavior, 52, 151–158. http://doi.org/10.1016/j.chb.2015.05.033.

    Article  Google Scholar 

  • Kononowicz, A. A., Narracott, A. J., Manini, S., Bayley, M. J., Lawford, P. V., McCormack, K., & Zary, N. (2014). A framework for different levels of integration of computational models into web-based virtual patients. Journal of Medical Internet Research, 16(1), e23.

    Article  Google Scholar 

  • Lindsey, L., & Berger, N. (2009). Experiential approach to instruction. In C. Reigeluth & A. Carr-Chellman (Eds.), Instructional-design theories and models: Volume 3. Building a common knowledge based (pp. 117–142). New York, NY: Routledge.

    Google Scholar 

  • Maran, N. J., & Glavin, R. J. (2003). Low-to high-fidelity simulation – A continuum of medical education? Medical Education, 37(1), 22–28.

    Article  Google Scholar 

  • McGaghie, W. C., Issenberg, S. B., Cohen, M. E. R., Barsuk, J. H., & Wayne, D. B. (2011). Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Academic Medicine: Journal of the Association of American Medical Colleges, 86(6), 706.

    Article  Google Scholar 

  • McKenney, S. E., & Reeves, T. (2012). Conducting educational design research: What, why and how. London, UK: Taylor & Francis Ltd..

    Google Scholar 

  • Mezirow, J. (1990). Fostering critical reflection in adulthood: A guide to transformative and emancipatory learning. San Francisco. CA: Jossey-Bass.

    Google Scholar 

  • Moore, F., & Chalk, C. (2009). The essential neurologic examination: What should medical students be taught? Neurology, 72(23), 2020–2023.

    Article  Google Scholar 

  • Posel, N., Mcgee, J. B., & Fleiszer, D. M. (2014). Twelve tips to support the development of clinical reasoning skills using virtual patient cases. Medical Teacher, 37(9):1–6.

    Google Scholar 

  • Quinn, C. (2009). Computer-based simulations: Principles of engagement. In M. Silberman (Ed.), The handbook of experiential learning (pp. 138–171). San Francisco, CA: Pfeiffer.

    Google Scholar 

  • Reigeluth, C. M., & Schwartz, E. (1989). An instructional theory for the design of computer-based simulations. Journal of Computer-Based Instruction, 16(1), 1–10.

    Google Scholar 

  • Reyes, R. J., & Hirumi, A. (2016). Analyzing the pedagogical foundations of virtual patient simulations: A review of literature. Poster presented at the annual graduate research forum at the University of Central Florida, Orlando, FL, April 5.

    Google Scholar 

  • Rimmele, U. (n.d.). A primer on emotions and learning. Retrieved May 16, 2017, 2017 OECD. from http://www.oecd.org/edu/ceri/aprimeronemotionsandlearning.htm

  • Rivera-Gutierrez, D., Kleinsmith, A., Johnson, T., Lyons, R., Cendan, J., & Lok, B. (2014). Towards a reflective practicum of embodied conversational agent experiences, IEEE international conference on advanced learning technologies (ICALT). Athens, Greece: IEEE.

    Google Scholar 

  • Rogers, E. M., & Rogers, E. M. (2003). Diffusion of innovations. New York, NY: Free Press.

    Google Scholar 

  • Salas, E., & Gregory, M. E. (2011). Simulation-based training: Beyond the bells and whistles! CyberTherapy Magazine, 4, 18–19.

    Google Scholar 

  • Salem-Schatz, S., Ordin, D., & Mittman, B. (2010). Guide to the after action review (version 1.1). Using evaluation to improve our work: A resource guide. Retrieved March 23, 2015. http://www.queri.research.va.gov/ciprs/after_action_review.pdf.

  • Salminen, H., Zary, N., Björklund, K., Toth-Pal, E., & Leanderson, C. (2014). Virtual patients in primary care: Developing a reusable model that fosters reflective practice and clinical reasoning. Journal of Medical Internet Research, 16(1), e3. http://doi.org/10.2196/jmir.2616.

  • Schank, R. C., Berman, T. R., & Macpherson, K. A. (1999). Learning by doing. In C. M. Reigeluth (Ed.), Instructional-design theories and models: Vol. 2, a new paradigm of instructional theory (pp. 161–181). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Shank, R. C., Berman, T. R., & Macpherson, K. A. (1992). Learning by doing. In C. M. Reigeluth (Ed.), Instructional design theories and models: A new paradigm of instructional theory (pp. 161–179). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Stapleton, C., & Hirumi, A. (2011). InterPLAY instructional strategy: Learning by engaging interactive entertainment conventions. In M. Shaughnessy & S. Fulgham (Eds.), Pedagogical models: The discipline of online teaching (pp. 183–211). Hauppauge, NY: Nova Science Publishers.

    Google Scholar 

  • Stapleton, C., & Hirumi, A. (2014). Designing InterPLAY learning landscapes to evoke emotions, spark the imagination, and promote creative problem solving. In A. Hirumi (Ed.), Grounded designs for online and hybrid learning (pp. 159–190). Eugene, WA: International Society for Technology in Education.

    Google Scholar 

Download references

Acknowledgments

Research reported in chapter paper was supported by the National Institutes of Health (NIH) under award number 1R01LM010813–01. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Author information

Authors and Affiliations

  1. University of Central Florida, Orlando, FL, USA

    Atsusi Hirumi

  2. Computer and Information Sciences and Engineering Department, University of Florida, 32611, Gainesville, FL, USA

    Benjamin Chak Lum Lok

  3. Johns Hopkins University School of Medicine, 2024 East Monument Street, 21221, Baltimore, MD, USA

    Teresa R. Johnson

  4. College of Engineering, University of Georgia, Driftmier Engineering Center, 30602, Athens, GA, USA

    Kyle Johnsen

  5. Microsoft Corporation, One Microsoft Way, 98052, Redmond, WA, USA

    Diego de Jesus Rivera-Gutierrez

  6. Indiana State University, 650 Cherry Street, Myers Technology Building, Room 203, 47809-2245, Terre Haute, IN, USA

    Ramsamooj Javier Reyes

  7. Ashford University, 13500 Evening Creek Drive North, Suite 120, 92128, San Diego, CA, USA

    Tom Atkinson

  8. Simiosys Real World Laboratory, Orlando, FL, USA

    Christopher Stapleton

  9. College of Medicine, University of Central Florida, 6850 Lake Nona Blvd, 32827, Orlando, FL, USA

    Juan C. Cendán

Authors
  1. Atsusi Hirumi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Benjamin Chak Lum Lok
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Teresa R. Johnson
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kyle Johnsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Diego de Jesus Rivera-Gutierrez
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ramsamooj Javier Reyes
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Tom Atkinson
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Christopher Stapleton
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Juan C. Cendán
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Atsusi Hirumi .

Editor information

Editors and Affiliations

  1. College of Info, Ste G150, Univ of North Texas, Denton, Texas, USA

    Michael J Spector

  2. School of Education, Virginia Tech, Blacksburg, Virginia, USA

    Barbara B Lockee

  3. School of Education, Baker University, Overland Park, Kansas, USA

    Marcus D. Childress

Supplementary Electronic Material (S)

(MP4 4075 kb)

(MP4 10302 kb)

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Hirumi, A. et al. (2018). NERVE, InterPLAY, and Design-Based Research: Advancing Experiential Learning and the Design of Virtual Patient Simulation. In: Spector, M., Lockee, B., Childress, M. (eds) Learning, Design, and Technology. Springer, Cham. https://doi.org/10.1007/978-3-319-17727-4_76-2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-17727-4_76-2

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-17727-4

  • Online ISBN: 978-3-319-17727-4

  • eBook Packages: Springer Reference EducationReference Module Humanities and Social SciencesReference Module Education

Publish with us

Policies and ethics

Chapter history

  1. Latest

    NERVE, InterPLAY, and Design-Based Research: Advancing Experiential Learning and the Design of Virtual Patient Simulation
    Published:
    11 April 2018

    DOI: https://doi.org/10.1007/978-3-319-17727-4_76-2

  2. Original

    NERVE, InterPLAY, and Design-Based Research: Advancing Experiential Learning and the Design of Virtual Patient Simulation
    Published:
    06 October 2017

    DOI: https://doi.org/10.1007/978-3-319-17727-4_76-1

Search

Navigation