Examining Virtual Reality as an Alternative to In-Person and Online Learning Environments

Abstract

The continuous advances in virtual reality (VR) technology have increased its potential for tasks that require hands-on learning. One potential target for VR is its use as an alternative to online learning when a physical lab cannot be accessed due to learner’s financial, travel, or pandemic-related constraints. We enrolled 15 participants to assess VR’s feasibility as a modality to teach A + certification skills. Each participant was randomly assigned to three groups (in-person lab, online lab, virtual reality lab). Participants completed System Usability Scale (SUS) and User Burden Scale (UBS) surveys and interviewed about their lab experience. In addition, VR participants completed a Technology Acceptance Model (TAM) survey. Participants reported the VR experience with lower system usability and higher user burden than other learning modalities. Virtual Reality participants in the study scored VR highly in its perceived usefulness, average for its perceived use, and high in perceived usefulness for learning and engagement. Learner adoption and onboarding of VR is a challenge worth surmounting. VR retains attention, increases learner retention, and incentivizes failure recovery. This study provides preliminary evidence supporting that further development of VR for training in spatial tasks holds promise over traditional learning modalities.

Appendix A: Survey Instruments & Interview Protocol

System Usability Scale [5-point Likert Scale]

• 1. I think that I would like to use this method of learning frequently.

• 2. I found the method of learning unnecessarily complex.

• 3. I thought the method of learning was easy to use.

• 4. I think that I would need the support of a technical person to be able to use this method of learning.

• 5. I found the various functions in this method of learning were well integrated.

• 6. I thought there was too much inconsistency in this method of learning.

• 7. I would imagine that most people would learn to use this method of learning very quickly.

• 8. I found the method of learning very cumbersome to use.

• 9. I felt very confident using the method of learning.

• 10. I needed to learn a lot of things before I could get going with this method of learning.

User Burden Scale [5-point Likert Scale]

[Difficulty of use]

• 1. I needed assistance from another person to use the system.

• 2. The learning system demanded too much mental effort.

• 3. It took too long for me to do what I wanted to do with the learning system.

• 4. The system was hard to learn.

[Physical]

• 1. Using this learning system created too much physical discomfort.

• 2. The learning system made me feel physical pain.

• 3. The use of this learning system was too physically demanding.

[Mental & Emotional]

• 1. The learning system required me to remember too much information.

• 2. The learning system presented too much information at once.

Technology Acceptance Model [Only for VR group]

[Perceived Usefulness of VR]

• 1. Using VR improves the quality of my learning.

• 2. Using VR gives me greater control over my learning.

• 3. VR enables me to accomplish my learning more quickly.

• 4. VR supports critical aspects of my learning.

• 5. Using VR increases my learning.

• 6. Using VR allows me to learn more than would otherwise be possible.

• 7. Using VR enhances the effectiveness of my learning.

• 8. Using VR makes it easier to learn.

• 9. Overall, I find VR useful in my learning.

[Perceived Ease of Use of VR]

• 1. I find VR cumbersome to use.

• 2. Learning to operate VR is easy for me.

• 3. Interacting with VR is often frustrating.

• 4. I find it easy to get VR to do what I want it to do.

• 5. VR is rigid and inflexible to interact with.

• 6. It is easy for me to remember how to perform tasks using VR.

• 7. Interacting with VR requires a lot of mental effort.

• 8. Interacting with virtual objects inside VR is clear and understandable.

• 9. I find it takes a lot of effort to become skillful at using VR.

• 10. Overall, I find VR easy to use.

[Perceived usefulness of VR for Learning and Engagement]

• 1. I find VR fun to use.

• 2. I prefer learning hands-on tasks in VR.

• 3. Learning spatial tasks is hard in VR.

• 4. I understand new material in VR.

• 5. I remember what I learned in VR.

• 6. I recommend learning in VR to others.

• 7. I enjoy learning to use VR.

• 8. It is disorienting to learn in VR.

Post-Usability Testing Interview Questions

• 1. How helpful was the information from the pre-requisite video to perform this task?

• 2. What difficulties did you face while performing the task?

• 3. What did you like about this exercise?

• 4. Do you have any feedback for us?

• 5. Do you have prior online learning experience? [Only for VR group]

• 6. If yes, which experience do you think is better? in-person, Online or VR? Why? [Only for VR group]