Abstract
In recent years the field of augmented reality (AR) has seen great advances in interaction, tracking and rendering. New input devices and mobile hardware have enabled entirely new interaction concepts for AR content. The high complexity of AR applications results in lacking usability evaluation practices on part of the developer. In this paper, we present a thorough classification of factors influencing user experience, split into the broad categories of rendering, tracking and interaction. Based on these factors, we propose an architecture for evaluating AR experiences prior to deployment in an adapted virtual reality (VR) environment. Thus we enable rapid prototyping and evaluation of AR applications especially suited for applications in challenging industrial AR projects.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Morrison, A., Mulloni, A., Lemmelä, S., Oulasvirta, A., Jacucci, G., Peltonen, P., Schmalstieg, D., Regenbrecht, H.: Collaborative use of mobile augmented reality with paper maps. Computers & Graphics 35(4), 789–799 (2011)
Allen, M., Hoermann, S., Piumsomboon, T., Regenbrecht, H.: Visual occlusion in an augmented reality post-stroke therapy scenario. In: Proc. CHINZ. ACM (2013)
Azuma, R.: A survey of augmented reality. Presence 6(4), 355–385 (1997)
Brooke, J.: Sus-a quick and dirty usability scale. Usability Evaluation in Industry 189, 194 (1996)
Du Huynh, Q.: Metrics for 3d rotations: Comparison and analysis. Mathematical Imaging and Vision 35(2), 155–164 (2009)
Dünser, A., Grasset, R., Billinghurst, M.: A Survey of Evaluation Techniques Used in Augmented Reality Studies. Technical report (2008)
Gabbard, J.L., Swan, J.E., Hix, D., Lucas, J., Gupta, D.: An empirical user-based study of text drawing styles and outdoor background textures for augmented reality. In: Proc. VR, pp. 11–18, 317. IEEE (2005)
Gauglitz, S., Lee, C., Turk, M., Höllerer, T.: Integrating the physical environment into mobile remote collaboration. In: Proc. MobileHCI, pp. 241–250. ACM (2012)
Hart, S.G., Staveland, L.E.: Development of nasa-tlx (task load index): Results of empirical and theoretical research. Human Mental Workload 1(3), 139–183 (1988)
Kaufmann, H., Schmalstieg, D.: Mathematics and geometry education with collaborative augmented reality. Computers & Graphics 27(3), 339–345 (2003)
Khan, V., Nuijten, K., Deslé, N.: Pervasive application evaluation within virtual environments. In: Proc. PECCS, pp. 261–264. SciTePress (2011)
Knecht, M., Dünser, A., Traxler, C., Wimmer, M., Grasset, R.: A framework for perceptual studies in photorealistic augmented reality (2011)
Lee, C., Bonebrake, S., Hollerer, T., Bowman, D.A.: The role of latency in the validity of ar simulation. In: Proc. VR, pp. 11–18. IEEE (2010)
Lee, C., Rincon, G.A., Meyer, G., Hollerer, T., Bowman, D.A.: The effects of visual realism on search tasks in mixed reality simulation. Visualization and Computer Graphics 19(4), 547–556 (2013)
Ragan, E., Wilkes, C., Bowman, D.A., Hollerer, T.: Simulation of augmented reality systems in purely virtual environments. In: Proc. VR, pp. 287–288. IEEE (2009)
Shah, M.M., Arshad, H., Sulaiman, R.: Occlusion in augmented reality. In: Proc. ICIDT, vol. 2, pp. 372–378. IEEE (2012)
Swan, J.E., Gabbard, J.L.: Survey of user-based experimentation in augmented reality. In: Proc. VR, pp. 1–9. IEEE (2005)
Viega, J., Conway, M.J., Williams, G., Pausch, R.: 3d magic lenses. In: Proc. UIST, pp. 51–58. ACM (1996)
Vincent, T., Nigay, L., Kurata, T.: Handheld augmented reality: Effect of registration jitter on cursor-based pointing techniques. In: Proc. IHM, pp. 1–6. ACM (2013)
Shen, Y., Ong, S.K., Nee, A.Y.C.: Augmented reality for collaborative product design and development. Design Studies 31(2), 118–145 (2010)
Bai, Z., Blackwell, A.F.: Analytic review of usability evaluation in ISMAR. Interacting with Computers 24(6), 450–460 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Tiefenbacher, P., Lehment, N.H., Rigoll, G. (2014). Augmented Reality Evaluation: A Concept Utilizing Virtual Reality. In: Shumaker, R., Lackey, S. (eds) Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments. VAMR 2014. Lecture Notes in Computer Science, vol 8525. Springer, Cham. https://doi.org/10.1007/978-3-319-07458-0_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-07458-0_22
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07457-3
Online ISBN: 978-3-319-07458-0
eBook Packages: Computer ScienceComputer Science (R0)