Abstract
3D Virtual Environments (3DVE) are more and more used in different applications such as CAD, games, or teleoperation. Due to the improvement of smartphones hardware performance, 3D applications were also introduced to mobile devices. In addition, smartphones provide new computing capabilities far beyond the traditional voice communication. They are permitted by the variety of built-in sensors and the internet connectivity. In consequence, interesting 3D applications can be designed by enabling the device capabilities to interact in a 3DVE. Due to the fact that smartphones have small and flat screens and that a 3DVE is wide and dense, mobile devices present some constraints: the environment density, the depth of targets and the occlusion. The pointing task faces these three problems to select a target. We propose a new classification of the existing interaction techniques, according to three axis of classification: a) the three discussed problems (density, depth and occlusion); b) the first two subtasks of the pointing task (navigation, selection); and c) the number of targets selected by the pointing technique (1 or N). In this paper we will begin by presenting a state of the art of the different pointing techniques in existing 3DVE, structured around three selection techniques: a) Ray casting, b) Curve and c) Point cursor. Then we will present our classification, and we will illustrate the classification of the main pointing techniques for 3DVE. From this classification, we will discuss the type of interaction that seems the most appropriate to perform this subtask optimally.
Chapter PDF
Similar content being viewed by others
Keywords
References
Bowman, D.A.: Principles for the Design of Performance-oriented Interaction Techniques, ch. 15
Bowman, D.A., Johnson, D.B., Hodges, L.F.: Testbed evaluation of virtual environment interaction techniques. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST 1999), pp. 26–33. ACM, New York (1999)
Bowman, D.A., Hodges, L.F.: An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. In: Proceedings of the 1997 Symposium on Interactive 3D Graphics (I3D 1997), pp. 35–38. ACM, New York (1997)
Dang, N., Le, H., Tavanti, M.: Visualization and interaction on flight trajectory in a 3D stereoscopic environment. In: IEEE 2003, pp. 9.A.5-1–9.A.5-10 (2003)
Grossman, T., Balakrishnan, R.: The Design and Evaluation of Selection Techniques for 3D Volumetric Displays. In: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST 2006), pp. 3–12. ACM, New York (2006)
Grossman, T., Balakrishnan, R.: The bubble cursor: Enhancing target acquisition by dynamic resizing of the cursor’s activation area. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2005), pp. 281–290. ACM, New York (2005)
Hwang, M.S., Jeon, J.W.: Design of the 3D Input Method Based on Touch Device for Mobile. In: Fifth International Joint Conference on INC, IMS and IDC IEEE, NCM 2009, pp. 1607–1610 (2009)
Liang, J., Liang, O., Green, M.: Geometric Modeling Using Six Degrees of Freedom Input Devices. In: 3rd Int’l Conference on CAD and Computer Graphics (1993)
Olwal, A., Feiner, S.: The Flexible Pointer: An Interaction Technique for Augmented and Virtual Reality. In: UIST 2003, ACM Symposium on User Interface Software and Technology, pp. 81–82 (2003)
Poupyrev, I., Billinghurst, M., Weghorst, S., Ichikawa, T.: The Go-Go Interaction Technique: Non-linear Mapping for Direct Manipulation in VR. In: Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology (UIST 1996), pp. 79–80. ACM, New York (1996)
Ramos, G., Robertson, G., Czerwinski, M., Tan, D., Baudisch, P., Hinckley, K., Agrawala, M.: Tumble! Splat! Helping Users Access and Manipulate Occluded Content in 2D Drawings. In: Proceedings of the Working Conference on Advanced Visual Interfaces (AVI 2006), pp. 428–435. ACM, New York (2006)
Robbins, D.C., Cutrell, E., Sarin, R., Horvitz, E.: ZoneZoom: Map Navigation for Smartphones with Recursive View Segmentation. In: Proceedings of the Working Conference on Advanced Visual Interfaces (AVI 2004), pp. 231–234. ACM, New York (2004)
Schäfers, T., Rohs, M., Spors, S., Raake, A., Ahrens, J.: Designing Low-Dimensional Interaction for Mobile Navigation in 3D Audio Spaces. In: Proceedings of 34th International Conference of the Audio Engineering Society, AES (2008)
Steed, A., Parker, C.: 3D Selection Strategies for Head Tracked and Non-Head Tracked Operation of Spatially Immersive Displays. In: Proceedings of 8th International Immersive Projection Technology Workshop, pp. 13–14 (2004)
Stoakley, R., Conway, M., Pausch, R.: Virtual Reality on a WIM: Interactive Worlds in Miniature. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1995), pp. 265–272. ACM Press/Addison-Wesley Publishing Co, New York, NY (1995)
Steinicke, F., Ropinski, T., Hinrichs, K.: Object selection in virtual environments using an improved virtual pointer metaphor. In: Proceedings of International Conference on Computer Vision and Graphics (ICCVG), pp. 320–326 (2006)
Vanacken, L., Grossman, T., Coninx, K.: Exploring the effects of environment density and target visibility on object selection in 3D virtual environments. In: IEEE Symposium on 3D User Interfaces, pp. 117–124 (2007)
Vanacken, L., Grossman, T., Coninx, K.: Multimodal selection techniques for dense and occluded 3D virtual environments. International Journal of Human-Computer Studies 67(3), 237–255 (2009)
Zhai, S., Milgram, P., Rastogi, A.: Anisotropic human performance in six degree-of-freedom tracking: An evaluation of three-dimensional display and control interfaces. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 27(4), 518–528 (1997)
Zhai, S., Buxton, W., Milgram, P.: The “Silk Cursor": Investigating transparency for 3D target acquisition. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1994), pp. 459–464. ACM, New York (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Balaa, E., Raynal, M., Issa, Y.B., Dubois, E. (2014). Classification of Interaction Techniques in the 3D Virtual Environment on Mobile Devices. In: Shumaker, R., Lackey, S. (eds) Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments. VAMR 2014. Lecture Notes in Computer Science, vol 8525. Springer, Cham. https://doi.org/10.1007/978-3-319-07458-0_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-07458-0_1
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07457-3
Online ISBN: 978-3-319-07458-0
eBook Packages: Computer ScienceComputer Science (R0)