Abstract
Large displays are helpful tools for knowledge discovery applications. The increased screen real estate allows for more data to be shown at once. In some cases using virtual reality visualizations helps in creating more useful visualizations. In such settings, traditional input devices are not well-suited. They also do not scale well to multiple users, effectively limiting collaborative knowledge discovery scenarios. Smart phones and tablet computers are becoming increasingly ubiquitous and powerful, even having multi-core CPUs and dedicated Graphic Processing Units (GPUs). Given their built-in sensors they can serve as replacements for currently-used input devices, and provide novel functionality not achieved with traditional devices. Furthermore, their ubiquity ensures that they scale well to multi-user environments, where users can use their own devices. We present an application-independent way to integrate smart phones and tablets into knowledge discovery applications as input devices with additional functionality. This approach is based on Marking Menus, but extends the basic idea by employing the special capabilities of current consumer-level smart phones and tablets.
Chapter PDF
Similar content being viewed by others
References
Accot, J., Zhai, S.: Beyond Fitts’ law: models for trajectory-based HCI tasks. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 295–302. ACM (1997)
Bailly, G., Lecolinet, E.: Flower menus: a new type of marking menu with large menu breadth, within groups and efficient expert mode memorization. In: AVI 2008 Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 15–22 (2008)
Ballagas, R., Rohs, M., Sheridan, J.G.: Sweep and Point and Shoot: Phonecam-based Interactions for Large Public Displays. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, pp. 1200–1203. ACM (2005)
Baudisch, P., Good, N., Stewart, P.: Focus plus context screens: combining display technology with visualization techniques. In: Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology, UIST 2001, pp. 31–40. ACM, New York (2001)
Fitts, P.M.: The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47(6), 381–391 (1954)
Francone, J., Bailly, G., Lecolinet, E., Mandran, N., Nigay, L.: Wavelet menus on handheld devices: stacking metaphor for novice mode and eyes-free selection for expert mode. In: Proceedings of the International Conference on Advanced Visual Interfaces, AVI 2010, pp. 173–180. ACM, New York (2010)
Francone, J., Bailly, G., Nigay, L., Lecolinet, E.: Wavelet Menus: A Stacking Metaphor for Adapting Marking Menus to Mobile Devices. In: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 2–5 (2009)
Gao, H., Guo, X., Chen, X., Wang, L., Liu, X.: YAGP: Yet Another Graphical Password Strategy. Computer Security Applications Conference, Annual, 121–129 (2008)
Guimbretiere, F., Winograd, T.: FlowMenu: Combining Command, Text, and Data Entry. In: Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, pp. 213–216. ACM (2000)
Heidrich, F., Golod, I., Russell, P., Ziefle, M.: Device-free interaction in smart domestic environments. In: Proceedings of the 4th Augmented Human International Conference, AH 2013, pp. 65–68. ACM, New York (2013)
Holzinger, A., Searle, G., Peischl, B., Debevc, M.: An answer to who needs a stylus? on handwriting recognition on mobile devices. In: Obaidat, M.S., Sevillano, J.L., Filipe, J. (eds.) ICETE 2011. CCIS, vol. 314, pp. 156–167. Springer, Heidelberg (2012)
Holzinger, A., Treitler, P., Slany, W.: Making apps useable on multiple different mobile platforms: On interoperability for business application development on smartphones. In: Quirchmayr, G., Basl, J., You, I., Xu, L., Weippl, E. (eds.) CD-ARES 2012. LNCS, vol. 7465, pp. 176–189. Springer, Heidelberg (2012)
Jeon, S., Hwang, J., Kim, G.J., Billinghurst, M.: Interaction techniques in large display environments using hand-held devices. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST 2006, pp. 100–103. ACM, New York (2006)
Kin, K., Hartmann, B.: Two-handed marking menus for multitouch devices. ACM Transactions on Computer-Human Interaction (TOCHI) TOCHI Homepage Archive 18(2), 16:1–16:23 (2011)
Kreylos, O.: Environment-Independent VR Development. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Remagnino, P., Porikli, F., Peters, J., Klosowski, J., Arns, L., Chun, Y.K., Rhyne, T.-M., Monroe, L. (eds.) ISVC 2008, Part I. LNCS, vol. 5358, pp. 901–912. Springer, Heidelberg (2008)
Kurtenbach, G., Buxton, W.: The limits of expert performance using hierarchic marking menus. In: Proceedings of the INTERACT 1993 and CHI 1993 Conference on Human Factors in Computing Systems, CHI 1993, pp. 482–487. ACM, New York (1993)
Kurtenbach, G., Buxton, W.: User learning and performance with marking menus. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Celebrating Interdependence, CHI 1994, pp. 258–264. ACM, New York (1994)
Lepinski, G., Grossman, T.: The design and evaluation of multitouch marking menus. In: Proceedings of the 28th International Conference on Human Factors in Computing Systems, pp. 2233–2242 (2010)
Madhavapeddy, A., Scott, D., Sharp, R.: Using Camera-Phones to Enhance Human-Computer Interaction. In: Proceedings of Ubiquitous (2004)
Mankoff, J., Abowd, G.D.: Cirrin: a word-level unistroke keyboard for pen input. In: Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology, UIST 1998, pp. 213–214. ACM, New York (1998)
Perlin, K.: Quikwriting: continuous stylus-based text entry. In: Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology, UIST 1998, pp. 215–216. ACM, New York (1998)
Pook, S., Lecolinet, E., Vaysseix, G., Ura, E.C., Bp, M.: Control Menus: Execution and Control in a Single Interactor. In: CHI 2000 Extended Abstracts on Human Factors in Computing Systems, pp. 263–264 (April 2000)
Thelen, S., Meyer, J., Ebert, A., Hagen, H.: A 3D Human Brain Atlas. Modelling the Physiological Human, 173–186 (2009)
Venolia, D., Neiberg, F.: T-Cube: a fast, self-disclosing pen-based alphabet. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Celebrating Interdependence, CHI 1994, pp. 265–270. ACM, New York (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 IFIP International Federation for Information Processing
About this paper
Cite this paper
Bauer, J., Ebert, A., Kreylos, O., Hamann, B. (2013). Marking Menus for Eyes-Free Interaction Using Smart Phones and Tablets. In: Cuzzocrea, A., Kittl, C., Simos, D.E., Weippl, E., Xu, L. (eds) Availability, Reliability, and Security in Information Systems and HCI. CD-ARES 2013. Lecture Notes in Computer Science, vol 8127. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40511-2_35
Download citation
DOI: https://doi.org/10.1007/978-3-642-40511-2_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40510-5
Online ISBN: 978-3-642-40511-2
eBook Packages: Computer ScienceComputer Science (R0)