Abstract
Pictorial representations are widely used in human problem solving. For blind and visually impaired people, haptic interfaces can provide perceptual access to graphical representations. We propose line-based graphics as a type of graphics, which are suitable to be explored by blind and visually impaired people, and which can be successfully augmented with auditory assistance by speech or non-verbal sounds. The central prerequisite for realizing powerful assistive interaction is monitoring the users’ haptic exploration and in particular the recognition of exploratory events. The representational layers of line-based graphics as well as of exploration-event descriptions are specified by qualitative spatial propositions. Based on these representations, event recognition is performed by rule-based processes.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
References
Tversky, B.: Visualizing Thought. Topics in Cognitive Science 3, 499–535 (2011)
De Felice, F., Renna, F., Attolico, G., Distante, A.: A Haptic/Acoustic Application to Allow Blind the Access to Spatial Information. In: World Haptics Conference, pp. 310–315 (2007)
Shimomura, Y., Hvannberg, E., Hafsteinsson, H.: Haptic cues as a utility to perceive and recognise geometry. Universal Access in the Information Society Online First, doi: 10.1007/s10209-012-0271-2
Sjöström, C., Danielsson, H., Magnusson, C., Rassmus-Gröhn, K.: Phantom-based Haptic Line Graphics for Blind Persons. Visual Impairment Research 5, 13–32 (2003)
Yu, J., Habel, C.: A Haptic-Audio Interface for Acquiring Spatial Knowledge about Apartments. In: Magnusson, C., Szymczak, D., Brewster, S. (eds.) HAID 2012. LNCS, vol. 7468, pp. 21–30. Springer, Heidelberg (2012)
Yu, W., Brewster, S.A.: Evaluation of Multimodal Graphs for Blind People. Journal of Universal Access in the Information Society 2, 105–124 (2003)
Loomis, J., Klatzky, R., Lederman, S.: Similarity of Tactual and Visual Picture Recognition with Limited Field of View. Perception 20, 167–177 (1991)
Beaudouin-Lafon, M.: Designing Interaction, not Interfaces. In: Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 15–22. ACM (2004)
Lohmann, K., Habel, C.: Extended Verbal Assistance Facilitates Knowledge Acquisition of Virtual Tactile Maps. In: Stachniss, C., Schill, K., Uttal, D. (eds.) Spatial Cognition 2012. LNCS, vol. 7463, pp. 299–318. Springer, Heidelberg (2012)
Lohmann, K., Kerzel, M., Habel, C.: Verbally Assisted Virtual-Environment Tactile Maps: A Prototype System. In: Proceedings of the Workshop on Spatial Knowledge Acquisition with Limited Information Displays, pp. 25–30 (2012)
Alaçam, Ö., Habel, C., Acartürk, C.: Towards Designing Audio Assistance for Comprehending Haptic Graphs: A Multimodal Perspective. In: Stephanidis, C. (ed.) UAHCI/HCII 2013, Part I. LNCS, vol. 8009, pp. 409–418. Springer, Heidelberg (2013)
Habel, C., Kerzel, M., Lohmann, K.: Verbal Assistance in Tactile-Map Explorations: A Case for Visual Representations and Reasoning. In: Proceedings of AAAI Workshop on Visual Representations and Reasoning 2010, pp. 34–41. AAAI, Menlo Park (2010)
Tversky, B.: Cognitive Maps, Cognitive Collages, and Spatial Mental Models. In: Campari, I., Frank, A.U. (eds.) COSIT 1993. LNCS, vol. 716, pp. 14–24. Springer, Heidelberg (1993)
Tversky, B., Zacks, J., Lee, P., Heiser, J.: Lines, Blobs, Crosses and Arrows: Diagrammatic Communication with Schematic Figures. In: Anderson, M., Cheng, P., Haarslev, V. (eds.) Diagrams 2000. LNCS (LNAI), vol. 1889, pp. 221–230. Springer, Heidelberg (2000)
Giudice, N.A., Palani, H., Brenner, E., Kramer, K.M.: Learning Non-Visual Graphic Information using a Touch-Based Vibro-Audio Interface. In: Proceedings 14th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 103–110. ACM (2012)
Parkes, D.: NOMAD - An Audio-Tactile Tool for the Acquisition, Use and Management of Spatially Distributed Information by Partially Sighted and Blind People. In: Tatham, A., Dodds, A. (eds.) Proceedings of the 2nd International Conference on Maps and Graphics for Visually Disabled People, pp. 24–29. King’s College, London (1988)
Moustakas, K., Nikolakis, G., Kostopoulos, K., Tzovaras, D., Strintzis, M.G.: Haptic Rendering of Visual Data for the Visually Impaired. IEEE Multimedia 14, 62–72 (2007)
Wang, Z., Li, B., Hedgpeth, T., Haven, T.: Instant Tactile-Audio Map: Enabling Access to Digital Maps for People with Visual Impairment. In: Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 43–50. ACM, Pittsburg (2009)
Lederman, S.J., Klatzky, R.L.: Haptic Perception: A Tutorial. Attention, Perception, and Psychophysics 71, 1439–1459 (2009)
Allen, J.: Maintaining Knowledge about Temporal Intervals. Communication of the ACM 26, 832–843 (1983)
Eschenbach, C., Kulik, L.: An Axiomatic Approach to the Spatial Relations Underlying ‘left’–‘right’ and ‘in front of’–‘behind’. In: Brewka, G., Habel, C., Nebel, B. (eds.) KI 1997. LNCS (LNAI), vol. 1303, pp. 207–218. Springer, Heidelberg (1997)
Eschenbach, C., Habel, C., Kulik, L.: Representing Simple Trajectories as Oriented Curves. In: Kumar, A.N., Russell, I. (eds.) FLAIRS 1999, Proceedings 12th International Florida AI Research Society Conference, pp. 431–436. AAAI, Menlo Park (1999)
Habel, C.: Representational Commitment in Maps. In: Duckham, M., Goodchild, M., Worboys, M. (eds.) Foundations of Geographic Information Science, pp. 69–93. Taylor & Francis, London (2003)
Klippel, A.: Wayfinding Choremes. In: Kuhn, W., Worboys, M.F., Timpf, S. (eds.) COSIT 2003. LNCS, vol. 2825, pp. 301–315. Springer, Heidelberg (2003)
Reiter, R., Mackworth, A.: A Logical Framework for Depiction and Image Interpretation. Artificial Intelligence 41, 125–155 (1989)
Pfoser, D., Jensen, C.: Indexing of Network Constrained Moving Objects. In: Proceedings of the 11th ACM International Symposium on Advances in Geographic Information Systems, pp. 25–32. ACM (2003)
Shipley, T., Maguire, M.: Geometric Information for Event Segmentation. Understanding Events: How Humans See, Represent, and Act on Events. In: Shipley, T.F., Zacks, J.M. (eds.) Understanding Events: How Humans See, Represent, and Act on Events, pp. 415–435. Oxford University Press, New York (2008)
Luckham, D.C.: The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley, Reading (2002)
Eckert, M., Bry, F.: Complex Event Processing (cep). In: Informatik-Spektrum 32, pp. 163–167 (2009)
Hayes-Roth, F.: Rule-Based Systems. Communications of the ACM 28, 921–932 (1985)
Anderson, J.R.: ACT: A Simple Theory of Complex Cognition. American Psychologist 51, 355–365 (1996)
Forgy, C.L.: Rete: A Fast Algorithm for the Many Pattern/Many Object Pattern Match Problem. Artificial Intelligence 19, 17–37 (1982)
Walzer, K., Breddin, T., Groch, M.: Relative Temporal Constraints in the Rete Algorithm for Complex Event Detection. In: Proceedings of the Second International Conference on Distributed Event-Based Systems, pp. 147–155. ACM (2008)
Kerzel, M.: Rule Patterns for Event Recognition During Exploration of Hapic Virtual Environment Line-based Graphics. Technical Report, Department of Informatics, University of Hamburg, Germany (2013)
Mackworth, A.K.: Adequacy Criteria for Visual Knowledge Representation. In: Pylyshyn, Z. (ed.) Computational Processes in Human Vision, pp. 464–476. Ablex Publishers, Norwood (1988)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Kerzel, M., Habel, C. (2013). Event Recognition during the Exploration of Line-Based Graphics in Virtual Haptic Environments. In: Tenbrink, T., Stell, J., Galton, A., Wood, Z. (eds) Spatial Information Theory. COSIT 2013. Lecture Notes in Computer Science, vol 8116. Springer, Cham. https://doi.org/10.1007/978-3-319-01790-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-01790-7_7
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-01789-1
Online ISBN: 978-3-319-01790-7
eBook Packages: Computer ScienceComputer Science (R0)