Abstract
Natural interaction, in the context of this paper, means human action in a world of tangible objects and live subjects. We introduce the concept of action regulation and relate it to observable human behaviour. A tool bringing together motor and cognitive action is a promising way to assure complete task regulation. Aiming for such tools, we propose a set of guidelines for the next generation of user interfaces, the Natural User Interface (NUI). We present a NUI instantiation called BUILD-IT, featuring video-mediated interaction in a task specific context. This multi-brick interaction tool renders virtual objects tangible and allows multiple user simultaneous interaction in one common space. A few user experiences are briefly described.
Preview
Unable to display preview. Download preview PDF.
References
Ackermann P: Developing Object-Oriented Multimedia Software Based on the MET++ Application Framework. Heidelberg: dpunkt Verlag für digitale Technologie, 1996.
AESOP GmbH: SIMPLE++ for modelling, simulation and visualisation, 1997.
Aicher O: analog und digital., ernst & sohn, 1991, pp 19–21, 28.
Buckminster Fuller R: On Education, The University of Massachusetts Press, Amherst, 1979, p. 46.
Campbell J: Training design for performance improvement. In J. Campbell & R. Campbell (Eds.), Productivity in organisations (pp. 177–216). San Francisco: Jossey-Bass, 1988.
CyberTouch, Virtual Technologies Inc., 2175 Park Boulevard, Palo Alto, CA 94306, http://www.virtex.com/
Draper S: Display Managers as the Basis for User-Machine Communication. In Norman D, Draper S (eds.) User Centered System Design. Lawrence Erlbaum, 1986, pp. 339–352.
Fitzmaurice G W: Graspable User Interfaces, PhD at the University of Toronto, 1996. http://www.dgp.utoronto.ca/people/GeorgeFitzmaurice/thesis/Thesis.gf.html.
Gibson, J. J. (1962). Observations on active touch. Psychological Review, 69, 477–491.
Hacker W: Action regulation theory and occupational psychology. Review of German empirical research since 1987. The German Journal of Psychology 18(2) (1994) pp. 91–120.
Kaptelinin V: Computer-Mediated Activity: Functional Organs in Social and Developmental Contexts. In Nardi B (ed.) Context and Consciousness, MIT Press 1996, p. 62.
Kirsh, D. and Maglio, P. (1994). On Distinguishing Epistemic from Pragmatic Action, Cognitive Science, 18, 513–549.
Mackenzie C., Iberall T: The grasping hand. Elsevier, 1994, p. 15.
Rauterberg M., über die Quantifizierung software-ergonomischer Richtlinien. PhD Thesis, University of Zurich, 1995.
Rauterberg M, Dätwyler M, Sperisen M: From Competition to Collaboration through a Shared Social Space. In: Proc. of East-West Intern. Conf. on Human-Computer Interaction (EWHCI ’95), 1995, pp. 94–101.
Rauterberg M, Fjeld M, Krueger H, Bichsel M, Leonhard U, Meier M: BUILD-IT: A computer Vision-based Interaction Technique for a Planning Tool. In (Thimbleby H, O’Connaill B, Thomas P eds.) People and Computers XII, Proc. of HCI’97, Springer, 1997, pp. 303–314.
Rauterberg M, Steiger P: Pattern recognition as a key technology for the next generation of user interfaces. In Proc. of IEEE International Conference on Systems, Man and Cybernetics—SMC’96 (Vol. 4, IEEE Catalogue Number: 96CH35929, pp. 2805–2810). Piscataway: IEEE.
Rotenstreich N: Reflection and Action. Martinus Nijhoff Publishers, 1985, p. 62.
Sanders M, McCormick E: Human Factors in Engineering and Design. McGraw Hill, 1993, p. 277.
Shneiderman B: Designing the User Interface. Addison-Wesley, Reading MA, 1987.
Tognazzini B: Tog on Software Design. Addison-Wesley, Reading MA, 1996.
Watts L, Monk A: Remote assistance: a view of the work and a view of the face?. In Proc. of the CHI’96 Companion, 1996, pp. 101–102.
Wellner P, Mackay W, Gold R: Computer-Augmented Environments: Back to the Real World. Communications of the ACM, 36(7), 1993, pp. 24–26.
Whittaker S: Rethinking video as a technology for interpersonal communications: theory and design implications. Intern. Journal of Human-Computer Studies, 42, 1995, pp. 501–529.
Winograd T, Flores C F: Understanding computers and cognition: a new foundation for design. Ablex publishing corporation, 1986, p. 97.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag
About this paper
Cite this paper
Fjeld, M., Bichsel, M., Rauterberg, M. (1998). BUILD-IT: An intuitive design tool based on direct object manipulation. In: Wachsmuth, I., Fröhlich, M. (eds) Gesture and Sign Language in Human-Computer Interaction. GW 1997. Lecture Notes in Computer Science, vol 1371. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0053008
Download citation
DOI: https://doi.org/10.1007/BFb0053008
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64424-8
Online ISBN: 978-3-540-69782-4
eBook Packages: Springer Book Archive