Abstract
This interactive installation paper describes [self.], an open source art installation where the people interacting with it determine its auditory and visual vocabulary. When the system starts, it knows nothing since the authors have decided that it should be without any kind of bias. However, the robot is equipped with the ability to learn and be creative with what it has internalized. In order to achieve this behaviour, biologically inspired models are implemented. The robot itself is made up of a moving head, mounted with a camera, projector, microphone and speaker. As an art installation, it has a clear robotic visual appearance, although it is designed to demonstrate life-like behaviour. This is done by making the system start in a “tabula rasa” state, forming categories and concepts as it learns through interaction. This is achieved by linking sounds, faces, video and their corresponding temporal information to form novel sentences. The robot also projects an association between sound and image; this is achieved using neural networks. This provides a visual and immediate way of seeing how the internal representations actually learn a certain concept.
Chapter PDF
Similar content being viewed by others
References
Brandtsegg, Ø., Saue, S., Johansen, T.: Particle synthesis – a unified model for granular synthesis. In: Linux Audio Conference (2011)
Brooks, R.: A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation 2(1), 14–23 (1986)
Clark, A.: Mindware. Mindware (2001)
Cortes, C., Vapnik, V.: Support-vector networks. Machine Learning 20(3), 273–297 (1995)
Hamming, R.: Error detecting and error correcting codes. The Bell System Technical Journal 29(2), 147–160 (1950)
Holland, J.H.: Adaptation in Neural and Artificial Systems. University of Michigan Press, Ann Arbor (1975)
Jaeger, H., Haas, H.: Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication. Science 304(5667), 78–80 (2004)
Kalman, R.E.: A new approach to linear filtering and prediction problems. Journal of Fluids Engineering 82(1), 35–45 (1960)
Lyon, R.F., Rehn, M., Bengio, S., Walters, T.C., Chechik, G.: Sound retrieval and ranking using sparse auditory representations. Neural Computation 22(9), 2390–2416 (2010)
Stickgold, R., Hobson, J.A., Fosse, R., Fosse, M.: Sleep, learning, and dreams: Off-line memory reprocessing. Science 294(5544), 1052–1057 (2001)
Tidemann, A., Brandtsegg, Ø.: [self.]: an Interactive Art Installation that Embodies Artificial Intelligence and Creativity. ACM Cognition + Creativity (to appear)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Tidemann, A., Brandtsegg, Ø. (2015). [self.]: Realization / Art Installation / Artificial Intelligence: A Demonstration. In: Chorianopoulos, K., Divitini, M., Baalsrud Hauge, J., Jaccheri, L., Malaka, R. (eds) Entertainment Computing - ICEC 2015. ICEC 2015. Lecture Notes in Computer Science(), vol 9353. Springer, Cham. https://doi.org/10.1007/978-3-319-24589-8_49
Download citation
DOI: https://doi.org/10.1007/978-3-319-24589-8_49
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24588-1
Online ISBN: 978-3-319-24589-8
eBook Packages: Computer ScienceComputer Science (R0)