Abstract
Empowerment is a promising concept to begin explaining how some biological organisms may assign a priori value expectations to states in taskless scenarios. Standard empowerment samples the full richness of an environment and assumes it can be fully explored. This may be too aggressive an assumption; here we explore impoverished versions achieved by limiting the bandwidth of the empowerment generating action sequences. It turns out that limited richness of actions concentrate on the “most important” ones with the additional benefit that the empowerment horizon can be extended drastically into the future. This indicates a path towards and intrinsic preselection for preferred behaviour sequences and helps to suggest more biologically plausible approaches.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Atick, J.J.: Could information theory provide an ecological theory of sensory processing. Network: Computation in Neural Systems 3(2), 213–251 (1992)
Attneave, F.: Some informational aspects of visual perception. Psychological Review 61(3), 183–193 (1954)
Ay, N., Bertschinger, N., Der, R., Guettler, F., Olbrich, E.: Predictive information and explorative behavior of autonomous robots. European Physical Journal B (2008) (accepted)
Barlow, H.B.: Possible principles underlying the transformations of sensory messages. In: Rosenblith, W.A. (ed.) Sensory Communication: Contributions to the Symposium on Principles of Sensory Communication, pp. 217–234. The M.I.T. Press, Cambridge (1959)
Barlow, H.B.: Redundancy reduction revisited. Network: Computation in Neural Systems 12(3), 241–253 (2001)
Bialek, W., Nemenman, I., Tishby, N.: Predictability, complexity, and learning. Neural Comp. 13(11), 2409–2463 (2001)
Blahut, R.: Computation of channel capacity and rate distortion functions. IEEE Transactions on Information Theory 18(4), 460–473 (1972)
Klyubin, A.S., Polani, D., Nehaniv, C.L.: Organization of the information flow in the perception-action loop of evolved agents. In: Zebulum, R.S., Gwaltney, D., Hornby, G., Keymeulen, D., Lohn, J., Stoica, A. (eds.) Proceedings of 2004 NASA/DoD Conference on Evolvable Hardware, pp. 177–180. IEEE Computer Society Press, Los Alamitos (2004)
Klyubin, A.S., Polani, D., Nehaniv, C.L.: All else being equal be empowered. In: Capcarrère, M.S., Freitas, A.A., Bentley, P.J., Johnson, C.G., Timmis, J. (eds.) ECAL 2005. LNCS (LNAI), vol. 3630, pp. 744–753. Springer, Heidelberg (2005a)
Klyubin, A.S., Polani, D., Nehaniv, C.L.: Empowerment: A universal agent-centric measure of control. In: Proceedings of the 2005 IEEE Congress on Evolutionary Computation, vol. 1, pp. 128–135. IEEE Press, Los Alamitos (2005b)
Prokopenko, M., Gerasimov, V., Tanev, I.: Evolving spatiotemporal coordination in a modular robotic system. In: Nolfi, S., Baldassarre, G., Calabretta, R., Hallam, J., Marocco, D., Meyer, J.-A., Parisi, D. (eds.) SAB 2006. LNCS (LNAI), vol. 4095, pp. 558–569. Springer, Heidelberg (2006)
Shannon, C.E.: A mathematical theory of communication. Bell System Technical Journal 27, 379–423 (1948)
Tishby, N., Pereira, F., Bialek, W.: The information bottleneck method. In: Proceedings of the 37th Annual Allerton Conference on Communication, Control and Computing, pp. 368–377 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Anthony, T., Polani, D., Nehaniv, C.L. (2011). Impoverished Empowerment: ‘Meaningful’ Action Sequence Generation through Bandwidth Limitation. In: Kampis, G., Karsai, I., Szathmáry, E. (eds) Advances in Artificial Life. Darwin Meets von Neumann. ECAL 2009. Lecture Notes in Computer Science(), vol 5778. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21314-4_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-21314-4_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21313-7
Online ISBN: 978-3-642-21314-4
eBook Packages: Computer ScienceComputer Science (R0)