Abstract
This paper presents a neural conditioning model for on-line learning of behaviors on mobile robots. The model is based on Grossberg's neural model of conditioning as recently implemented by Chang and Gaudiano. It attempts to tackle some of the limitations of the original model by (1) using a temporal difference of the reinforcement to drive learning, (2) adding eligibility trace mechanisms to dissociate behavior generation from learning, (3) automatically categorizing sensor readings and (4) bootstrapping the learning process through the use of unconditioned responses. Preliminary results of the model that learn simple behaviors on a mobile robot simulator are presented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Chang, C., Gaudiano, P.: Application of biological learning theories to mobile robot avoidance and approach behaviors. Journal of Complex Systems, 1(1) (1998), 79–114.
Grossberg, S.: On the dynamics of operant conditioning. Journal of Theoretical Biology, 33, (1971) 225–255.
Grossberg, S., Levine, D.: Neural dynamics of attentionally modulated Pavlovian conditioning: blocking, interstimulus interval, and secondary reinforcement. Applied Optics, 26, (1987) 5015–5030.
Grossberg, S., Schmajuk, N.A.: A neural network architecture for attentionally-modulated Pavlovian conditioning: Conditioned reinforcement, inhibition and opponent processing. Psychobiology, 15, (1987) 195–240.
Klopf, A.H.: The Hedonistic Neuron: A theory of memory, learning and intelligence. Hemisphere, Washington, D. C., (1982).
Sutton, R.S., Barto, A.G.: Toward a modern theory of adaptive networks: Expectation and prediction Psychological Review, 88, (1981) 135–170.
Sutton, R.S., Barto, A.G.: A temporal-difference model of classical conditioning In Proceedings of the Ninth Conference of the Cognitive Science Society Hillsdale, NJ. Lawrence Erlbaum Associates, (1987).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Şahin, E. (2001). Towards an On-Line Neural Conditioning Model for Mobile Robots. In: Mira, J., Prieto, A. (eds) Bio-Inspired Applications of Connectionism. IWANN 2001. Lecture Notes in Computer Science, vol 2085. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45723-2_63
Download citation
DOI: https://doi.org/10.1007/3-540-45723-2_63
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42237-2
Online ISBN: 978-3-540-45723-7
eBook Packages: Springer Book Archive