Abstract
In this paper we propose a lateral inhibitory spiking neural network for reward-based associative learning with correlation in spike patterns for conflicting responses. The network has random and sparse connectivity, and we introduce a lateral inhibition via an anatomical constraint and synapse reinforcement. The spiking dynamic follows the properties of Izhikevich spiking model. The learning involves association of a delayed stimulus pair to a response using reward modulated spike-time dependent plasticity (STDP). The proposed learning scheme has improved our initial work by allowing learning in a more dynamic and competitive environment.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Florian, R.V.: Reinforcement learning through modulation of spike-timing dependent synaptic plasticity. Neural Comput. 6, 1468–1502 (2007)
Izhikevich, E.M.: Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb. Cortex 17, 2443–2452 (2007)
Yusoff, N., Grüning, A.: Learning Anticipation through Priming in Spatio-temporal Neural Networks. In: Huang, T., Zeng, Z., Li, C., Leung, C.S. (eds.) ICONIP 2012, Part I. LNCS, vol. 7663, pp. 168–175. Springer, Heidelberg (2012)
Izhikevich, E.M.: Simple Model of Spiking Neurons. IEEE Trans. Neural Networks 14(6), 1569–1572 (2003)
Izhikevich, E.M.: Polychronization: Computation with Spikes. Neural Computation 18, 245–282 (2006)
Jones, E.G.: Microcolumns in the cerebral cortex. Proceedings of the National Academy of Sciences 97(10), 5019–5021 (2000)
Cutsuridis, V., Wennekers, T.: Hippocampus, microcircuits and associative memory. Neural Networks 22, 1120–1128 (2009)
Paugam-Moisy, H., Martinez, R., Bengio, S.: Delay learning and polychnization for reservoir computing. Neurocomputing 71(7-9), 1143–1158 (2008)
Botvinick, M., Braver, T., Barch, D., Carter, C., Cohen, J.: Conflict monitoring and cognitive control. Psychological Review 108(3), 624–652 (2001)
Kaplan, G.B., Sengor, N.S., Gurvit, S., Guzelis, C.: Modelling The Stroop Effect: A Connectionist Approach. Neurocomputing 70, 1414–1423 (2007)
Brunel, N., Lavigne, F.: Semantic Priming in a Cortical Network Model. Journal of Cognitive Neuroscience 21(12), 2300–2319 (2009)
Yusoff, N., Grüning, A.: Biologically Inspired Temporal Sequence Learning. Journal of Procedia Engineering 41, 319–325 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Yusoff, N., Ahmad, F.K. (2014). Spiking Neural Network with Lateral Inhibition for Reward-Based Associative Learning. In: Loo, C.K., Yap, K.S., Wong, K.W., Teoh, A., Huang, K. (eds) Neural Information Processing. ICONIP 2014. Lecture Notes in Computer Science, vol 8834. Springer, Cham. https://doi.org/10.1007/978-3-319-12637-1_41
Download citation
DOI: https://doi.org/10.1007/978-3-319-12637-1_41
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-12636-4
Online ISBN: 978-3-319-12637-1
eBook Packages: Computer ScienceComputer Science (R0)