Abstract
Stochastic behavior is a natural and inevitable property of biological neurons. The effect of stochastic behavior or thermal fluctuation in neural firings on the learning process in a neural system is investigated. A learning model, which is derived from the stochastic differential equation of the firing-rate model, is presented as an estimate of the gradient flow of free energy. The model reveals that the learning process becomes competitive owing to the effect of entropy even through the synapse modifications only follow the simple Hebbian rule.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
D. O. Hebb, The organization of behavior: A neurophysiological theory (John Wiley and Sons, New York, 1949).
E. Oja, J. Math. Bio. 53, 267 (1982).
E. L. Bienenstock, L. N. Cooper and P. W. Munro, J. Neurosci. 2, 32 (1982).
H. Markram, J. Lübke, M. Frotscher, and B. Sakmann, Science 275, 213 (1997).
G.-q. Bi and M.-m. Poo, J. Neurosci 18, 10464 (1998).
L. F. Abbott and S. B. Nelson, Nat. Neurosci 3, 1173 (2000).
S. Song and L. F. Abbott, Neuron 32, 339 (2001).
M. W. Cho and M. Y. Choi, Europhys. Lett 95, 58005 (2011).
D. H. Ackley, G. Hinton and T. Sejnowski, Cognitive Science 9, 147 (1985).
C. Peipenbrock, in Probabilistic Models of the Brain, edited by R. P. N. Rao, B. A. Olshausen and M. S. Lewicki (The MIT Press, Cambridge MA, 2002), p. 181.
B. A. Olshausen and D. J. Field, Nature 381, 607 (1996).
P. Dayan and L. Fl. Abbott, Theoretical neuroscience (The MIT Press, London, 2001).
H. Kleinert, Gauge Fields in Condensed Matter (World Scientific, Singapore, 1989).
A. J. Bell and T. J. Sejnowski, Neural Comput 7, 1004 (1995).
T.-W. Lee, Independent component analysis (Kluwer Academic Publishers, Boston, 1998).
M. W. Cho and M. Y. Choi, Neural Networks 31, 46 (2012).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Cho, M.W. Competitive learning behavior in a stochastic neural network. Journal of the Korean Physical Society 67, 1679–1685 (2015). https://doi.org/10.3938/jkps.67.1679
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3938/jkps.67.1679