Abstract
Spiking neural networks (SNN) aim to mimic membrane potential dynamics of biological neurons. They have been used widely in neuromorphic applications and neuroscience modeling studies. We design a parallel SNN accelerator for producing large-scale cortical simulation targeting an off-the-shelf Field-Programmable Gate Array (FPGA)-based system. The accelerator parallelizes synaptic processing with run time proportional to the firing rate of the network. Using only one FPGA, this accelerator is estimated to support simulation of 64K neurons 2.5 times real-time, and achieves a spike delivery rate which is at least 1.4 times faster than a recent GPU accelerator with a benchmark toroidal network.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Izhikevich, E.M., Edelman, G.M.: Large-scale model of mammalian thalamocortical systems. PNAS 105, 3593–3598 (2008)
Markram, H.: The Blue Brain Project. Nat. Rev. Neurosci. 7, 153–160 (2006)
Ananthanarayanan, R., Esser, S.K., Simon, H.D., Modha, D.S.: The cat is out of the bag: cortical simulations with 109 neurons, 1013 synapses. In: Proc. Conf. High Performance Computing Networking, Storage and Analysis, pp. 1–12. ACM (2009)
Khan, M.M., Lester, D.R., Plana, L.A., Rast, A., Jin, X., Painkras, E., Furber, S.B.: SpiNNaker: Mapping Neural Networks onto a Massively-Parallel Chip Multiprocessor. In: Proc. IEEE International Joint Conference on Neural Networks (2008)
Fidjeland, A.K., Shanahan, M.P.: Accelerated simulation of spiking neural networks using GPUs. In: Proc. IEEE International Joint Conference on Neural Networks (July 2010)
Schemmel, J., Bruderle, D., Grubl, A., Hock, M., Meier, K., Millner, S.: A wafer-scale neuromorphic hardware system for large-scale neural modeling. In: Proc. IEEE Int. Conf. Circuits and Systems, pp. 1947–1950 (2010)
Cheung, K., Schultz, S.R., Leong, P.H.W.: A parallel spiking neural network simulator. In: Proc. Int’l Conf. on Field-Programmable Technology (FPT), pp. 247–254 (2009)
Izhikevich, E.M.: Simple model of spiking neurons. IEEE Transactions on Neural Networks 14(6), 1569–1572 (2003)
Mead, C.: Analog VLSI and Neural Systems. Addison-Wesley (1989)
Maguire, L.P., McGinnity, T.M., Glackin, B., Ghani, A., Belatreche, A., Harkin, J.: Challenges for large-scale implementations of spiking neural networks on FPGAs. Neurocomputing 71(1-3), 13–29 (2007)
Moore, S.W., Fox, P.J., Marsh, S.J.T., Markettos, A.T., Mujumdar, A.: Bluehive – A Field-Programable Custom Computing Machine for Extreme-Scale Real-Time Neural Network Simulation. In: FCCM, pp. 133–140 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cheung, K., Schultz, S.R., Luk, W. (2012). A Large-Scale Spiking Neural Network Accelerator for FPGA Systems. In: Villa, A.E.P., Duch, W., Érdi, P., Masulli, F., Palm, G. (eds) Artificial Neural Networks and Machine Learning – ICANN 2012. ICANN 2012. Lecture Notes in Computer Science, vol 7552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33269-2_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-33269-2_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33268-5
Online ISBN: 978-3-642-33269-2
eBook Packages: Computer ScienceComputer Science (R0)