Abstract
Much has been written regarding the merits and demerits of analog and digital techniques for the integration of neural networks. Proponents of both approaches are often scathing about alternatives, and blind to the shortcomings of their own work. In this chapter, we will attempt to give an honest account of a body of work that builds VLSI neural circuitry using digital voltage and current pulses to carry information and perform computation, in a manner similar to the biological nervous system. Although this parallel did not, and does not, form the motivation for the use of this technique, it is an interesting aspect of the work, and was in part its inspiration.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
A. F. Murray and A. V. W. Smith, “Asynchronous Arithmetic for VLSI Neural Systems,” Electronics Letters, vol. 23, no. 12, pp. 642–643, June 1987.
A. F. Murray and A. V. W. Smith, “A Novel Computational and Signalling Method for VLSI Neural Networks,” European Solid State Circuits Conference, pp. 19–22, VDE-Verlag, Berlin, 1987.
A. F. Murray and A. V. W. Smith, “Asynchronous VLSI Neural Networks using Pulse Stream Arithmetic,” IEEE Journal of Solid-State Circuits and Systems, vol. 23, no. 3, pp. 688–697, 1988.
D. Del Corso, F. Gregoretti, C. Pellegrini, and L.M. Reyneri, “An Artificial Neural Network Based on Multiplexed Pulse Streams,” Proc. ITG/IEEE Workshop on Microelectronics for Neural Networks, Dortmund (Germany)., pp. 28–39, June 1990.
A. Siggelkow, A. J. Beltman, J. A. G. Nijhuis, and L. Spaanenburg, “Pulse-Density Modulated Neural Networks on a Semi-Custom Gate Forest,” Proc ITG/IEEE Workshop on Microelectronics for Neural Networks, Dortmund (Germany)., pp. 16–27, June 1990.
J. Meador, A. Wu, and C. Cole, “Programmable Impulse Neural Circuits,” IEEE Transactions on Neural Networks, 1990. to be published
N. E1-Leithy, M. Zaghloul, and R. W. Newcomb, “Implementation of Pulse-Coded Neural Networks,” Proc. 27th Conf. on Decision and Control, pp. 334–336, 1988.
S. Ryckebusch, C. Mead, and J. Bower, “Modelling Small Oscillating Biological Networks in Analog VLSI,” Neural Information Processing Systems Conference, pp. 384–393, Morgan Kaufmann, December 1988.
P. M. Daniell, W. A. J. Waller, and D. A. Bisset, “An Implementation of Fully Analogue Sum-of-Product Neural Models,” 1st IEE Conf. on Artificial Neural Networks, pp. 52–56, 1989.
S. Grossberg, “Some Physiological and Biochemical Consequences of Psychological Postulates,” Proc. Natl. Acad. Sci. USA, vol. 60, pp. 758–765, 1968. Reprinted 1980 — American Psychological Association
J. A. Simmons, “Acoustic-Imaging Computations by Echolocating Bats: Unification of Diversely-Represented Stimulus Features into Whole Images,” Neural Information Processing Systems Conference, pp. 2–9, Morgan Kaufmann, 1989.
D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning Representations by Back-Propagating Errors,” Nature, vol. 323, pp. 533–536, 1986.
J. J. Hopfield, “Neural Networks and Physical Systems with Emergent Collective Computational Abilities,” Proc. Natl. Acad. Sci. USA, vol. 79, pp. 2554–2558, April 1982.
R. S. Sutton and A. G. Barto, “Toward a Modern Theory of Adaptive Networks: Expectation and Prediction,” Psychological Review, vol. 88, pp. 135–170, 1981.
P. E. Allen and D. R. Holberg, in CMOS Analog Circuit Design, Holt, Rinehart and Winston, New York, 1987.
A. Moopenn, T. Duong, and A. P. Thakoor, “Digital-Analog Hybrid Synapse Chips for Electronic Neural Networks,” Neural Information Processing Systems Conference, pp. 769–776, Morgan Kaufmann, 1989.
D. Del Corso and L.M. Reyneri, D. Del Corso, F. Gregoretti, C. Pellegrini, and L.M. Reyneri, “A Pulse Stream Synapse Based on a Closed Loop Register,— Proc. Third Int. Conf. on Parallel Architectures and Neural Networks, Vietri sul Mare (Italy)., May 1990.
Y. P. Tsividis and D. Anastassiou, “Switched — Capacitor Neural Networks,” Electronics Letters, vol. 23, no. 18, pp. 958–959, August 1987.
E. Vittoz, H. Oguey, M. A. Maher, O. Nys, E. Dijkstra, and M. Chevroulet, “Analog Storage of Adjustable Synaptic Weights,” Proc. ITG/IEEE Workshop on Microelectronics for Neural Networks, Dortmund (Germany)., pp. 69–79, June 1990.
A. F. Murray, M. Brownlow, A. Hamilton, II Song Han, H. M. Reekie, and L. Tarassenko, “Pulse-Firing Neural Chips for Hundreds of Neurons,” Neural Information Processing Systems (NIPS) Conference, pp. 785–792, Morgan Kaufmann, 1989.
J. P. Sage, K. Thompson, and R. S. Withers, “An Artificial Neural Network Integrated Circuit Based on MNOS/CCD Principles,” Proc. AIP Conference on Neural Networks for Computing, Snowbird, pp. 381–385, 1986.
A. V. W. Smith, “The Implementation of Neural Networks as CMOS Integrated Circuits,” PhD. Thesis (University of Edinburgh), 1988.
D. Del Corso, A. F. Murray, and L. Tarassenko, “Pulse-Stream VLSI Neural Networks — Mixing Analog and Digital Techniques,” IEEE Trans. Neural Networks, 1990. to be published
A. F. Murray, L. Tarassenko, and A. Hamilton, “Programmable Analogue Pulse-Firing Neural Networks,” Neural Information Processing Systems (NIPS) Conference, pp. 671–677, Morgan Kaufmann, 1988
P. B. Denyer and J. Mavor, “MOST Transconductance Multipliers for Array Applications,” IEE Proc. Pt. 1, vol. 128, no. 3, pp. 81–86, June 1981.
S. Han and Song B. Park, “Voltage-Controlled Linear Resistors by MOS Transistors and their Application to Active RC Filter MOS Integration,” Proc. IEEE, pp. 1655–1657, Nov., 1984.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1991 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Murray, A.F. et al. (1991). Pulsed Silicon Neural Networks - Following the Biological Leader -. In: Ramacher, U., Rückert, U. (eds) VLSI Design of Neural Networks. The Springer International Series in Engineering and Computer Science, vol 122. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-3994-0_6
Download citation
DOI: https://doi.org/10.1007/978-1-4615-3994-0_6
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-6785-7
Online ISBN: 978-1-4615-3994-0
eBook Packages: Springer Book Archive