Skip to main content

Pulsed Silicon Neural Networks - Following the Biological Leader -

  • Chapter
VLSI Design of Neural Networks

Abstract

Much has been written regarding the merits and demerits of analog and digital techniques for the integration of neural networks. Proponents of both approaches are often scathing about alternatives, and blind to the shortcomings of their own work. In this chapter, we will attempt to give an honest account of a body of work that builds VLSI neural circuitry using digital voltage and current pulses to carry information and perform computation, in a manner similar to the biological nervous system. Although this parallel did not, and does not, form the motivation for the use of this technique, it is an interesting aspect of the work, and was in part its inspiration.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. A. F. Murray and A. V. W. Smith, “Asynchronous Arithmetic for VLSI Neural Systems,” Electronics Letters, vol. 23, no. 12, pp. 642–643, June 1987.

    Article  Google Scholar 

  2. A. F. Murray and A. V. W. Smith, “A Novel Computational and Signalling Method for VLSI Neural Networks,” European Solid State Circuits Conference, pp. 19–22, VDE-Verlag, Berlin, 1987.

    Google Scholar 

  3. A. F. Murray and A. V. W. Smith, “Asynchronous VLSI Neural Networks using Pulse Stream Arithmetic,” IEEE Journal of Solid-State Circuits and Systems, vol. 23, no. 3, pp. 688–697, 1988.

    Article  Google Scholar 

  4. D. Del Corso, F. Gregoretti, C. Pellegrini, and L.M. Reyneri, “An Artificial Neural Network Based on Multiplexed Pulse Streams,” Proc. ITG/IEEE Workshop on Microelectronics for Neural Networks, Dortmund (Germany)., pp. 28–39, June 1990.

    Google Scholar 

  5. A. Siggelkow, A. J. Beltman, J. A. G. Nijhuis, and L. Spaanenburg, “Pulse-Density Modulated Neural Networks on a Semi-Custom Gate Forest,” Proc ITG/IEEE Workshop on Microelectronics for Neural Networks, Dortmund (Germany)., pp. 16–27, June 1990.

    Google Scholar 

  6. J. Meador, A. Wu, and C. Cole, “Programmable Impulse Neural Circuits,” IEEE Transactions on Neural Networks, 1990. to be published

    Google Scholar 

  7. N. E1-Leithy, M. Zaghloul, and R. W. Newcomb, “Implementation of Pulse-Coded Neural Networks,” Proc. 27th Conf. on Decision and Control, pp. 334–336, 1988.

    Google Scholar 

  8. S. Ryckebusch, C. Mead, and J. Bower, “Modelling Small Oscillating Biological Networks in Analog VLSI,” Neural Information Processing Systems Conference, pp. 384–393, Morgan Kaufmann, December 1988.

    Google Scholar 

  9. P. M. Daniell, W. A. J. Waller, and D. A. Bisset, “An Implementation of Fully Analogue Sum-of-Product Neural Models,” 1st IEE Conf. on Artificial Neural Networks, pp. 52–56, 1989.

    Google Scholar 

  10. S. Grossberg, “Some Physiological and Biochemical Consequences of Psychological Postulates,” Proc. Natl. Acad. Sci. USA, vol. 60, pp. 758–765, 1968. Reprinted 1980 — American Psychological Association

    Article  MATH  Google Scholar 

  11. J. A. Simmons, “Acoustic-Imaging Computations by Echolocating Bats: Unification of Diversely-Represented Stimulus Features into Whole Images,” Neural Information Processing Systems Conference, pp. 2–9, Morgan Kaufmann, 1989.

    Google Scholar 

  12. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning Representations by Back-Propagating Errors,” Nature, vol. 323, pp. 533–536, 1986.

    Article  Google Scholar 

  13. J. J. Hopfield, “Neural Networks and Physical Systems with Emergent Collective Computational Abilities,” Proc. Natl. Acad. Sci. USA, vol. 79, pp. 2554–2558, April 1982.

    Article  MathSciNet  Google Scholar 

  14. R. S. Sutton and A. G. Barto, “Toward a Modern Theory of Adaptive Networks: Expectation and Prediction,” Psychological Review, vol. 88, pp. 135–170, 1981.

    Article  Google Scholar 

  15. P. E. Allen and D. R. Holberg, in CMOS Analog Circuit Design, Holt, Rinehart and Winston, New York, 1987.

    Google Scholar 

  16. A. Moopenn, T. Duong, and A. P. Thakoor, “Digital-Analog Hybrid Synapse Chips for Electronic Neural Networks,” Neural Information Processing Systems Conference, pp. 769–776, Morgan Kaufmann, 1989.

    Google Scholar 

  17. D. Del Corso and L.M. Reyneri, D. Del Corso, F. Gregoretti, C. Pellegrini, and L.M. Reyneri, “A Pulse Stream Synapse Based on a Closed Loop Register,— Proc. Third Int. Conf. on Parallel Architectures and Neural Networks, Vietri sul Mare (Italy)., May 1990.

    Google Scholar 

  18. Y. P. Tsividis and D. Anastassiou, “Switched — Capacitor Neural Networks,” Electronics Letters, vol. 23, no. 18, pp. 958–959, August 1987.

    Article  Google Scholar 

  19. E. Vittoz, H. Oguey, M. A. Maher, O. Nys, E. Dijkstra, and M. Chevroulet, “Analog Storage of Adjustable Synaptic Weights,” Proc. ITG/IEEE Workshop on Microelectronics for Neural Networks, Dortmund (Germany)., pp. 69–79, June 1990.

    Google Scholar 

  20. A. F. Murray, M. Brownlow, A. Hamilton, II Song Han, H. M. Reekie, and L. Tarassenko, “Pulse-Firing Neural Chips for Hundreds of Neurons,” Neural Information Processing Systems (NIPS) Conference, pp. 785–792, Morgan Kaufmann, 1989.

    Google Scholar 

  21. J. P. Sage, K. Thompson, and R. S. Withers, “An Artificial Neural Network Integrated Circuit Based on MNOS/CCD Principles,” Proc. AIP Conference on Neural Networks for Computing, Snowbird, pp. 381–385, 1986.

    Google Scholar 

  22. A. V. W. Smith, “The Implementation of Neural Networks as CMOS Integrated Circuits,” PhD. Thesis (University of Edinburgh), 1988.

    Google Scholar 

  23. D. Del Corso, A. F. Murray, and L. Tarassenko, “Pulse-Stream VLSI Neural Networks — Mixing Analog and Digital Techniques,” IEEE Trans. Neural Networks, 1990. to be published

    Google Scholar 

  24. A. F. Murray, L. Tarassenko, and A. Hamilton, “Programmable Analogue Pulse-Firing Neural Networks,” Neural Information Processing Systems (NIPS) Conference, pp. 671–677, Morgan Kaufmann, 1988

    Google Scholar 

  25. P. B. Denyer and J. Mavor, “MOST Transconductance Multipliers for Array Applications,” IEE Proc. Pt. 1, vol. 128, no. 3, pp. 81–86, June 1981.

    Google Scholar 

  26. S. Han and Song B. Park, “Voltage-Controlled Linear Resistors by MOS Transistors and their Application to Active RC Filter MOS Integration,” Proc. IEEE, pp. 1655–1657, Nov., 1984.

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1991 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Murray, A.F. et al. (1991). Pulsed Silicon Neural Networks - Following the Biological Leader -. In: Ramacher, U., Rückert, U. (eds) VLSI Design of Neural Networks. The Springer International Series in Engineering and Computer Science, vol 122. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-3994-0_6

Download citation

  • DOI: https://doi.org/10.1007/978-1-4615-3994-0_6

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-6785-7

  • Online ISBN: 978-1-4615-3994-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics