Skip to main content

Stochastic Approximation with Smoothing for Optimization of an Adaptive Recursive Filter

  • Chapter
State of the Art in Global Optimization

Part of the book series: Nonconvex Optimization and Its Applications ((NOIA,volume 7))

  • 678 Accesses

Abstract

A major concern of adaptive IIR filter is that with the objective function being non- convex, currently used gradient methods have a tendency to converge to the local minimum. The stochastic approximation with convolution smoothing represents a simple approach for deriving a global optimization algorithm for adaptive filtering. This stochastic approximation method has been derived for adaptive system identification. Optimization is based on minimizing the mean square error objective function. The mean square error is a function of time series data that is statistically varying. An experimental result demonstrates the viability of using stochastic approximation for adaptive filtering.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. P.M. Pardalos and R. Horst, (1995).Introduction to Global Optimization, Kluwer Academic Publishers.

    MATH  Google Scholar 

  2. J. J. Shynk, (1989) “Adaptive IIR filtering,”IEEE ASSP Magazine, pp. 4–21.

    Google Scholar 

  3. M. A. Styblinski and T. S. Tang, (1990). “Experimentsin nonconvex optimization: Stochastic approximation with function smoothing and simulated annealing,”Neural Networks, vol. 3, pp. 467–483.

    Article  Google Scholar 

  4. B. Widrow and S. Stearns, (1985).Adaptive Signal Processing, Prentice-Hall, Inc.

    MATH  Google Scholar 

  5. L. Ljung, (1987).System Identification, Prentice-Hall, Inc.

    MATH  Google Scholar 

  6. S. Haykin, (1991).Adaptive Filter Theory, 2nd Edition, Prentice-Hall, Inc.

    MATH  Google Scholar 

  7. H. Robins and S. Monro, (1951). “A stochastic approximation method.”Annals of Mathematical Statistics, vol. 22, pp. 400–407.

    Article  MathSciNet  Google Scholar 

  8. M. A. Styblinski and L. J. Opalski, (1984). “A random perturbation method for IC yield optimization with deterministic process parameters.”Proceedings of the International Symposium on Circuits and Systems, pp. 977–980, Montreal, Canada, May 7–10.

    Google Scholar 

  9. T.S. Tang and M.A. Styblinski, (1988). “Yield optimization for non-differentiable density functions using convolution techniques.”IEEE Transactions on CAD of IC and Systems, vol. 7, no. 10, pp. 1053–1067.

    Google Scholar 

  10. S. Kirkpatrick, C.D. Gelatt, and M.P. Vecchi, (1983). “Optimization by simulated annealing”,Science, vol. 220, pp. 671–680.

    Article  MathSciNet  Google Scholar 

  11. R.Y. Rubinstein, (1981).Simulation and the Monte Carlo Method. John Wiley.

    Book  MATH  Google Scholar 

  12. D.G. Luenberger, (1984).Linear and Nonlinear Programming, 2nd Edition. Addison-Wesley Publishing.

    MATH  Google Scholar 

  13. H. Fan and W.K. Jenkins, (1986), “A new Adaptive IIR filter.”IEEE Transactions on Circuits and Systems, vol. CAS-33, NO. 10, pp. 939–947.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Kluwer Academic Publishers

About this chapter

Cite this chapter

Edmonson, W., Srinivasan, K., Wang, C., Principe, J. (1996). Stochastic Approximation with Smoothing for Optimization of an Adaptive Recursive Filter. In: Floudas, C.A., Pardalos, P.M. (eds) State of the Art in Global Optimization. Nonconvex Optimization and Its Applications, vol 7. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-3437-8_16

Download citation

  • DOI: https://doi.org/10.1007/978-1-4613-3437-8_16

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-3439-2

  • Online ISBN: 978-1-4613-3437-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics