Abstract
Several variable step-size strategies have been suggested in the literature to improve the performance of the least-mean-square (LMS) algorithm. Although they enhance performance, a major drawback is the complexity in the theoretical analysis of these algorithms. Researchers use several assumptions to find closed-form analytical solutions. This work presents a unified approach for the analysis of variable step-size LMS algorithms. The approach is then applied to several variable step-size strategies, and theoretical and simulation results are compared.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Sayed, A.H.: Fundamentals of Adaptive Filtering. Wiley, New York (2003)
Nagumo, J.; Noda, A.: A learning method for system identification. IEEE Trans. Autom. Control. 12, 282–287 (1967)
Harris, R.; Chabries, D.M.; Bishop, F.: A variable step (VS) adaptive filter algorithm. IEEE Trans. Acoust. Speech Signal Process. 34, 309–316 (1986)
Kwong, R.H.; Johnston, E.W.: A variable step-size LMS algorithm. IEEE Trans. Signal Process. 40, 1633–1642 (1992)
Mathews, V.J.; Xie, Z.: A stochastic gradient adaptive filter with gradient adaptive step size. IEEE Trans. Signal Process. 41, 2075–2087 (1993)
Aboulnasr, T.; Mayyas, K.: A robust variable step size LMS-type algorithm: analysis and simulations. IEEE Trans. Signal Process. 45, 631–639 (1997)
Gollamudi, S.; Nagaraj, S.; Kapoor, S.; Huang, Y.-F.: Set-membership filtering and a set-membership normalized LMS algorithm with an adaptive step size. IEEE Signal Process. Lett. 5, 111–114 (1998)
Pazaitis, D.I.; Constantinides, A.G.: A novel kurtosis driven variable step-size adaptive algorithm. IEEE Trans. Signal Process. 47, 864–872 (1999)
Ang, W.-P.; Farhang-Boroujeny, B.: A new class of gradient adaptive step-size LMS algorithms. IEEE Trans. Signal Process. 49, 805–810 (2001)
Wei, Y.; Gelfand, S.B.; Krogmeier, J.V.: Noise-constrained least mean squares algorithm. IEEE Trans. Signal Process. 49, 1961–1970 (2001)
Sulyman, A.I.; Zerguine, A.: Convergence and steady-state analysis of a variable step-size NLMS algorithm. Signal Process. 83, 1255–1273 (2003)
Egiazarian, K.; Kuosmanen, P.; Bilcu, R.C.: Variable step-size LMS adaptive filters for CDMA multiuser detection. In: Proceedings of TELSIKS ’03, pp. 259–264 (2003)
Shin, H.-C.; Sayed, A.H.; Song, W.-J.: Variable step-size NLMS and affine projection algorithms. IEEE Signal Process. Lett. 11, 132–135 (2004)
Benesty, J.; Rey, H.; Vega, L.R.; Tressens, S.: A nonparametric VSS NLMS algorithm. IEEE Signal Process. Lett. 13, 581–584 (2006)
Akhtar, M.T.; Abe, M.; Kawamata, M.: A new variable step size LMS algorithm-based method for improved online secondary path modeling in active noise control systems. IEEE Trans. Audio Speech Lang. Process. 14, 720–726 (2006)
Zhang, Y.; Li, N.; Chambers, J.A.; Hao, Y.: New gradient-based variable step size LMS algorithms. EURASIP J. Adv. Signal Process. 2008, 1–9 (2008)
Costa, M.H.; Bermudez, J.C.M.: A noise resilient variable step-size LMS algorithm. Signal Process. 88, 733–748 (2008)
Zhao, S.; Man, Z.; Khoo, S.; Wu, H.R.: Variable step-size LMS algorithm with a quotient form. Signal Process. 89, 67–76 (2009)
Hwang, J.-K.; Li, Y.-P.: Variable step-size LMS algorithm with a gradient-based weighted average. IEEE Signal Process. Lett. 16, 1043–1046 (2009)
Filho, A.M.A.; Pinto, E.L.; Galdino, J.F.: Simple and robust analytically derived variable step-size least mean squares algorithm for channel estimation. IET Commun. 3, 1832–1842 (2009)
Narasimhan, S.V.: New unbiased adaptive IIR filter: its robust and variable step-size versions and application to active noise control. Signal Image Video Process. 7, 197–207 (2013)
Bin Saeed, M.O.; Zerguine, A.: A variable step-size strategy for sparse system identification. In: Proceedings of SSD ’13, pp. 1–4 (2013).
Bin Saeed, M.O.; Zerguine, A.; Zummo, S.A.: A variable step-size strategy for distributed estimation over adaptive networks. EURASIP J. Adv. Signal Process. 2013, 135 (2013)
Bin Saeed, M.O.; Zerguine, A.; Zummo, S.A.: A noise-constrained algorithm for estimation over distributed networks. Int. J. Adapt. Control Signal Process. 27, 827–845 (2013)
Gil-Cacho, J.M.; Waterschoot, Tv; Moonen, M.; Jensen, S.H.: Wiener variable step size and gradient spectral variance smoothing for double-talk-robust acoustic echo cancellation and acoustic feedback cancellation. Signal Process. 104, 1–14 (2014)
Al-Naffouri, T.Y.; Moinuddin, M.: Exact performance analysis of the \(\epsilon \)-NLMS algorithm for colored circular gaussian inputs. IEEE Trans. Signal Process. 58, 5080–5090 (2010)
Al-Naffouri, T.Y.; Moinuddin, M.; Sohail, M.S.: Mean weight behavior of the NLMS algorithm for correlated gaussian inputs. IEEE Signal Process. Lett. 18, 7–10 (2011)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Saeed, M.O.B. LMS-Based Variable Step-Size Algorithms: A Unified Analysis Approach. Arab J Sci Eng 42, 2809–2816 (2017). https://doi.org/10.1007/s13369-017-2453-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13369-017-2453-y