Skip to main content
Erschienen in:

27.12.2023

On the NP-VSS-NLMS Algorithm: Model, Design Guidelines, and Numerical Results

verfasst von: Augusto Cesar Becker, Eduardo Vinicius Kuhn, Marcos Vinicius Matsuo, Jacob Benesty

Erschienen in: Circuits, Systems, and Signal Processing | Ausgabe 4/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, a stochastic model is presented for the nonparametric variable step-size normalized least-mean-square (NP-VSS-NLMS) algorithm. This algorithm has demonstrated potential in practical applications and hence a deeper understanding of its behavior becomes crucial. In this context, model expressions are obtained for characterizing the algorithm behavior in the transient phase as well as in the steady state, considering a system identification problem and Gaussian input data. Such expressions reveal interesting algorithm characteristics that are useful for establishing design guidelines and for the advancement of more refined algorithms. Simulation results for various operating scenarios ratified both the model’s accuracy and the algorithm’s superior performance relative to other recent and relevant algorithms from the literature.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

ATZelektronik

Die Fachzeitschrift ATZelektronik bietet für Entwickler und Entscheider in der Automobil- und Zulieferindustrie qualitativ hochwertige und fundierte Informationen aus dem gesamten Spektrum der Pkw- und Nutzfahrzeug-Elektronik. 

Lassen Sie sich jetzt unverbindlich 2 kostenlose Ausgabe zusenden.

ATZelectronics worldwide

ATZlectronics worldwide is up-to-speed on new trends and developments in automotive electronics on a scientific level with a high depth of information. 

Order your 30-days-trial for free and without any commitment.

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat M.S.E. Abadi, J.H. Husøy, On the application of a unified adaptive filter theory in the performance prediction of adaptive filter algorithms. Digit. Signal Process. 19(3), 410–432 (2009)CrossRef M.S.E. Abadi, J.H. Husøy, On the application of a unified adaptive filter theory in the performance prediction of adaptive filter algorithms. Digit. Signal Process. 19(3), 410–432 (2009)CrossRef
2.
Zurück zum Zitat T. Aboulnasr, K. Mayyas, A robust variable step-size LMS-type algorithm: analysis and simulations. IEEE Trans. Signal Process. 45(3), 631–639 (1997)ADSCrossRef T. Aboulnasr, K. Mayyas, A robust variable step-size LMS-type algorithm: analysis and simulations. IEEE Trans. Signal Process. 45(3), 631–639 (1997)ADSCrossRef
3.
Zurück zum Zitat A.E. Albert, L.S. Gardner Jr., Stochastic Approximation and Nonlinear Regression, 1st edn. (MIT Press, Cambridge, MA, 1967) A.E. Albert, L.S. Gardner Jr., Stochastic Approximation and Nonlinear Regression, 1st edn. (MIT Press, Cambridge, MA, 1967)
4.
Zurück zum Zitat K.J. Aström, B. Wittenmark, Adaptive Control, 2nd edn. (Dover Publications, Mineola, NY, 2008) K.J. Aström, B. Wittenmark, Adaptive Control, 2nd edn. (Dover Publications, Mineola, NY, 2008)
5.
Zurück zum Zitat K.J. Bakri, E.V. Kuhn, R. Seara, J. Benesty, C. Paleologu, S. Ciochină, On the stochastic modeling of the LMS algorithm operating with bilinear forms. Digit. Signal Process. 122, 103359 (2022)CrossRef K.J. Bakri, E.V. Kuhn, R. Seara, J. Benesty, C. Paleologu, S. Ciochină, On the stochastic modeling of the LMS algorithm operating with bilinear forms. Digit. Signal Process. 122, 103359 (2022)CrossRef
6.
Zurück zum Zitat J. Benesty, I. Cohen, J. Chen, Array Processing-Kronecker Product Beamforming (Springer, Cham, 2019)CrossRef J. Benesty, I. Cohen, J. Chen, Array Processing-Kronecker Product Beamforming (Springer, Cham, 2019)CrossRef
7.
Zurück zum Zitat J. Benesty, T. Gänsler, D.R. Morgan, M.M. Sondhi, S.L. Gay, Advances in Network and Acoustic Echo Cancellation (Springer, Berlin, 2001)CrossRef J. Benesty, T. Gänsler, D.R. Morgan, M.M. Sondhi, S.L. Gay, Advances in Network and Acoustic Echo Cancellation (Springer, Berlin, 2001)CrossRef
8.
Zurück zum Zitat J. Benesty, C. Paleologu, S. Ciochină, E.V. Kuhn, K.J. Bakri, R. Seara, LMS and NLMS algorithms for the identification of impulse responses with intrinsic symmetric or antisymmetric properties. In Proceedings of the IEEE International Conference on Acoustic, Speech, Signal Process (ICASSP), pp. 5662–5666, Singapore, Singapore, May (2022) J. Benesty, C. Paleologu, S. Ciochină, E.V. Kuhn, K.J. Bakri, R. Seara, LMS and NLMS algorithms for the identification of impulse responses with intrinsic symmetric or antisymmetric properties. In Proceedings of the IEEE International Conference on Acoustic, Speech, Signal Process (ICASSP), pp. 5662–5666, Singapore, Singapore, May (2022)
9.
Zurück zum Zitat J. Benesty, H. Rey, L.R. Vega, S. Tressens, A nonparametric VSS-NLMS algorithm. IEEE Signal Process. Lett. 13, 581–584 (2006)ADSCrossRef J. Benesty, H. Rey, L.R. Vega, S. Tressens, A nonparametric VSS-NLMS algorithm. IEEE Signal Process. Lett. 13, 581–584 (2006)ADSCrossRef
10.
Zurück zum Zitat D. Bismor, K. Czyz, Z. Ogonowski, Review and comparison of variable step-size LMS algorithms. Int. J. Acoust. Vib. 21(1), 24–39 (2016) D. Bismor, K. Czyz, Z. Ogonowski, Review and comparison of variable step-size LMS algorithms. Int. J. Acoust. Vib. 21(1), 24–39 (2016)
11.
Zurück zum Zitat S. Ciochina, C. Paleologu, J. Benesty, An optimized NLMS algorithm for system identification. Signal Process. 118, 115–121 (2016)CrossRef S. Ciochina, C. Paleologu, J. Benesty, An optimized NLMS algorithm for system identification. Signal Process. 118, 115–121 (2016)CrossRef
12.
Zurück zum Zitat M.H. Costa, J.C.M. Bermudez, An improved model for the normalized LMS algorithm with Gaussian inputs and large number of coefficients. In Proceedings of the IEEE International Conference on Acoustic, Speech, Signal Processing (ICASSP), volume 2, pp. 1385–1388, Orlando, FL, May (2002) M.H. Costa, J.C.M. Bermudez, An improved model for the normalized LMS algorithm with Gaussian inputs and large number of coefficients. In Proceedings of the IEEE International Conference on Acoustic, Speech, Signal Processing (ICASSP), volume 2, pp. 1385–1388, Orlando, FL, May (2002)
13.
Zurück zum Zitat P.S.R. Diniz, Adaptive Filtering: Algorithms and Practical Implementation, 4th edn. (Springer, New York, NY, 2013)CrossRef P.S.R. Diniz, Adaptive Filtering: Algorithms and Practical Implementation, 4th edn. (Springer, New York, NY, 2013)CrossRef
14.
Zurück zum Zitat B. Farhang-Boroujeny, Adaptive Filters: Theory and Applications, 2nd edn. (Wiley, Chichester, 2013)CrossRef B. Farhang-Boroujeny, Adaptive Filters: Theory and Applications, 2nd edn. (Wiley, Chichester, 2013)CrossRef
15.
Zurück zum Zitat S. Haykin, Adaptive Filter Theory, 5th edn. (Prentice Hall, Upper Saddle River, NJ, 2014) S. Haykin, Adaptive Filter Theory, 5th edn. (Prentice Hall, Upper Saddle River, NJ, 2014)
16.
Zurück zum Zitat M.H. Holmes, Introduction to Perturbation Methods, 2nd edn. (Springer, New York, NY, 2013)CrossRef M.H. Holmes, Introduction to Perturbation Methods, 2nd edn. (Springer, New York, NY, 2013)CrossRef
17.
Zurück zum Zitat H.-C. Huang, J. Lee, A new variable step-size NLMS algorithm and its performance analysis. IEEE Trans. Signal Process. 60(4), 2055–2060 (2012)ADSMathSciNetCrossRef H.-C. Huang, J. Lee, A new variable step-size NLMS algorithm and its performance analysis. IEEE Trans. Signal Process. 60(4), 2055–2060 (2012)ADSMathSciNetCrossRef
18.
Zurück zum Zitat ITU-T Recommendation G.168 – Digital Network Echo Cancellers. Switzerland, International Telecommunications Union - Telecommunication Standardization Sector, Geneva (2015) ITU-T Recommendation G.168 – Digital Network Echo Cancellers. Switzerland, International Telecommunications Union - Telecommunication Standardization Sector, Geneva (2015)
19.
Zurück zum Zitat A. Jeffrey, H.-H. Dai, Handbook of Mathematical Formulas and Integrals, 4th edn. (Academic Press, Burlington, MA, 2008) A. Jeffrey, H.-H. Dai, Handbook of Mathematical Formulas and Integrals, 4th edn. (Academic Press, Burlington, MA, 2008)
20.
Zurück zum Zitat S. Kaczmarz, Angenäherte auflösung von systemen linearer gleichungen. Bull. Int. Acad. Pol. Sci. Lettres A, 35(III), 355–357 (1937) S. Kaczmarz, Angenäherte auflösung von systemen linearer gleichungen. Bull. Int. Acad. Pol. Sci. Lettres A, 35(III), 355–357 (1937)
21.
Zurück zum Zitat J.E. Kolodziej, O.J. Tobias, R. Seara, D.R. Morgan, On the constrained stochastic gradient algorithm: Model, performance, and improved version. IEEE Trans. Signal Process. 57(4), 1304–1315 (2009)ADSMathSciNetCrossRef J.E. Kolodziej, O.J. Tobias, R. Seara, D.R. Morgan, On the constrained stochastic gradient algorithm: Model, performance, and improved version. IEEE Trans. Signal Process. 57(4), 1304–1315 (2009)ADSMathSciNetCrossRef
22.
Zurück zum Zitat E.V. Kuhn, J.E. Kolodziej, R. Seara, Stochastic modeling of the NLMS algorithm for complex Gaussian input data and nonstationary environment. Digit. Signal Process. 30, 55–66 (2014)MathSciNetCrossRef E.V. Kuhn, J.E. Kolodziej, R. Seara, Stochastic modeling of the NLMS algorithm for complex Gaussian input data and nonstationary environment. Digit. Signal Process. 30, 55–66 (2014)MathSciNetCrossRef
23.
Zurück zum Zitat E.V. Kuhn, J.G.F. Zipf, R. Seara, On the stochastic modeling of a VSS-NLMS algorithm with high immunity against measurement noise. Signal Process. 147, 120–132 (2018)CrossRef E.V. Kuhn, J.G.F. Zipf, R. Seara, On the stochastic modeling of a VSS-NLMS algorithm with high immunity against measurement noise. Signal Process. 147, 120–132 (2018)CrossRef
24.
Zurück zum Zitat R.H. Kwong, E.W. Johnston, A variable step size LMS algorithm. IEEE Trans. Signal Process. 40(7), 1633–1642 (1992)ADSCrossRef R.H. Kwong, E.W. Johnston, A variable step size LMS algorithm. IEEE Trans. Signal Process. 40(7), 1633–1642 (1992)ADSCrossRef
25.
Zurück zum Zitat A. Mader, H. Puder, G.U. Schmidt, Step-size control for acoustic echo cancellation filters: An overview. Signal Process. 80(9), 1697–1719 (2000)CrossRef A. Mader, H. Puder, G.U. Schmidt, Step-size control for acoustic echo cancellation filters: An overview. Signal Process. 80(9), 1697–1719 (2000)CrossRef
26.
Zurück zum Zitat M.V. Matsuo, E.V. Kuhn, R. Seara, Stochastic analysis of the NLMS algorithm for nonstationary environment and deficient length adaptive filter. Signal Process. 160, 190–201 (2019)CrossRef M.V. Matsuo, E.V. Kuhn, R. Seara, Stochastic analysis of the NLMS algorithm for nonstationary environment and deficient length adaptive filter. Signal Process. 160, 190–201 (2019)CrossRef
27.
Zurück zum Zitat M.V. Matsuo, R. Seara, On the stochastic analysis of the NLMS algorithm for white and correlated Gaussian inputs in time-varying environments. Signal Process. 128, 291–302 (2016)CrossRef M.V. Matsuo, R. Seara, On the stochastic analysis of the NLMS algorithm for white and correlated Gaussian inputs in time-varying environments. Signal Process. 128, 291–302 (2016)CrossRef
28.
Zurück zum Zitat K. Mayyas, F. Momani, An LMS adaptive algorithm with a new step-size control equation. J. Franklin Inst. 348(4), 589–605 (2011)MathSciNetCrossRef K. Mayyas, F. Momani, An LMS adaptive algorithm with a new step-size control equation. J. Franklin Inst. 348(4), 589–605 (2011)MathSciNetCrossRef
29.
Zurück zum Zitat D.R. Morgan, Comments on ‘Convergence and performance analysis of the normalized LMS algorithm with uncorrelated Gaussian data’. IEEE Trans. Inform. Theory 35(6), 1299 (1989)MathSciNetCrossRef D.R. Morgan, Comments on ‘Convergence and performance analysis of the normalized LMS algorithm with uncorrelated Gaussian data’. IEEE Trans. Inform. Theory 35(6), 1299 (1989)MathSciNetCrossRef
30.
Zurück zum Zitat J.I. Nagumo, A. Noda, A learning method for system identification. IEEE Trans. Autom. Control 12(3), 282–287 (1967)CrossRef J.I. Nagumo, A. Noda, A learning method for system identification. IEEE Trans. Autom. Control 12(3), 282–287 (1967)CrossRef
31.
Zurück zum Zitat A. Papoulis, S.U. Pillai, Probability, Random Variables, and Stochastic Processes, 4th edn. (McGraw-Hill, New York, NY, 2002) A. Papoulis, S.U. Pillai, Probability, Random Variables, and Stochastic Processes, 4th edn. (McGraw-Hill, New York, NY, 2002)
32.
Zurück zum Zitat M. Rupp, The behavior of LMS and NLMS algorithms in the presence of spherically invariant processes. IEEE Trans. Signal Process. 41(3), 1149–1160 (1993)ADSCrossRef M. Rupp, The behavior of LMS and NLMS algorithms in the presence of spherically invariant processes. IEEE Trans. Signal Process. 41(3), 1149–1160 (1993)ADSCrossRef
33.
Zurück zum Zitat M.O.B. Saeed, LMS-based variable step-size algorithms: A unified analysis approach. Arab. J. Sci. Eng. 42(7), 2809–2816 (2017)MathSciNetCrossRef M.O.B. Saeed, LMS-based variable step-size algorithms: A unified analysis approach. Arab. J. Sci. Eng. 42(7), 2809–2816 (2017)MathSciNetCrossRef
35.
Zurück zum Zitat H.-C. Shin, A.H. Sayed, W.-J. Song, Variable step-size NLMS and affine projection algorithms. IEEE Signal Process. Lett. 11(2), 132–135 (2004)ADSCrossRef H.-C. Shin, A.H. Sayed, W.-J. Song, Variable step-size NLMS and affine projection algorithms. IEEE Signal Process. Lett. 11(2), 132–135 (2004)ADSCrossRef
36.
Zurück zum Zitat C.W. Therrien, Discrete Random Signals and Statistical Signal Processing (Prentice Hall, Englewood Cliffs, NJ, 1992) C.W. Therrien, Discrete Random Signals and Statistical Signal Processing (Prentice Hall, Englewood Cliffs, NJ, 1992)
37.
Zurück zum Zitat D.G. Tiglea, R. Candido, M.T.M. Silva, A variable step size adaptive algorithm with simple parameter selection. IEEE Signal Process. Lett. 29, 1774–1778 (2022)ADSCrossRef D.G. Tiglea, R. Candido, M.T.M. Silva, A variable step size adaptive algorithm with simple parameter selection. IEEE Signal Process. Lett. 29, 1774–1778 (2022)ADSCrossRef
39.
Zurück zum Zitat W. Wang, H. Zhang, A new and effective nonparametric variable step-size normalized least-mean-square algorithm and its performance analysis. Signal Process. 210, 109060 (2023)CrossRef W. Wang, H. Zhang, A new and effective nonparametric variable step-size normalized least-mean-square algorithm and its performance analysis. Signal Process. 210, 109060 (2023)CrossRef
40.
Zurück zum Zitat B. Widrow, M.E. Hoff, Adaptive switching circuits. Proc. IRE WESCON Conv. Rec. 4, 96–104 (1960) B. Widrow, M.E. Hoff, Adaptive switching circuits. Proc. IRE WESCON Conv. Rec. 4, 96–104 (1960)
41.
Zurück zum Zitat B. Widrow, J. McCool, M. Ball, The complex LMS algorithm. Proc. IEEE 63(4), 719–720 (1975)ADSCrossRef B. Widrow, J. McCool, M. Ball, The complex LMS algorithm. Proc. IEEE 63(4), 719–720 (1975)ADSCrossRef
42.
Zurück zum Zitat S. Zhao, Z. Man, S. Khoo, H.R. Wu, Variable step-size LMS algorithm with a quotient form. Signal Process. 89(1), 67–76 (2009)CrossRef S. Zhao, Z. Man, S. Khoo, H.R. Wu, Variable step-size LMS algorithm with a quotient form. Signal Process. 89(1), 67–76 (2009)CrossRef
43.
Zurück zum Zitat J.G.F. Zipf, O.J. Tobias, R. Seara, Non-parametric VSS-NLMS algorithm with control parameter based on the error correlation. In IEEE International Telecommunication Symposium (ITS), pp. 1–5, Manaus, AM, Brazil (2010) J.G.F. Zipf, O.J. Tobias, R. Seara, Non-parametric VSS-NLMS algorithm with control parameter based on the error correlation. In IEEE International Telecommunication Symposium (ITS), pp. 1–5, Manaus, AM, Brazil (2010)
Metadaten
Titel
On the NP-VSS-NLMS Algorithm: Model, Design Guidelines, and Numerical Results
verfasst von
Augusto Cesar Becker
Eduardo Vinicius Kuhn
Marcos Vinicius Matsuo
Jacob Benesty
Publikationsdatum
27.12.2023
Verlag
Springer US
Erschienen in
Circuits, Systems, and Signal Processing / Ausgabe 4/2024
Print ISSN: 0278-081X
Elektronische ISSN: 1531-5878
DOI
https://doi.org/10.1007/s00034-023-02565-2