Skip to main content
Erschienen in: Journal of Computer and Systems Sciences International 6/2019

01.11.2019 | CONTROL IN STOCHASTIC SYSTEMS AND UNDER UNCERTAINTY CONDITIONS

Two-Stage Algorithm for Estimation of Nonlinear Functions of State Vector in Linear Gaussian Continuous Dynamical Systems

verfasst von: Won Choi, Il Young Song, Vladimir Shin

Erschienen in: Journal of Computer and Systems Sciences International | Ausgabe 6/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper focuses on the optimal minimum mean square error estimation of a nonlinear function of state (NFS) in linear Gaussian continuous-time stochastic systems. The NFS represents a multivariate function of state variables which carries useful information of a target system for control. The main idea of the proposed optimal estimation algorithm includes two stages: the optimal Kalman estimate of a state vector computed at the first stage is nonlinearly transformed at the second stage based on the NFS and the minimum mean square error (MMSE) criterion. Some challenging theoretical aspects of analytic calculation of the optimal MMSE estimate are solved by usage of the multivariate Gaussian integrals for the special NFS such as the Euclidean norm, maximum and absolute value. The polynomial functions are studied in detail. In this case the polynomial MMSE estimator has a simple closed form and it is easy to implement in practice. We derive effective matrix formulas for the true mean square error of the optimal and suboptimal quadratic estimators. The obtained results we demonstrate on theoretical and practical examples with different types of NFS. Comparison analysis of the optimal and suboptimal nonlinear estimators is presented. The subsequent application of the proposed estimators demonstrates their effectiveness.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat N. Davari and A. Gholami, “An asynchronous adaptive direct kalman filter algorithm to improve underwater navigation system performance,” IEEE Sens. J. 17, 1061–1068 (2017).CrossRef N. Davari and A. Gholami, “An asynchronous adaptive direct kalman filter algorithm to improve underwater navigation system performance,” IEEE Sens. J. 17, 1061–1068 (2017).CrossRef
2.
Zurück zum Zitat T. Rajaram, J. M. Reddy, and Y. Xu, “Kalman filter based detection and mitigation of subsynchronous resonance with SSSC,” IEEE Trans. Power Syst. 32, 1400–1409 (2017).CrossRef T. Rajaram, J. M. Reddy, and Y. Xu, “Kalman filter based detection and mitigation of subsynchronous resonance with SSSC,” IEEE Trans. Power Syst. 32, 1400–1409 (2017).CrossRef
3.
Zurück zum Zitat X. Deng and Z. Zhang, “Automatic multihorizons recognition for seismic data based on Kalman filter tracker,” IEEE Geosci. Remote Sensing Lett. 14, 319–323 (2017).CrossRef X. Deng and Z. Zhang, “Automatic multihorizons recognition for seismic data based on Kalman filter tracker,” IEEE Geosci. Remote Sensing Lett. 14, 319–323 (2017).CrossRef
4.
Zurück zum Zitat M. S. Grewal, A. P. Andrews, and C. G. Bartone, Global Navigation Satellite Systems, Inertial Navigation, and Integration (Wiley, NJ, 2013). M. S. Grewal, A. P. Andrews, and C. G. Bartone, Global Navigation Satellite Systems, Inertial Navigation, and Integration (Wiley, NJ, 2013).
6.
Zurück zum Zitat Y. Bar-Shalom, X. R. Li, and T. Kirubarajan, Estimation with Applications to Tracking and Navigation (Wiley, New York, 2001).CrossRef Y. Bar-Shalom, X. R. Li, and T. Kirubarajan, Estimation with Applications to Tracking and Navigation (Wiley, New York, 2001).CrossRef
7.
Zurück zum Zitat V. I. Arnold, Mathematical Methods of Classical Mechanics (Springer, New York, 1989).CrossRef V. I. Arnold, Mathematical Methods of Classical Mechanics (Springer, New York, 1989).CrossRef
8.
Zurück zum Zitat T. T. Cai and M. G. Low, “Optimal adaptive estimation of a quadratic functional,” Ann. Stat. 34, 2298–2325 (2006).MathSciNetCrossRef T. T. Cai and M. G. Low, “Optimal adaptive estimation of a quadratic functional,” Ann. Stat. 34, 2298–2325 (2006).MathSciNetCrossRef
9.
Zurück zum Zitat J. Robins, L. Li, E. Tchetgen, and A. Vaart, “Higher order infuence functions and minimax estimation of nonlinear functionals,” Prob. Stat. 2, 335–421 (2008).MATH J. Robins, L. Li, E. Tchetgen, and A. Vaart, “Higher order infuence functions and minimax estimation of nonlinear functionals,” Prob. Stat. 2, 335–421 (2008).MATH
10.
Zurück zum Zitat J. Jiao, K. Venkat, Y. Han, and T. Weissman, “Minimax estimation of functionals of discrete distributions,” IEEE Trans. Inform. Theory 61, 2835–2885 (2015).MathSciNetCrossRef J. Jiao, K. Venkat, Y. Han, and T. Weissman, “Minimax estimation of functionals of discrete distributions,” IEEE Trans. Inform. Theory 61, 2835–2885 (2015).MathSciNetCrossRef
11.
Zurück zum Zitat J. Jiao, K. Venkat, Y. Han, and T. Weissman, “Maximum likelihood estimation of functionals of discrete distributions,” IEEE Trans. Inform. Theory 63, 6774–6798 (2017).MathSciNetCrossRef J. Jiao, K. Venkat, Y. Han, and T. Weissman, “Maximum likelihood estimation of functionals of discrete distributions,” IEEE Trans. Inform. Theory 63, 6774–6798 (2017).MathSciNetCrossRef
12.
Zurück zum Zitat Y. Amemiya and W. A. Fuller, “Estimation for the nonlinear functional relationship,” Ann. Stat. 16, 147–160 (1988).MathSciNetCrossRef Y. Amemiya and W. A. Fuller, “Estimation for the nonlinear functional relationship,” Ann. Stat. 16, 147–160 (1988).MathSciNetCrossRef
13.
Zurück zum Zitat D. L. Donoho and M. Nussbaum, “Minimax quadratic estimation of a quadratic functional,” J. Complexity 6, 290–323 (1990).MathSciNetCrossRef D. L. Donoho and M. Nussbaum, “Minimax quadratic estimation of a quadratic functional,” J. Complexity 6, 290–323 (1990).MathSciNetCrossRef
14.
Zurück zum Zitat D. S. Grebenkov, “Optimal and suboptimal quadratic forms for noncentered gaussian processes,” Phys. Rev. E88, 032140 (2013).CrossRef D. S. Grebenkov, “Optimal and suboptimal quadratic forms for noncentered gaussian processes,” Phys. Rev. E88, 032140 (2013).CrossRef
15.
Zurück zum Zitat B. Laurent and P. Massart, “Adaptive estimation of a quadratic functional by model selection,” Ann. Stat. 28, 1302–1338 (2000).MathSciNetCrossRef B. Laurent and P. Massart, “Adaptive estimation of a quadratic functional by model selection,” Ann. Stat. 28, 1302–1338 (2000).MathSciNetCrossRef
16.
Zurück zum Zitat I. G. Vladimirov and I. R. Petersen, “Directly coupled observers for quantum harmonic oscillators with discounted mean square cost functionals and penalized back-action,” in Proceedings of the IEEE Conference on Norbert Wiener in the 21st Century, Melbourne, Australia,2016, pp. 78–83. I. G. Vladimirov and I. R. Petersen, “Directly coupled observers for quantum harmonic oscillators with discounted mean square cost functionals and penalized back-action,” in Proceedings of the IEEE Conference on Norbert Wiener in the 21st Century, Melbourne, Australia,2016, pp. 78–83.
17.
Zurück zum Zitat K. Sricharan, R. Raich, and A. O. Hero, “Estimation of nonlinear functionals of densities with confidence,” IEEE Trans. Inform. Theory 58, 4135–4159 (2012).MathSciNetCrossRef K. Sricharan, R. Raich, and A. O. Hero, “Estimation of nonlinear functionals of densities with confidence,” IEEE Trans. Inform. Theory 58, 4135–4159 (2012).MathSciNetCrossRef
18.
Zurück zum Zitat A. Wisler, V. Berisha, A. Spanias, and A. O. Hero, “Direct estimation of density functionals using a polynomial basis,” IEEE Trans. Signal Process. 66, 558–588 (2018).MathSciNetCrossRef A. Wisler, V. Berisha, A. Spanias, and A. O. Hero, “Direct estimation of density functionals using a polynomial basis,” IEEE Trans. Signal Process. 66, 558–588 (2018).MathSciNetCrossRef
19.
Zurück zum Zitat M. Taniguchi, “On estimation of parameters of gaussian stationary processes,” J. Appl. Prob. 16, 575–591 (1979).MathSciNetCrossRef M. Taniguchi, “On estimation of parameters of gaussian stationary processes,” J. Appl. Prob. 16, 575–591 (1979).MathSciNetCrossRef
20.
Zurück zum Zitat C. Zhao-Guo and E. J. Hanman, “The distribution of periodogram ordinates,” J. Time Ser. Anal. 1, 73–82 (1980).MathSciNetCrossRef C. Zhao-Guo and E. J. Hanman, “The distribution of periodogram ordinates,” J. Time Ser. Anal. 1, 73–82 (1980).MathSciNetCrossRef
21.
Zurück zum Zitat D. Janas and R. Sachs, “Consistency for non-linear functions of the periodogram of tapered data,” J. Time Ser. Anal. 16, 585–606 (1995).MathSciNetCrossRef D. Janas and R. Sachs, “Consistency for non-linear functions of the periodogram of tapered data,” J. Time Ser. Anal. 16, 585–606 (1995).MathSciNetCrossRef
22.
Zurück zum Zitat G. Fay, E. Moulines, and P. Soulier, “Nonlinear functionals of the periodogram,” J. Time Ser. Anal. 23, 523–553 (2002).MathSciNetCrossRef G. Fay, E. Moulines, and P. Soulier, “Nonlinear functionals of the periodogram,” J. Time Ser. Anal. 23, 523–553 (2002).MathSciNetCrossRef
23.
Zurück zum Zitat C. Noviello, G. Fornaro, P. Braca, and M. Martorella, “Fast and accurate ISAR focusing based on a doppler parameter estimation algorithm,” IEEE Geosci. Remote Sens. Lett. 14, 349–353 (2017).CrossRef C. Noviello, G. Fornaro, P. Braca, and M. Martorella, “Fast and accurate ISAR focusing based on a doppler parameter estimation algorithm,” IEEE Geosci. Remote Sens. Lett. 14, 349–353 (2017).CrossRef
24.
Zurück zum Zitat Y. Wu and P. Yang, “Minimax rates of entropy estimation on large alphabets via best polynomial approximation,” IEEE Trans. Inform. Theory 62, 3702–3720 (2016).MathSciNetCrossRef Y. Wu and P. Yang, “Minimax rates of entropy estimation on large alphabets via best polynomial approximation,” IEEE Trans. Inform. Theory 62, 3702–3720 (2016).MathSciNetCrossRef
25.
Zurück zum Zitat Y. Wu and P. Yang, “Optimal entropy estimation on large alphabets via best polynomial approximation,” in Proceedings of the IEEE International Symposium on Information Theory, Hong Kong,2015, pp. 824–828. Y. Wu and P. Yang, “Optimal entropy estimation on large alphabets via best polynomial approximation,” in Proceedings of the IEEE International Symposium on Information Theory, Hong Kong,2015, pp. 824–828.
26.
Zurück zum Zitat S. O. Haykin, Adaptive Filtering (Prentice Hall, NJ, 2013).MATH S. O. Haykin, Adaptive Filtering (Prentice Hall, NJ, 2013).MATH
27.
Zurück zum Zitat T. K. Moon and W. C. Stirling, Mathematical Methods and Algorithms for Signal Processing (Prentice Hall, NJ, 2000). T. K. Moon and W. C. Stirling, Mathematical Methods and Algorithms for Signal Processing (Prentice Hall, NJ, 2000).
28.
Zurück zum Zitat A. Coluccia, “On the expected value and higher-order moments of the euclidean norm for elliptical normal variates,” IEEE Commun. Lett. 17, 2364–2367 (2013).CrossRef A. Coluccia, “On the expected value and higher-order moments of the euclidean norm for elliptical normal variates,” IEEE Commun. Lett. 17, 2364–2367 (2013).CrossRef
29.
Zurück zum Zitat S. Nadarajah and S. Kotz, “Exact distribution of the max/Min of two gaussian random variables,” IEEE Trans. Very Large Scale Integr. Syst. 16, 210–212 (2008).CrossRef S. Nadarajah and S. Kotz, “Exact distribution of the max/Min of two gaussian random variables,” IEEE Trans. Very Large Scale Integr. Syst. 16, 210–212 (2008).CrossRef
30.
Zurück zum Zitat V. S. Pugachev and I. N. Sinitsyn, Stochastic Differential Systems. Analysis and Filtering, 2nd ed. (Nauka, Moscow, 1990) [in Russian].MATH V. S. Pugachev and I. N. Sinitsyn, Stochastic Differential Systems. Analysis and Filtering, 2nd ed. (Nauka, Moscow, 1990) [in Russian].MATH
31.
Zurück zum Zitat V. S. Pugachev, “Assessment of the state and parameters of continuous nonlinear systems,” Avtom. Telemekh., No. 6, 63–79 (1979). V. S. Pugachev, “Assessment of the state and parameters of continuous nonlinear systems,” Avtom. Telemekh., No. 6, 63–79 (1979).
32.
Zurück zum Zitat E. A. Rudenko, “Optimal structure of continuous nonlinear reduced-order Pugachev filter,” J. Comput. Syst. Sci. Int. 52, 866 (2013).MathSciNetCrossRef E. A. Rudenko, “Optimal structure of continuous nonlinear reduced-order Pugachev filter,” J. Comput. Syst. Sci. Int. 52, 866 (2013).MathSciNetCrossRef
33.
Zurück zum Zitat S. J. Julier and J. K. Uhlmann, “Unscented filtering and nonlinear estimation,” Proc. IEEE 92, 401–422 (2004).CrossRef S. J. Julier and J. K. Uhlmann, “Unscented filtering and nonlinear estimation,” Proc. IEEE 92, 401–422 (2004).CrossRef
34.
Zurück zum Zitat K. Ito and K. Xiong, “Gaussian filters for nonlinear filtering problems,” IEEE Trans. Autom. Control 45, 910–927 (2000).MathSciNetCrossRef K. Ito and K. Xiong, “Gaussian filters for nonlinear filtering problems,” IEEE Trans. Autom. Control 45, 910–927 (2000).MathSciNetCrossRef
35.
Zurück zum Zitat A. Doucet, N. D. Freitas, and N. Gordon, Sequential Monte Carlo Methods in Practice (Springer, London, 2001).CrossRef A. Doucet, N. D. Freitas, and N. Gordon, Sequential Monte Carlo Methods in Practice (Springer, London, 2001).CrossRef
36.
Zurück zum Zitat E. S. Armstrong and J. S. Tripp, “An application of multivariable design techniques to the control of the national transonic facility,” NASA Technical Paper, No. 1887 (NASA, Washington, DC, 1981), pp. 1–36. E. S. Armstrong and J. S. Tripp, “An application of multivariable design techniques to the control of the national transonic facility,” NASA Technical Paper, No. 1887 (NASA, Washington, DC, 1981), pp. 1–36.
37.
38.
Zurück zum Zitat B. Holmquist, “Expectations of products of quadratic forms in normal variables,” Stoch. Anal. Appl. 14, 149–164 (1996).MathSciNetCrossRef B. Holmquist, “Expectations of products of quadratic forms in normal variables,” Stoch. Anal. Appl. 14, 149–164 (1996).MathSciNetCrossRef
Metadaten
Titel
Two-Stage Algorithm for Estimation of Nonlinear Functions of State Vector in Linear Gaussian Continuous Dynamical Systems
verfasst von
Won Choi
Il Young Song
Vladimir Shin
Publikationsdatum
01.11.2019
Verlag
Pleiades Publishing
Erschienen in
Journal of Computer and Systems Sciences International / Ausgabe 6/2019
Print ISSN: 1064-2307
Elektronische ISSN: 1555-6530
DOI
https://doi.org/10.1134/S1064230719060169

Weitere Artikel der Ausgabe 6/2019

Journal of Computer and Systems Sciences International 6/2019 Zur Ausgabe

SYSTEMS ANALYSIS AND OPERATIONS RESEARCH

Diagnosis of Linear Systems Based on Sliding Mode Observers

Premium Partner