Skip to main content
Log in

Robust Nonlinear Autoregressive Moving Average Model Parameter Estimation Using Stochastic Recurrent Artificial Neural Networks

  • Published:
Annals of Biomedical Engineering Aims and scope Submit manuscript

Abstract

In this study, we introduce a new approach for estimating linear and nonlinear stochastic autoregressive moving average (ARMA) model parameters, given a corrupt signal, using artificial recurrent neural networks. This new approach is a two-step approach in which the parameters of the deterministic part of the stochastic ARMA model are first estimated via a three-layer artificial neural network (deterministic estimation step) and then reestimated using the prediction error as one of the inputs to the artificial neural networks in an iterative algorithm (stochastic estimation step). The prediction error is obtained by subtracting the corrupt signal of the estimated ARMA model obtained via the deterministic estimation step from the system output response. We present computer simulation examples to show the efficacy of the proposed stochastic recurrent neural network approach in obtaining accurate model predictions. Furthermore, we compare the performance of the new approach to that of the deterministic recurrent neural network approach. Using this simple two-step procedure, we obtain more robust model predictions than with the deterministic recurrent neural network approach despite the presence of significant amounts of either dynamic or measurement noise in the output signal. The comparison between the deterministic and stochastic recurrent neural network approaches is furthered by applying both approaches to experimentally obtained renal blood pressure and flow signals. © 1999 Biomedical Engineering Society.

PAC99: 8710+e, 8719Uv, 0705Mh

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

REFERENCES

  1. Bishop, C. M. Neural Networks for Pattern Recognition. New York, NY: Oxford University Press, 1995.

    Google Scholar 

  2. Chen, S., C. F. N. Cowan, and P. M. Grant. Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans. Neural Netw. 2:302–309, 1991.

    Google Scholar 

  3. Chon, K. H., and R. J. Cohen. Linear and nonlinear ARMA model parameter estimation using an artificial neural network. IEEE Trans. Biomed. Eng. 44:168–174, 1997.

    Google Scholar 

  4. Chon, K. H., Y. M. Chen, N. H. Holstein-Rathlou, D. J. Marsh, and V. Z. Marmarelis. On the efficacy of linear system analysis of renal autoregulation in rats. IEEE Trans. Biomed. Eng. 40:8–20, 1993.

    Google Scholar 

  5. Chon, K. H., R. J. Cohen, and N. H. Holstein-Rathlou. Compact and accurate linear and nonlinear autoregressive moving average model parameter estimation using Laguerre functions. Ann. Biomed. Eng. 25:731–738, 1997.

    Google Scholar 

  6. Chon, K. H., M. J. Korenberg, and N. H. Holstein-Rathlou. Application of fast orthogonal search to linear and nonlinear stochastic systems. Ann. Biomed. Eng. 25:793–801, 1997.

    Google Scholar 

  7. Chon, K. H., N. H. Holstein-Rathlou, D. J. Marsh, and V. Z. Marmarelis. Comparative nonlinear modeling of renal autoregulation in rats: Volterra approach versus artificial neural networks. IEEE Trans. Neural Netw. 9:430–435, 1998.

    Google Scholar 

  8. Goodwin, G. C., and R. L. Payne. Dynamic System Identification: Experimental Design and Data Analysis. New York, NY: Academic, 1977.

    Google Scholar 

  9. Hassoun, M. H. Fundamentals of Artificial Neural Networks. Cambridge, MA: MIT Press, 1995.

    Google Scholar 

  10. Korenberg, M. J., S. A. Billings, Y. P. Li, and P. J. McIlroy. Orthogonal parameter estimation algorithm for non-linear stochastic systems. Int. J. Control 48:193–210, 1988.

    Google Scholar 

  11. Korenberg, M. J. A robust orthogonal algorithm for system identification and time series analysis. Biol. Cybern. 60:267–276, 1989.

    Google Scholar 

  12. Marmarelis, V. Z. Identification of nonlinear biological systems using Laguerre expansion of kernels. Ann. Biomed. Eng. 21:573–589, 1993.

    Google Scholar 

  13. Marmarelis, P. Z., and V. Z. Marmarelis. Analysis of Physiological Systems: The White Noise Approach. New York, NY: Plenum, 1978.

    Google Scholar 

  14. Marmarelis, V. Z., and X. Zhao. Volterra models and three-layer perceptrons. IEEE Trans. Neural Netw. 8:1421–1433, 1997.

    Google Scholar 

  15. Ripley, B. D. Pattern Recognition and Neural Networks. New York, NY: Cambridge University Press, 1996.

    Google Scholar 

  16. Rumelhart, D. E., and J. L. McClelland, Eds. Parallel Distributed Processing. Cambridge, MA: MIT Press, 1986, Vols. I and II.

    Google Scholar 

  17. Wray, J., and G. G. R. Green. Calculation of the Volterra kernels of nonlinear dynamic systems using an artificial neural network. Biol. Cybern. 71:187–195, 1994.

    Google Scholar 

  18. Zhu, Q., and S. A. Billings. Fast orthogonal identification of nonlinear stochastic model and radial basis function neural networks. Int. J. Control 64:871–886, 1996.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chon, K.H., Hoyer, D., Armoundas, A.A. et al. Robust Nonlinear Autoregressive Moving Average Model Parameter Estimation Using Stochastic Recurrent Artificial Neural Networks. Annals of Biomedical Engineering 27, 538–547 (1999). https://doi.org/10.1114/1.197

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1114/1.197

Navigation