Abstract
In this study, we introduce a new approach for estimating linear and nonlinear stochastic autoregressive moving average (ARMA) model parameters, given a corrupt signal, using artificial recurrent neural networks. This new approach is a two-step approach in which the parameters of the deterministic part of the stochastic ARMA model are first estimated via a three-layer artificial neural network (deterministic estimation step) and then reestimated using the prediction error as one of the inputs to the artificial neural networks in an iterative algorithm (stochastic estimation step). The prediction error is obtained by subtracting the corrupt signal of the estimated ARMA model obtained via the deterministic estimation step from the system output response. We present computer simulation examples to show the efficacy of the proposed stochastic recurrent neural network approach in obtaining accurate model predictions. Furthermore, we compare the performance of the new approach to that of the deterministic recurrent neural network approach. Using this simple two-step procedure, we obtain more robust model predictions than with the deterministic recurrent neural network approach despite the presence of significant amounts of either dynamic or measurement noise in the output signal. The comparison between the deterministic and stochastic recurrent neural network approaches is furthered by applying both approaches to experimentally obtained renal blood pressure and flow signals. © 1999 Biomedical Engineering Society.
PAC99: 8710+e, 8719Uv, 0705Mh
Similar content being viewed by others
REFERENCES
Bishop, C. M. Neural Networks for Pattern Recognition. New York, NY: Oxford University Press, 1995.
Chen, S., C. F. N. Cowan, and P. M. Grant. Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans. Neural Netw. 2:302–309, 1991.
Chon, K. H., and R. J. Cohen. Linear and nonlinear ARMA model parameter estimation using an artificial neural network. IEEE Trans. Biomed. Eng. 44:168–174, 1997.
Chon, K. H., Y. M. Chen, N. H. Holstein-Rathlou, D. J. Marsh, and V. Z. Marmarelis. On the efficacy of linear system analysis of renal autoregulation in rats. IEEE Trans. Biomed. Eng. 40:8–20, 1993.
Chon, K. H., R. J. Cohen, and N. H. Holstein-Rathlou. Compact and accurate linear and nonlinear autoregressive moving average model parameter estimation using Laguerre functions. Ann. Biomed. Eng. 25:731–738, 1997.
Chon, K. H., M. J. Korenberg, and N. H. Holstein-Rathlou. Application of fast orthogonal search to linear and nonlinear stochastic systems. Ann. Biomed. Eng. 25:793–801, 1997.
Chon, K. H., N. H. Holstein-Rathlou, D. J. Marsh, and V. Z. Marmarelis. Comparative nonlinear modeling of renal autoregulation in rats: Volterra approach versus artificial neural networks. IEEE Trans. Neural Netw. 9:430–435, 1998.
Goodwin, G. C., and R. L. Payne. Dynamic System Identification: Experimental Design and Data Analysis. New York, NY: Academic, 1977.
Hassoun, M. H. Fundamentals of Artificial Neural Networks. Cambridge, MA: MIT Press, 1995.
Korenberg, M. J., S. A. Billings, Y. P. Li, and P. J. McIlroy. Orthogonal parameter estimation algorithm for non-linear stochastic systems. Int. J. Control 48:193–210, 1988.
Korenberg, M. J. A robust orthogonal algorithm for system identification and time series analysis. Biol. Cybern. 60:267–276, 1989.
Marmarelis, V. Z. Identification of nonlinear biological systems using Laguerre expansion of kernels. Ann. Biomed. Eng. 21:573–589, 1993.
Marmarelis, P. Z., and V. Z. Marmarelis. Analysis of Physiological Systems: The White Noise Approach. New York, NY: Plenum, 1978.
Marmarelis, V. Z., and X. Zhao. Volterra models and three-layer perceptrons. IEEE Trans. Neural Netw. 8:1421–1433, 1997.
Ripley, B. D. Pattern Recognition and Neural Networks. New York, NY: Cambridge University Press, 1996.
Rumelhart, D. E., and J. L. McClelland, Eds. Parallel Distributed Processing. Cambridge, MA: MIT Press, 1986, Vols. I and II.
Wray, J., and G. G. R. Green. Calculation of the Volterra kernels of nonlinear dynamic systems using an artificial neural network. Biol. Cybern. 71:187–195, 1994.
Zhu, Q., and S. A. Billings. Fast orthogonal identification of nonlinear stochastic model and radial basis function neural networks. Int. J. Control 64:871–886, 1996.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Chon, K.H., Hoyer, D., Armoundas, A.A. et al. Robust Nonlinear Autoregressive Moving Average Model Parameter Estimation Using Stochastic Recurrent Artificial Neural Networks. Annals of Biomedical Engineering 27, 538–547 (1999). https://doi.org/10.1114/1.197
Issue Date:
DOI: https://doi.org/10.1114/1.197