Top

Published in:

2018 | OriginalPaper | Chapter

1. First- and Higher-Order Continuous Time Models for Arbitrary N Using SEM

Authors : Johan H. L. Oud, Manuel C. Voelkle, Charles C. Driver

Published in: Continuous Time Modeling in the Behavioral and Related Sciences

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In this chapter we review continuous time series modeling and estimation by extended structural equation models (SEM) for single subjects and N > 1. First-order as well as higher-order models will be dealt with. Both will be handled by the general state space approach which reformulates higher-order models as first-order models. In addition to the basic model, the extensions of exogenous variables and traits (random intercepts) will be introduced. The connection between continuous time and discrete time for estimating the model by SEM will be made by the exact discrete model (EDM). It is by the EDM that the exact estimation procedure in this chapter differentiates from many approximate procedures found in the literature. The proposed analysis procedure will be applied to the well-known Wolfer sunspot data, an N = 1 time series that has been analyzed by several continuous time analysts in the past. The analysis will be carried out by ctsem, an R-package for continuous time modeling that interfaces to OpenMx, and the results will be compared to those reported in the previous studies.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

next chapter A Continuous-Time Approach to Intensive Longitudinal Data: What, Why, and How?

Available only for authorised users

In this chapter we follow the common practice to write the Wiener process by capital letter W, although it is here a vector whose size should be inferred from the context.

The adapted version uses (1.18A)

$$\displaystyle \begin{aligned} {{\text{e}}^{{\mathbf{A}}{\Delta} t}} = \mathop {\lim }\limits_{D \to \infty } \prod_{d = 0}^{D - 1} {\Big[\Big({\mathbf{I}}} - \frac{1}{2}{\mathbf{A}}{\delta _d}{\Big)^{ - 1}}\Big({\mathbf{I}} + \frac{1}{2}{\mathbf{A}}{\delta _d}\Big)\Big]{\text{ for }}{\delta _d} = \frac{{{\Delta} t}}{D},{} \end{aligned} $$

(1.18A)

which converges much more rapidly than (1.18). It is based on the approximate discrete model (ADM), described by Oud and Delsing (2010), which just as the EDM goes back to Bergstrom (1984). Computation of the matrix exponential by (1.18) or (1.18A) has the advantage over the diagonalization method (Oud and Jansen 2000) that no assumptions with regard to the eigenvalues need to be made. Currently by most authors the Padé-approximation (Higham 2009) is considered the best computation method, which therefore is implemented in the most recent version of ctsem.

A better approximation than a step function is given by a piecewise linear or polygonal approximation (Oud and Jansen 2000; Singer 1992). Then we write u(t) in (1.23) as ${\mathbf {u}}(t) = {\mathbf {u}}({t_0}) +(t - {t_0}){{\mathbf {b}}_{({t_0},t]}}$ and (1.26) becomes:

$$\displaystyle \begin{aligned} \begin{aligned} {\mathbf{x}}(t) &= {{\text{e}}^{{\mathbf{A}}(t - {t_0})}}{\mathbf{x}}({t_0}) + {{\mathbf{A}}^{ - 1}}\big[{{\text{e}}^{{\mathbf{A}}(t - {t_0})}} - {\mathbf{I}}\big]{\mathbf{Bu}}({t_0}) + \left\{ {{\mathbf{A}}^{ - 2}}\big[{{\text{e}}^{{\mathbf{A}}(t - {t_0})}} - {\mathbf{I}}\big] - {{\mathbf{A}}^{ - 1}}(t - {t_0}) \right\} {\mathbf{B}}{{\mathbf{b}}_{({t_0},t]}} \hfill \\ & \quad+ {{\mathbf{A}}^{ - 1}}\big[{{\text{e}}^{{\mathbf{A}}(t - {t_0})}} - {\mathbf{I}}\big]{\boldsymbol{\upgamma}} + \int_{{t_0}}^t {{{\text{e}}^{{\mathbf{A}}(t - s)}}} {\mathbf{G}}{\text{d}}{\mathbf{W}}(s). \hfill \\ \end{aligned}{} \end{aligned} $$

(1.26A)

The programming code of the analysis is available as supplementary material at the book website http://www.springer.com/us/book/9783319772189.

Arnold, L. (1974). Stochastic differential equations. New York: Wiley.MATH

Bergstrom, A. R. (1984). Continuous time stochastic models and issues of aggregation over time. In Z. Griliches & M. D. Intriligator (Eds.), Handbook of econometrics (Vol. 2, pp. 1145–1212). Amsterdam: North-Holland. https://doi.org/10.1016/S1573-4412(84)02012-2

Boker, S. M. (2001). Differential structural equation modeling of intraindividual variability. In L. M. Collins & A. G. Sayer (Eds.), New methods for the analysis of change (pp. 5–27). Washington, DC: American Psychological Association. https://doi.org/10.1007/s11336-010-9200-6 CrossRef

Boker, S. M., Neale, M., Maes, H., Wilde, M., Spiegel, M., Brick, T., …Fox, J. (2011). OpenMx: An open source extended structural equation modeling framework. Psychometrika, 76(2), 306–317. https://doi.org/10.1007/s11336-010-9200-6

Boker, S. M., Neale, M., & Rausch, J. (2004). Latent differential equation modeling with multivariate multi-occasion indicators. In K. van Montfort, J. H. L. Oud, & A. Satorra (Eds.), Recent developments on structural equation models (pp. 151–174). Amsterdam: Kluwer.CrossRef

Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley. https://doi.org/10.1002/9781118619179

Box, G. E. P., & Jenkins, G. M. (1970). Time serie analysis: Forecasting and control. Oakland, CA: Holden-Day.MATH

Brockwell, P. J. (2004). Representations of continuous-time ARMA processes. Journal of Applied Probability, 41(a), 375–382. https://doi.org/10.1017/s0021900200112422 MathSciNetCrossRef

Caines, P. E. (1988). Linear stochastic systems. New York: Wiley.MATH

Chan, K., & Tong, H. (1987). A note on embedding a discrete parameter ARMA model in a continuous parameter ARMA model. Journal of Time Series Analysis, 8, 277–281. https://doi.org/10.1111/j.1467-9892.1987.tb00439.x MathSciNetCrossRef

Deistler, M. (1985). General structure and parametrization of arma and state-space systems and its relation to statistical problems. In E. J. Hannan, P. R. Krishnaiah, & M. M. Rao (Eds.), Handbook of statistics: Volume 5. Time series in the time domain (pp. 257–277). Amsterdam: North Holland. https://doi.org/10.1016/s0169-7161(85)05011-8

Driver, C. C., Oud, J. H., & Voelkle, M. C. (2017). Continuous time structural equation modeling with R package ctsem. Journal of Statistical Software, 77, 1–35. https://doi.org/10.18637/jss.v077.i05 CrossRef

Durbin, J., & Koopman, S. J. (2001). Time series analysis by state space methods. Oxford: Oxford University Press. https://doi.org/10.1093/acprof:oSo/9780199641178.001.0001

Gasimova, F., Robitzsch, A., Wilhelm, O., Boker, S. M., Hu, Y., & Hülür, G. (2014). Dynamical systems analysis applied to working memory data. Frontiers in Psychology, 5, 687 (Advance online publication). https://doi.org/10.3389/fpsyg.2014.00687

Goodrich, R. L., & Caines, P. (1979). Linear system identification from nonstationary cross-sectional data. IEEE Transactions on Automatic Control, 24, 403–411. https://doi.org/10.1109/TAC.1979.1102037 MathSciNetCrossRef

Gottman, J. M. (1981). Time-series analysis: A comprehensive introduction for social scientists. Cambridge: Cambridge University Press.MATH

Hamaker, E. L., Dolan, C. V., & Molenaar, C. M. (2003). ARMA-based SEM when the number of time points T exceeds the number of cases N: Raw data maximum likelihood. Structural Equation Modeling, 10, 352–379. https://doi.org/10.1207/s15328007sem1003-2 MathSciNetCrossRef

Hamerle, A., Nagl, W., & Singer, H. (1991). Problems with the estimation of stochastic differential equations using structural equations models. Journal of Mathematical Sociology, 16(3), 201–220. https://doi.org/10.1080/0022250X.1991.9990088 CrossRef

Hannan, E. J., & Deistler, M. (1988). The statistical theory of linear systems. New York: Wiley.MATH

Hansen, L. P., & Sargent, T. J. (1983). The dimensionality of the aliasing problem. Econometrica, 51, 377–388. https://doi.org/10.2307/1911996 MathSciNetCrossRef

Harvey, A. C. (1981). Time series models. Oxford: Philip Allen.MATH

Harvey, A. C. (1989). Forecasting, structural time series models and the Kalman filter. Cambridge: Cambridge University Press.

Higham, N. J. (2009). The scaling and squaring method for the matrix exponential revisited. SIAM Review, 51, 747–764. https://doi.org/10.1137/090768539 MathSciNetCrossRef

Jones, R. H. (1993). Longitudinal data with serial correlation; a state space approach. London: Chapman & Hall. https://doi.org/10.1007/978-1-4899-4489-4

Jöreskog, K. G. (1973). A general method for estimating a linear structural equation system. In A. S. Goldberger & O. D. Duncan (Eds.), Structural equation models in the social sciences (pp. 85–112). New York: Seminar Press.

Jöreskog, K. G. (1977). Structural equation models in the social sciences: Specification, estimation and testing. In P. R. Krishnaiah (Ed.), Applications of statistics (pp. 265–287). Amsterdam: North Holland.

Jöreskog, K. G., & Sörbom, D. (1976). LISREL III: Estimation of linear structural equation systems by maximum likelihood methods: A FORTRAN IV program. Chicago: National Educational Resources.

Jöreskog, K. G., & Sörbom, D. (1996). LISREL 8: User’s reference guide. Chicago: Scientific Software International.

Kalman, R. E. (1960). A new approach to linear filtering and prediction problems. Journal of Basic Engineering, 82, 35–45 (Trans. ASME, ser. D).

Kuo, H. H. (2006). Introduction to stochastic integration. New York: Springer.MATH

Ljung, L. (1985). Estimation of parameters in dynamical systems. In E. J. Hannan, P. R. Krishnaiah, & M. M. Rao (Eds.), Handbook of statistics: Volume 5. Time series in the time domain (pp. 189–211). Amsterdam: North Holland. https://doi.org/10.1016/s0169-7161(85)05009-x

Lütkepohl, H. (1991). Introduction to multiple time series analysis. Berlin: Springer.CrossRef

McCleary, R., & Hay, R. (1980). Applied time series analysis for the social sciences. Beverly Hills: Sage.

Mills, T. C. (2012). A very British affair: Six Britons and the development of time series analysis during the 20th century. Basingstoke: Palgrave Macmillan.MATH

Neale, M. C. (1997). Mx: Statistical modeling (4th ed.). Richmond, VA: Department of Psychiatry.

Neale, M. C., Hunter, M. D., Pritikin, J. N., Zahery, M., Brick, T. R., Kirkpatrick, R. M., …Boker, S. M. (2016). OpenMx 2.0: Extended structural equation and statistical modeling. Psychometrika, 81, 535–549. https://doi.org/10.1007/s11336-014-9435-8

Oud, J. H. L. (1978). Systeem-methodologie in sociaal-wetenschappelijk onderzoek [Systems methodology in social science research]. Unpublished doctoral dissertation, Radboud University Nijmegen, Nijmegen.

Oud, J. H. L. (2007). Comparison of four procedures to estimate the damped linear differential oscillator for panel data. In K. van Montfort, J. H. L. Oud, & A. Satorra (Eds.), Longitudinal models in the behavioral and related sciences (pp. 19–39). Mahwah, NJ: Erlbaum.

Oud, J. H. L., & Delsing, M. J. M. H. (2010). Continuous time modeling of panel data by means of SEM. In K. van Montfort, J. H. L. Oud, & A. Satorra (Eds.), Longitudinal research with latent variables (pp. 201–244). New York: Springer. https://doi.org/10.1007/978-3-642-11760-2-7 CrossRef

Oud, J. H. L., & Jansen, R. A. R. G. (2000). Continuous time state space modeling of panel data by means of SEM. Psychometrika, 65, 199–215. https://doi.org/10.1007/BF02294374 MathSciNetCrossRef

Oud, J. H. L., & Singer, H. (2008). Continuous time modeling of panel data: SEM versus filter techniques. Statistica Neerlandica, 62, 4–28. https://doi.org/10.1111/j.1467-9574.2007.00376.x MathSciNetCrossRef

Oud, J. H. L., van den Bercken J. H., & Essers, R. J. (1990). Longitudinal factor score estimation using the Kalman filter. Applied Psychological Measurement, 14, 395–418. https://doi.org/10.1177/014662169001400406 CrossRef

Oud, J. H. L., & Voelkle, M. C. (2014). Do missing values exist? Incomplete data handling in cross-national longitudinal studies by means of continuous time modeling. Quality & Quantity, 48, 3271–3288. https://doi.org/10.1007/s11135-013-9955-9 CrossRef

Oud, J. H. L., Voelkle, M. C., & Driver, C. C. (2018). SEM based CARMA time series modeling for arbitrary N. Multivariate Behavioral Research, 53(1), 36–56. https://doi.org/10.1080/00273171.1383224 CrossRef

Phadke, M., & Wu, S. (1974). Modeling of continuous stochastic processes from discrete observations with application to sunspots data. Journal of the American Statistical Association, 69, 325–329. https://doi.org/10.1111/j.1467-9574.2007.00376.x CrossRef

Phillips, P. C. B. (1973). The problem of identification in finite parameter continuous time models. In A. R. Bergstrom (Ed.), Statistical inference in continuous time models (pp. 135–173). Amsterdam: North-Holland.

Prado, R., & West, M. (2010). Time series: Modeling, computation, and inference. Boca Raton: Chapman & Hall.CrossRef

R Core Team. (2015). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org/

Shumway, R. H., & Stoffer, D. (2000). Time series analysis and its applications. New York: Springer. https://doi.org/10.1007/978-1-4419-7865-3

Singer, H. (1990). Parameterschätzung in zeitkontinuierlichen dynamischen Systemen [Parameter estimation in continuous time dynamic systems]. Konstanz: Hartung-Gorre.

Singer, H. (1991). LSDE-A program package for the simulation, graphical display, optimal filtering and maximum likelihood estimation of linear stochastic differential equations: User’s guide. Meersburg: Author.

Singer, H. (1992). The aliasing-phenomenon in visual terms. Journal of Mathematical Sociology, 17, 39–49. https://doi.org/10.1080/0022250X.1992.9990097 MathSciNetCrossRef

Singer, H. (1998). Continuous panel models with time dependent parameters. Journal of Mathematical Sociology, 23, 77–98.CrossRef

Singer, H. (2010). SEM modeling with singular moment part I: ML estimation of time series. Journal of Mathematical Sociology, 34, 301–320. https://doi.org/10.1080/0022250X.2010.509524 CrossRef

Singer, H. (2012). SEM modeling with singular moment part II: ML-estimation of sampled stochastic differential equations. Journal of Mathematical Sociology, 36, 22–43. https://doi.org/10.1080/0022250X.2010.532259 MathSciNetCrossRef

Steele, J. S., & Ferrer, E. (2011a). Latent differential equation modeling of self-regulatory and coregulatory affective processes. Multivariate Behavioral Research, 46, 956–984. https://doi.org/10.1080/00273171.2011.625305 CrossRef

Steele, J. S., & Ferrer, E. (2011b). Response to Oud & Folmer: Randomness and residuals. Multivariate Behavioral Research, 46, 994–1003. https://doi.org/10.1080/00273171.625308 CrossRef

Tómasson, H. (2011). Some computational aspects of Gaussian CARMA modelling. Vienna: Institute for Advanced Studies.MATH

Tómasson, H. (2015). Some computational aspects of Gaussian CARMA modelling. Statistical Computation, 25, 375–387. https://doi.org/10.1007/s11222-013-9438-9 MathSciNetCrossRef

Tsai, H., & Chan, K.-S. (2000). A note on the covariance structure of a continuous-time ARMA process. Statistica Sinica, 10, 989–998.MathSciNetMATH

Voelkle, M. C., & Oud, J. H. L. (2013). Continuous time modelling with individually varying time intervals for oscillating and non-oscillating processes. British Journal of Mathematical and Statistical Psychology, 66, 103–126. https://doi.org/10.1111/j.2044-8317.2012.02043.x MathSciNetCrossRef

Voelkle, M. C., Oud, J. H. L., Davidov, E., & Schmidt, P. (2012a). An SEM approach to continuous time modeling of panel data: Relating authoritarianism and anomia. Psychological Methods, 17, 176–192. https://doi.org/10.1037/a0027543 CrossRef

Voelkle, M. C., Oud, J. H. L., Oertzen, T. von, & Lindenberger, U. (2012b). Maximum likelihood dynamic factor modeling for arbitrary N and T using SEM. Structural Equation Modeling: A Multidisciplinary Journal, 19, 329–350.https://doi.org/10.1080/10705511.2012.687656 MathSciNetCrossRef

Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013). Sample size requirements for structural equation models: An evaluation of power, bias, and solution propriety. Educational and Psychological Measurement, 73, 913–934. https://doi.org/10.1177/0013164413495237 CrossRef

Yu, J. (2014). Econometric analysis of continuous time models: A survey of Peter Philips’s work and some new results. Econometric Theory, 30, 737–774. https://doi.org/10.1017/S0266466613000467 MathSciNetCrossRef

Zadeh, L. A., & Desoer, C. A. (1963). Linear system theory: The state space approach. New York: McGraw-Hill.MATH

Title: First- and Higher-Order Continuous Time Models for Arbitrary N Using SEM
Authors: Johan H. L. Oud
Manuel C. Voelkle
Charles C. Driver
Publisher: Springer International Publishing
Book: Continuous Time Modeling in the Behavioral and Related Sciences
Print ISBN: 978-3-319-77218-9

Electronic ISBN: 978-3-319-77219-6

Copyright Year: 2018
DOI: https://doi.org/10.1007/978-3-319-77219-6_1

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner