Skip to main content

2012 | OriginalPaper | Buchkapitel

12. Automatic Selection for Non-linear Models

verfasst von : Jennifer L. Castle, David F. Hendry

Erschienen in: System Identification, Environmental Modelling, and Control System Design

Verlag: Springer London

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Our strategy for automatic selection in potentially non-linear processes is: test for non-linearity in the unrestricted linear formulation; if that test rejects, specify a general model using polynomials, to be simplified to a minimal congruent representation; finally select by encompassing tests of specific non-linear forms against the selected model. Non-linearity poses many problems: extreme observations leading to non-normal (fat-tailed) distributions; collinearity between non-linear functions; usually more variables than observations when approximating the non-linearity; and excess retention of irrelevant variables; but solutions are proposed. A returns-to-education empirical application demonstrates the feasibility of the non-linear automatic model selection algorithm Autometrics.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
p-values shown in brackets.
 
Literatur
2.
Zurück zum Zitat Ahmed, S.: Econometric issues on the return to education. MPhil thesis. University of Oxford (2007) Ahmed, S.: Econometric issues on the return to education. MPhil thesis. University of Oxford (2007)
3.
Zurück zum Zitat Altonji, J., Dunn, T.: Using siblings to estimate the effect of schooling quality on wages. Rev. Econ. Stat. 78, 665–671 (1996) CrossRef Altonji, J., Dunn, T.: Using siblings to estimate the effect of schooling quality on wages. Rev. Econ. Stat. 78, 665–671 (1996) CrossRef
4.
Zurück zum Zitat Blundell, R., Dearden, L., Sianesi, B.: Evaluating the effect of education on earnings: models, methods and results from the National Child Development Survey. J. R. Stat. Soc. A 168, 473–512 (2005) MathSciNetMATHCrossRef Blundell, R., Dearden, L., Sianesi, B.: Evaluating the effect of education on earnings: models, methods and results from the National Child Development Survey. J. R. Stat. Soc. A 168, 473–512 (2005) MathSciNetMATHCrossRef
5.
Zurück zum Zitat Campos, J., Hendry, D.F., Krolzig, H.M.: Consistent model selection by an automatic Gets approach. Oxf. Bull. Econ. Stat. 65, 803–819 (2003) CrossRef Campos, J., Hendry, D.F., Krolzig, H.M.: Consistent model selection by an automatic Gets approach. Oxf. Bull. Econ. Stat. 65, 803–819 (2003) CrossRef
6.
Zurück zum Zitat Card, D.: The causal effect of education on earnings. In: Ashenfelter, O., Card, D. (eds.) Handbook of Labor Economics, vol. 3A, pp. 1801–1863. North-Holland, Amsterdam (1999) Card, D.: The causal effect of education on earnings. In: Ashenfelter, O., Card, D. (eds.) Handbook of Labor Economics, vol. 3A, pp. 1801–1863. North-Holland, Amsterdam (1999)
7.
Zurück zum Zitat Castle, J.L.: Evaluating PcGets and RETINA as automatic model selection algorithms. Oxf. Bull. Econ. Stat. 67, 837–880 (2005) CrossRef Castle, J.L.: Evaluating PcGets and RETINA as automatic model selection algorithms. Oxf. Bull. Econ. Stat. 67, 837–880 (2005) CrossRef
8.
Zurück zum Zitat Castle, J.L., Hendry, D.F.: A low-dimension, portmanteau test for non-linearity. J. Econom. (2010) Castle, J.L., Hendry, D.F.: A low-dimension, portmanteau test for non-linearity. J. Econom. (2010)
9.
Zurück zum Zitat Castle, J.L., Doornik, J.A., Hendry, D.F.: Evaluating automatic model selection. J. Time Ser. Econom. 3(1), Article 8 (2011) Castle, J.L., Doornik, J.A., Hendry, D.F.: Evaluating automatic model selection. J. Time Ser. Econom. 3(1), Article 8 (2011)
10.
Zurück zum Zitat Castle, J.L., Doornik, J.A., Hendry, D.F.: Model selection when there are multiple breaks. Working Paper 472, Economics Department, University of Oxford (2009) Castle, J.L., Doornik, J.A., Hendry, D.F.: Model selection when there are multiple breaks. Working Paper 472, Economics Department, University of Oxford (2009)
11.
Zurück zum Zitat Castle, J.L., Fawcett, N.W.P., Hendry, D.F.: Forecasting breaks and during breaks. In: Clements, M.P., Hendry, D.F. (eds.) Oxford Handbook of Economic Forecasting, Chap. 11, pp. 315–354. Oxford University Press, London (2011) Castle, J.L., Fawcett, N.W.P., Hendry, D.F.: Forecasting breaks and during breaks. In: Clements, M.P., Hendry, D.F. (eds.) Oxford Handbook of Economic Forecasting, Chap. 11, pp. 315–354. Oxford University Press, London (2011)
12.
Zurück zum Zitat Clements, M.P., Hendry, D.F.: Forecasting Economic Time Series. Cambridge University Press, Cambridge (1998) CrossRef Clements, M.P., Hendry, D.F.: Forecasting Economic Time Series. Cambridge University Press, Cambridge (1998) CrossRef
13.
14.
Zurück zum Zitat Dearden, L.: The effects of families and ability on men’s education and earnings in Britain. Labour Econ. 6, 551–567 (1999) CrossRef Dearden, L.: The effects of families and ability on men’s education and earnings in Britain. Labour Econ. 6, 551–567 (1999) CrossRef
15.
Zurück zum Zitat Doornik, J.A.: Econometric model selection with more variables than observations. Working Paper, Economics Department, University of Oxford (2007) Doornik, J.A.: Econometric model selection with more variables than observations. Working Paper, Economics Department, University of Oxford (2007)
16.
Zurück zum Zitat Doornik, J.A.: Encompassing and automatic model selection. Oxf. Bull. Econ. Stat. 70, 915–925 (2008) CrossRef Doornik, J.A.: Encompassing and automatic model selection. Oxf. Bull. Econ. Stat. 70, 915–925 (2008) CrossRef
17.
Zurück zum Zitat Doornik, J.A.: Autometrics. In: Castle, J.L., Shephard, N. (eds.) The Methodology and Practice of Econometrics, pp. 88–121. Oxford University Press, Oxford (2009) CrossRef Doornik, J.A.: Autometrics. In: Castle, J.L., Shephard, N. (eds.) The Methodology and Practice of Econometrics, pp. 88–121. Oxford University Press, Oxford (2009) CrossRef
18.
Zurück zum Zitat Doornik, J.A., Hansen, H.: An omnibus test for univariate and multivariate normality. Oxf. Bull. Econ. Stat. 70, 927–939 (2008) CrossRef Doornik, J.A., Hansen, H.: An omnibus test for univariate and multivariate normality. Oxf. Bull. Econ. Stat. 70, 927–939 (2008) CrossRef
19.
Zurück zum Zitat Doornik, J.A., Hendry, D.F.: Empirical model discovery. Working paper, Economics Department, University of Oxford (2009) Doornik, J.A., Hendry, D.F.: Empirical model discovery. Working paper, Economics Department, University of Oxford (2009)
20.
Zurück zum Zitat Frisch, R.: Statistical Confluence Analysis by Means of Complete Regression Systems. University Institute of Economics, Oslo (1934) MATH Frisch, R.: Statistical Confluence Analysis by Means of Complete Regression Systems. University Institute of Economics, Oslo (1934) MATH
21.
Zurück zum Zitat Garen, J.: The returns to schooling: a selectivity bias approach with a continuous choice variable. Econometrica 52(5), 1199–1218 (1984) CrossRef Garen, J.: The returns to schooling: a selectivity bias approach with a continuous choice variable. Econometrica 52(5), 1199–1218 (1984) CrossRef
22.
Zurück zum Zitat Granger, C.W.J., Teräsvirta, T.: Modelling Nonlinear Economic Relationships. Oxford University Press, Oxford (1993) MATH Granger, C.W.J., Teräsvirta, T.: Modelling Nonlinear Economic Relationships. Oxford University Press, Oxford (1993) MATH
23.
Zurück zum Zitat Griliches, Z.: Estimating the returns to schooling: some econometric problems. Econometrica 45, 1–22 (1977) CrossRef Griliches, Z.: Estimating the returns to schooling: some econometric problems. Econometrica 45, 1–22 (1977) CrossRef
24.
Zurück zum Zitat Harmon, C., Walker, I.: Estimates of the economic return to schooling for the UK. Am. Econ. Rev. 85, 1278–1286 (1995) Harmon, C., Walker, I.: Estimates of the economic return to schooling for the UK. Am. Econ. Rev. 85, 1278–1286 (1995)
25.
Zurück zum Zitat Harrison, A.: Earnings by size: a tale of two distributions. Rev. Econ. Stud. 48, 621–631 (1981) CrossRef Harrison, A.: Earnings by size: a tale of two distributions. Rev. Econ. Stud. 48, 621–631 (1981) CrossRef
26.
Zurück zum Zitat Heckman, J.J., Lochner, L.J., Todd, P.E.: Earnings functions, rates of return and treatment effects: the Mincer equation and beyond. In: Hanushek, E., Welch, F. (eds.) Handbook of the Economics of Education, vol. 1. North Holland, Amsterdam (2006). Chap. 7 Heckman, J.J., Lochner, L.J., Todd, P.E.: Earnings functions, rates of return and treatment effects: the Mincer equation and beyond. In: Hanushek, E., Welch, F. (eds.) Handbook of the Economics of Education, vol. 1. North Holland, Amsterdam (2006). Chap. 7
27.
Zurück zum Zitat Hendry, D.F., Doornik, J.A.: Empirical Econometric Modelling using PcGive, vol. I. Timberlake Consultants Press, London (2009) Hendry, D.F., Doornik, J.A.: Empirical Econometric Modelling using PcGive, vol. I. Timberlake Consultants Press, London (2009)
28.
Zurück zum Zitat Hendry, D.F., Krolzig, H.M.: Automatic Econometric Model Selection. Timberlake Consultants Press, London (2001) Hendry, D.F., Krolzig, H.M.: Automatic Econometric Model Selection. Timberlake Consultants Press, London (2001)
29.
Zurück zum Zitat Hendry, D.F., Krolzig, H.M.: The properties of automatic Gets modelling. Econ. J. 115, C32–C61 (2005) CrossRef Hendry, D.F., Krolzig, H.M.: The properties of automatic Gets modelling. Econ. J. 115, C32–C61 (2005) CrossRef
30.
Zurück zum Zitat Hendry, D.F., Mizon, G.E.: Econometric modelling of changing time series. Working Paper 475, Economics Department, Oxford University (2009) Hendry, D.F., Mizon, G.E.: Econometric modelling of changing time series. Working Paper 475, Economics Department, Oxford University (2009)
31.
Zurück zum Zitat Hendry, D.F., Morgan, M.S.: A re-analysis of confluence analysis. Oxf. Econ. Pap. 41, 35–52 (1989) Hendry, D.F., Morgan, M.S.: A re-analysis of confluence analysis. Oxf. Econ. Pap. 41, 35–52 (1989)
32.
Zurück zum Zitat Hendry, D.F., Richard, J.F.: Recent developments in the theory of encompassing. In: Cornet, B., Tulkens, H. (eds.) Contributions to Operations Research and Economics. The XXth Anniversary of CORE, pp. 393–440. MIT Press, Cambridge (1989) Hendry, D.F., Richard, J.F.: Recent developments in the theory of encompassing. In: Cornet, B., Tulkens, H. (eds.) Contributions to Operations Research and Economics. The XXth Anniversary of CORE, pp. 393–440. MIT Press, Cambridge (1989)
33.
Zurück zum Zitat Hendry, D.F., Santos, C.: Regression models with data-based indicator variables. Oxf. Bull. Econ. Stat. 67, 571–595 (2005) CrossRef Hendry, D.F., Santos, C.: Regression models with data-based indicator variables. Oxf. Bull. Econ. Stat. 67, 571–595 (2005) CrossRef
34.
Zurück zum Zitat Hendry, D.F., Johansen, S., Santos, C.: Automatic selection of indicators in a fully saturated regression. Comput. Stat. 33, 317–335 (2008). Erratum, 337–339 MathSciNet Hendry, D.F., Johansen, S., Santos, C.: Automatic selection of indicators in a fully saturated regression. Comput. Stat. 33, 317–335 (2008). Erratum, 337–339 MathSciNet
35.
Zurück zum Zitat Hoover, K.D., Perez, S.J.: Data mining reconsidered: encompassing and the general-to-specific approach to specification search. Econom. J. 2, 167–191 (1999) CrossRef Hoover, K.D., Perez, S.J.: Data mining reconsidered: encompassing and the general-to-specific approach to specification search. Econom. J. 2, 167–191 (1999) CrossRef
36.
Zurück zum Zitat Johansen, S., Nielsen, B.: An analysis of the indicator saturation estimator as a robust regression estimator. In: Castle, J.L., Shephard, N. (eds.) The Methodology and Practice of Econometrics, pp. 1–36. Oxford University Press, Oxford (2009) CrossRef Johansen, S., Nielsen, B.: An analysis of the indicator saturation estimator as a robust regression estimator. In: Castle, J.L., Shephard, N. (eds.) The Methodology and Practice of Econometrics, pp. 1–36. Oxford University Press, Oxford (2009) CrossRef
37.
Zurück zum Zitat Lehergott, S.: The shape of the income distribution. Am. Econ. Rev. 49, 328–347 (1959) Lehergott, S.: The shape of the income distribution. Am. Econ. Rev. 49, 328–347 (1959)
38.
Zurück zum Zitat Mincer, J.: Investment in human capital and personal income distribution. J. Polit. Econ. 66(4), 281–302 (1958) CrossRef Mincer, J.: Investment in human capital and personal income distribution. J. Polit. Econ. 66(4), 281–302 (1958) CrossRef
39.
Zurück zum Zitat Mincer, J.: Schooling, Experience and Earnings. Natonal Bureau of Economic Research, New York (1974) Mincer, J.: Schooling, Experience and Earnings. Natonal Bureau of Economic Research, New York (1974)
40.
Zurück zum Zitat Mizon, G.E., Richard, J.F.: The encompassing principle and its application to non-nested hypothesis tests. Econometrica 54, 657–678 (1986) MathSciNetMATHCrossRef Mizon, G.E., Richard, J.F.: The encompassing principle and its application to non-nested hypothesis tests. Econometrica 54, 657–678 (1986) MathSciNetMATHCrossRef
41.
Zurück zum Zitat Perez-Amaral, T., Gallo, G.M., White, H.: A flexible tool for model building: the relevant transformation of the inputs network approach (RETINA). Oxf. Bull. Econ. Stat. 65, 821–838 (2003) CrossRef Perez-Amaral, T., Gallo, G.M., White, H.: A flexible tool for model building: the relevant transformation of the inputs network approach (RETINA). Oxf. Bull. Econ. Stat. 65, 821–838 (2003) CrossRef
42.
Zurück zum Zitat Phillips, P.C.B.: Regression with slowly varying regressors and nonlinear trends. Econom. Theory 23, 557–614 (2007) Phillips, P.C.B.: Regression with slowly varying regressors and nonlinear trends. Econom. Theory 23, 557–614 (2007)
43.
Zurück zum Zitat Priestley, M.B.: Spectral Analysis and Time Series. Academic Press, New York (1981) MATH Priestley, M.B.: Spectral Analysis and Time Series. Academic Press, New York (1981) MATH
44.
Zurück zum Zitat Ramsey, J.B.: Tests for specification errors in classical linear least squares regression analysis. J. R. Stat. Soc. B 31, 350–371 (1969) MathSciNetMATH Ramsey, J.B.: Tests for specification errors in classical linear least squares regression analysis. J. R. Stat. Soc. B 31, 350–371 (1969) MathSciNetMATH
45.
Zurück zum Zitat Rushton, S.: On least squares fitting by orthogonal polynomials using the Choleski method. J. R. Stat. Soc. B 13, 92–99 (1951) MathSciNetMATH Rushton, S.: On least squares fitting by orthogonal polynomials using the Choleski method. J. R. Stat. Soc. B 13, 92–99 (1951) MathSciNetMATH
46.
47.
Zurück zum Zitat Staehle, H.: Ability, wages and income. Rev. Econ. Stat. 25, 77–87 (1943) CrossRef Staehle, H.: Ability, wages and income. Rev. Econ. Stat. 25, 77–87 (1943) CrossRef
48.
Zurück zum Zitat Teräsvirta, T.: Specification, estimation and evaluation of smooth transition autoregressive models. J. Am. Stat. Assoc. 89, 208–218 (1994) CrossRef Teräsvirta, T.: Specification, estimation and evaluation of smooth transition autoregressive models. J. Am. Stat. Assoc. 89, 208–218 (1994) CrossRef
49.
Zurück zum Zitat White, H.: A heteroskedastic-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 48, 817–838 (1980) MathSciNetMATHCrossRef White, H.: A heteroskedastic-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 48, 817–838 (1980) MathSciNetMATHCrossRef
50.
Zurück zum Zitat White, H.: Artificial Neural Networks: Approximation and Learning Theory. Oxford University Press, Oxford (1992) White, H.: Artificial Neural Networks: Approximation and Learning Theory. Oxford University Press, Oxford (1992)
Metadaten
Titel
Automatic Selection for Non-linear Models
verfasst von
Jennifer L. Castle
David F. Hendry
Copyright-Jahr
2012
Verlag
Springer London
DOI
https://doi.org/10.1007/978-0-85729-974-1_12

Neuer Inhalt