Skip to main content

2011 | OriginalPaper | Buchkapitel

6. Outliers

verfasst von : Prof. Roberto Baragona, Prof. Francesco Battaglia, Prof. Irene Poli

Erschienen in: Evolutionary Statistical Procedures

Verlag: Springer Berlin Heidelberg

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Outliers, that is outlying observations, sometimes also known as aberrant observations, are being often studied in the literature closely related to missing data treatment and validation procedures. An interesting issue is concerned with the influence of outliers on the estimates of moments of the data distribution or indexes relevant for further data analysis and model building. The approach of robust statistics is oriented in such direction to ensure that good reliable estimates may be obtained even in the presence of gross errors or unusual measures originated by unexpected events. The approach we shall cope with here aims instead at discovering such outliers and either setting them apart or correcting them according to some properly fitted data model. The very complexity of such a problem prompted soon for employing general heuristic methods for outlier detection and size estimation for independent sample data. Owing to the dependence structure outlier analysis in time series proved to be much more difficult as observations have to be checked not only as regards their distance from the mean but as far as relationships among neighboring observations and correlation function are concerned. For this reason we shall give a brief account of evolutionary computing applications within independent data analysis framework while more detailed discussion will be devoted to outliers and influential observations in time series analysis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Akaike H (1977) An entropy maximisation principle. In: Krishnaiah PR (ed) Proceedings of the symposium on applied statistics. North-Holland, Amsterdam, pp 27–41 Akaike H (1977) An entropy maximisation principle. In: Krishnaiah PR (ed) Proceedings of the symposium on applied statistics. North-Holland, Amsterdam, pp 27–41
Zurück zum Zitat Andrews DF, Pregibon D (1978) Finding the outliers that matter. J R Stat Soc B 40:85–93MATH Andrews DF, Pregibon D (1978) Finding the outliers that matter. J R Stat Soc B 40:85–93MATH
Zurück zum Zitat Atkinson AC, Riani M (2000) Robust diagnostic regression analysis. Springer, New York, NYMATH Atkinson AC, Riani M (2000) Robust diagnostic regression analysis. Springer, New York, NYMATH
Zurück zum Zitat Atkinson AC, Riani M (2002) Forward search added-variable t-tests and the effect of masked outliers in model selection. Biometrika 89:939–946MATHCrossRefMathSciNet Atkinson AC, Riani M (2002) Forward search added-variable t-tests and the effect of masked outliers in model selection. Biometrika 89:939–946MATHCrossRefMathSciNet
Zurück zum Zitat Baragona R, Battaglia F (1995) Linear interpolators and the inverse correlation function of non stationary time series. J Time Ser Anal 16:531–538MATHCrossRefMathSciNet Baragona R, Battaglia F (1995) Linear interpolators and the inverse correlation function of non stationary time series. J Time Ser Anal 16:531–538MATHCrossRefMathSciNet
Zurück zum Zitat Baragona R, Battaglia F (2007) Outliers detection in multivariate time series by independent component analysis. Neural Comput 19:1962–1984MATHCrossRef Baragona R, Battaglia F (2007) Outliers detection in multivariate time series by independent component analysis. Neural Comput 19:1962–1984MATHCrossRef
Zurück zum Zitat Baragona R, Battaglia F, Calzini C (2001a) Genetic algorithms for the identification of additive and innovation outliers in time series. Comput Stat Data Anal 37:1–12MATHCrossRefMathSciNet Baragona R, Battaglia F, Calzini C (2001a) Genetic algorithms for the identification of additive and innovation outliers in time series. Comput Stat Data Anal 37:1–12MATHCrossRefMathSciNet
Zurück zum Zitat Barnett V, Lewis T (1994) Outliers in statistical data, 3rd edn. Wiley, ChichesterMATH Barnett V, Lewis T (1994) Outliers in statistical data, 3rd edn. Wiley, ChichesterMATH
Zurück zum Zitat Battaglia F, Baragona R (1992) Linear interpolators and the outlier problem in time series. Metron 50:79–97MATHMathSciNet Battaglia F, Baragona R (1992) Linear interpolators and the outlier problem in time series. Metron 50:79–97MATHMathSciNet
Zurück zum Zitat Bhansali RJ (1990) On a relationship between the inverse of a stationary covariance matrix and the linear interpolator. J Appl Probab 27:156–170MATHCrossRefMathSciNet Bhansali RJ (1990) On a relationship between the inverse of a stationary covariance matrix and the linear interpolator. J Appl Probab 27:156–170MATHCrossRefMathSciNet
Zurück zum Zitat Box GEP, Jenkins GM (1976) Time series analysis: forecasting and control, 2nd edn. Holden-Day, San Francisco, CAMATH Box GEP, Jenkins GM (1976) Time series analysis: forecasting and control, 2nd edn. Holden-Day, San Francisco, CAMATH
Zurück zum Zitat Box GEP, Jenkins GM, Reinsel GC (1994) Time series analysis: forecasting and control, 3rd edn. Prentice Hall, Englewood Cliffs, NJMATH Box GEP, Jenkins GM, Reinsel GC (1994) Time series analysis: forecasting and control, 3rd edn. Prentice Hall, Englewood Cliffs, NJMATH
Zurück zum Zitat Bruce AG, Martin RD (1989) Leave-k-out diagnostics for time series (with discussion). J R Stat Soc B 51:363–424MATHMathSciNet Bruce AG, Martin RD (1989) Leave-k-out diagnostics for time series (with discussion). J R Stat Soc B 51:363–424MATHMathSciNet
Zurück zum Zitat Chang I, Tiao GC, Chen C (1988) Estimation of time series parameters in the presence of outliers. Technometrics 30:193–204CrossRefMathSciNet Chang I, Tiao GC, Chen C (1988) Estimation of time series parameters in the presence of outliers. Technometrics 30:193–204CrossRefMathSciNet
Zurück zum Zitat Chen C (1997) Detection of additive outliers in bilinear time series. Comput Stat Data Anal 24:283–294MATHCrossRef Chen C (1997) Detection of additive outliers in bilinear time series. Comput Stat Data Anal 24:283–294MATHCrossRef
Zurück zum Zitat Chen C, Liu LM (1993) Joint estimation of model parameters and outlier effects in time series. J Am Stat Assoc 88:284–297MATHCrossRef Chen C, Liu LM (1993) Joint estimation of model parameters and outlier effects in time series. J Am Stat Assoc 88:284–297MATHCrossRef
Zurück zum Zitat Cleveland WS (1972) The inverse autocorrelations of a time series and their applications. Technometrics 14:277–298MATHCrossRef Cleveland WS (1972) The inverse autocorrelations of a time series and their applications. Technometrics 14:277–298MATHCrossRef
Zurück zum Zitat Cook RD, Weisberg S (1982) Residuals and influence in regression. Chapman and Hall, LondonMATH Cook RD, Weisberg S (1982) Residuals and influence in regression. Chapman and Hall, LondonMATH
Zurück zum Zitat Crawford KD, Wainwright RL (1995) Applying genetic algorithms to outlier detection. In: Eshelman LJ (ed) Proceedings of the 6th international conference on genetic algorithms. Morgan Kaufmann, San Mateo, CA, pp 546–550 Crawford KD, Wainwright RL (1995) Applying genetic algorithms to outlier detection. In: Eshelman LJ (ed) Proceedings of the 6th international conference on genetic algorithms. Morgan Kaufmann, San Mateo, CA, pp 546–550
Zurück zum Zitat Crawford KD, Wainwright RL, Vasicek DJ (1995) Detecting multiple outliers in regression data using genetic algorithms. In: Proceedings of the 1995 ACM/SIGAPP symposium on applied computing. 26–28 Feb 1995, ACM Press, Nashville, TN, pp 351–356 Crawford KD, Wainwright RL, Vasicek DJ (1995) Detecting multiple outliers in regression data using genetic algorithms. In: Proceedings of the 1995 ACM/SIGAPP symposium on applied computing. 26–28 Feb 1995, ACM Press, Nashville, TN, pp 351–356
Zurück zum Zitat Fox AJ (1972) Outliers in time series. J R Stat Soc B 43:350–363 Fox AJ (1972) Outliers in time series. J R Stat Soc B 43:350–363
Zurück zum Zitat Galeano P, Peña D, Tsay RS (2006) Outlier detection in multivariate time series by projection pursuit. J Am Stat Assoc 101:654–669MATHCrossRef Galeano P, Peña D, Tsay RS (2006) Outlier detection in multivariate time series by projection pursuit. J Am Stat Assoc 101:654–669MATHCrossRef
Zurück zum Zitat Glendinning RH (2000) Estimating the inverse autocorrelation function from outlier contaminated data. Comput Stat 15:541–565MATHCrossRefMathSciNet Glendinning RH (2000) Estimating the inverse autocorrelation function from outlier contaminated data. Comput Stat 15:541–565MATHCrossRefMathSciNet
Zurück zum Zitat Grenander U, Rosenblatt M (1957) Statistical analysis of stationary time series. Wiley, New York, NYMATH Grenander U, Rosenblatt M (1957) Statistical analysis of stationary time series. Wiley, New York, NYMATH
Zurück zum Zitat Kargupta H, Deb K, Goldberg DE (1992) Ordering genetic algorithms and deception. In: Männer R, Manderick B (eds) Parallel problem solving from nature, vol 2. Elsevier, Amsterdam, pp 47–56 Kargupta H, Deb K, Goldberg DE (1992) Ordering genetic algorithms and deception. In: Männer R, Manderick B (eds) Parallel problem solving from nature, vol 2. Elsevier, Amsterdam, pp 47–56
Zurück zum Zitat Kohn R, Ansley CF (1983) Fixed interval estimation in state space models when some of the data are missing or aggregated. Biometrika 70:683–688MATHCrossRefMathSciNet Kohn R, Ansley CF (1983) Fixed interval estimation in state space models when some of the data are missing or aggregated. Biometrika 70:683–688MATHCrossRefMathSciNet
Zurück zum Zitat Michalewicz Z (1996b) Genetic algorithms+data structures=evolution programs, 3rd edn. Springer, BerlinMATH Michalewicz Z (1996b) Genetic algorithms+data structures=evolution programs, 3rd edn. Springer, BerlinMATH
Zurück zum Zitat Priestley MB (1988) Non-linear and non-stationary time series analysis. Academic Press, London Priestley MB (1988) Non-linear and non-stationary time series analysis. Academic Press, London
Zurück zum Zitat Reinsel GC (1993) Elements of multivariate time series analysis. Springer, New York, NYMATH Reinsel GC (1993) Elements of multivariate time series analysis. Springer, New York, NYMATH
Zurück zum Zitat Riani M (2004) Extensions of the forward search to time series. Stud Nonlinear Dyn Econom 8(2), Article 2 Riani M (2004) Extensions of the forward search to time series. Stud Nonlinear Dyn Econom 8(2), Article 2
Zurück zum Zitat Tolvi J (2004) Genetic algorithms for outlier detection and variable selection in linear regression models. Soft Comput 8:527–533MATHCrossRef Tolvi J (2004) Genetic algorithms for outlier detection and variable selection in linear regression models. Soft Comput 8:527–533MATHCrossRef
Zurück zum Zitat Tsay RS (1986) Time series model specification in the presence of outliers. J Am Stat Assoc 81:132–141CrossRef Tsay RS (1986) Time series model specification in the presence of outliers. J Am Stat Assoc 81:132–141CrossRef
Zurück zum Zitat Battaglia F (1988a) Bilateral autoregressive models for data validation in time series. Metron 46:275–286, invited lecture given at the 17th Conference on stochastic processes and their applications held in Rome, June 27th–July 1st, 1988 Battaglia F (1988a) Bilateral autoregressive models for data validation in time series. Metron 46:275–286, invited lecture given at the 17th Conference on stochastic processes and their applications held in Rome, June 27th–July 1st, 1988
Zurück zum Zitat Gounder MK, Shitan M, Imon R (2007) Detection of outliers in non-linear time series: A review. In: Festschrift in honor of distinguished professor Mir Masoom Ali on the occasion of his retirement. 18–19, May 2007, Ball State University, Muncie, IN, USA, pp 213–224 Gounder MK, Shitan M, Imon R (2007) Detection of outliers in non-linear time series: A review. In: Festschrift in honor of distinguished professor Mir Masoom Ali on the occasion of his retirement. 18–19, May 2007, Ball State University, Muncie, IN, USA, pp 213–224
Zurück zum Zitat Liu LM, Hudak T (1992) Forecasting and time series analysis using the sca statistical system. Technical report, Scientific Computing Associates, DeKalb, IL Liu LM, Hudak T (1992) Forecasting and time series analysis using the sca statistical system. Technical report, Scientific Computing Associates, DeKalb, IL
Zurück zum Zitat Maravall A, Peña D (1989) Missing observations, additive outliers and inverse autocorrelation function. Technical Report 89/384, European University Institute, Florence Maravall A, Peña D (1989) Missing observations, additive outliers and inverse autocorrelation function. Technical Report 89/384, European University Institute, Florence
Metadaten
Titel
Outliers
verfasst von
Prof. Roberto Baragona
Prof. Francesco Battaglia
Prof. Irene Poli
Copyright-Jahr
2011
Verlag
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-16218-3_6

Premium Partner