Skip to main content
Erschienen in: Soft Computing 11/2013

01.11.2013 | Focus

Ensembles of change-point methods to estimate the change point in residual sequences

verfasst von: Cesare Alippi, Giacomo Boracchi, Manuel Roveri

Erschienen in: Soft Computing | Ausgabe 11/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Change-point methods (CPMs) are statistical tests design to assess whether a given sequence comes from an unique, stationary, data-generating process. CPMs eventually estimate the change-point location, i.e., the point where the data-generating process shifted. While there exists a large literature concerning CPMs meant for sequences of independent and identically distributed (i.i.d.) random variables, their use on time-dependent signals has not been properly investigated. In this case, a straightforward solution consists in computing at first the residuals between the observed signal and the output of a suitable approximation model, and then applying the CPM on the residual sequence. Unfortunately, in practical applications, such residuals are seldom i.i.d., and this may prevent the CPMs to operate properly. To counteract this problem, we introduce the ensemble of CPMs, which aggregates several estimates obtained from CPMs executed on different subsequences of residuals, obtained from random sampling. Experiments show that the ensemble of CPMs improves the change-point estimates when the residuals are not i.i.d., as it is often the case in real-world scenarios.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Akaike H (1974) A new look at the statistical model identification. IEEE Transactions on Automatic Control, vol 19, no 6, pp 716–723 Akaike H (1974) A new look at the statistical model identification. IEEE Transactions on Automatic Control, vol 19, no 6, pp 716–723
Zurück zum Zitat Alippi C, Boracchi G, Roveri M (2011) A just-in-time adaptive classification system based on the intersection of confidence intervals rule. Neural Netw 24(8):791–800CrossRef Alippi C, Boracchi G, Roveri M (2011) A just-in-time adaptive classification system based on the intersection of confidence intervals rule. Neural Netw 24(8):791–800CrossRef
Zurück zum Zitat Alippi C, Boracchi G, Puig V, Roveri M (2013a) A hierarchy of change-point methods for estimating the time instant of leakages in water distribution networks. In: Proceedings of LEAPS, the 1st workshop on learning strategies and data processing in nonstationary environments, in 9th AIAI conference, pp 1–10 Alippi C, Boracchi G, Puig V, Roveri M (2013a) A hierarchy of change-point methods for estimating the time instant of leakages in water distribution networks. In: Proceedings of LEAPS, the 1st workshop on learning strategies and data processing in nonstationary environments, in 9th AIAI conference, pp 1–10
Zurück zum Zitat Alippi C, Boracchi G, Puig V, Roveri M (2013b) An ensemble approach to estimate the fault-time instant. In: Proceedings of the 4th international conference on intelligent control and information processing (ICICIP 2013) Alippi C, Boracchi G, Puig V, Roveri M (2013b) An ensemble approach to estimate the fault-time instant. In: Proceedings of the 4th international conference on intelligent control and information processing (ICICIP 2013)
Zurück zum Zitat Alippi C, Boracchi G, Roveri M (2013c) Just-in-time classifiers for recurrent concepts. IEEE Transactions on Neural Networks and Learning Systems, vol 24, no 4, pp 620–634 Alippi C, Boracchi G, Roveri M (2013c) Just-in-time classifiers for recurrent concepts. IEEE Transactions on Neural Networks and Learning Systems, vol 24, no 4, pp 620–634
Zurück zum Zitat Alippi C, Liu D, Zhao D, Bu L (2013d) Detecting and reacting to changes in sensing units: the active classifier case. IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol PP, no 99, p 1 Alippi C, Liu D, Zhao D, Bu L (2013d) Detecting and reacting to changes in sensing units: the active classifier case. IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol PP, no 99, p 1
Zurück zum Zitat Alippi C, Ntalampiras S, Roveri M (2013e) Model ensemble for an effective on-line reconstruction of missing data in sensor networks. In: International joint conference on neural networks (IJCNN 2013) Alippi C, Ntalampiras S, Roveri M (2013e) Model ensemble for an effective on-line reconstruction of missing data in sensor networks. In: International joint conference on neural networks (IJCNN 2013)
Zurück zum Zitat Anderson TW (1962) On the distribution of the two-sample Cramer–von Mises criterion. Ann Math Stat 33(3):1148–1159CrossRefMATH Anderson TW (1962) On the distribution of the two-sample Cramer–von Mises criterion. Ann Math Stat 33(3):1148–1159CrossRefMATH
Zurück zum Zitat Bai J (November 1997) Estimation of a change point in multiple regression models. Rev Econ Stat 79(4):551–563 Bai J (November 1997) Estimation of a change point in multiple regression models. Rev Econ Stat 79(4):551–563
Zurück zum Zitat Basseville M, Nikiforov IV (1993) Detection of abrupt changes: theory and application. Prentice-Hall, Upper Saddle River Basseville M, Nikiforov IV (1993) Detection of abrupt changes: theory and application. Prentice-Hall, Upper Saddle River
Zurück zum Zitat Chen J, Gupta AK (2000) Parametric statistical change point analysis. Birkhauser, Basel Chen J, Gupta AK (2000) Parametric statistical change point analysis. Birkhauser, Basel
Zurück zum Zitat Dietterich T (2000) Ensemble methods in machine learning. Multiple classifier systems, pp 1–15 Dietterich T (2000) Ensemble methods in machine learning. Multiple classifier systems, pp 1–15
Zurück zum Zitat Hawkins DM, Qiu P, Kang CW (2003) The changepoint model for statistical process control. J Qual Technol 35(4):355–366 Hawkins DM, Qiu P, Kang CW (2003) The changepoint model for statistical process control. J Qual Technol 35(4):355–366
Zurück zum Zitat Hawkins DM, Zamba KD (2005) A change-point model for a shift in variance. J Qual Technol 37(1):21–31 Hawkins DM, Zamba KD (2005) A change-point model for a shift in variance. J Qual Technol 37(1):21–31
Zurück zum Zitat Isermann R (2006) Fault-diagnosis systems: an introduction from fault detection to fault tolerance. Springer, New York Isermann R (2006) Fault-diagnosis systems: an introduction from fault detection to fault tolerance. Springer, New York
Zurück zum Zitat Krogh A, Sollich P (1997) Statistical mechanics of ensemble learning. Phys Rev E 55(1):811CrossRef Krogh A, Sollich P (1997) Statistical mechanics of ensemble learning. Phys Rev E 55(1):811CrossRef
Zurück zum Zitat Lepage Y (April 1974) A combination of Wilcoxon’s and Ansari–Bradley’s statistics. Biometrika 58(1):213–217 Lepage Y (April 1974) A combination of Wilcoxon’s and Ansari–Bradley’s statistics. Biometrika 58(1):213–217
Zurück zum Zitat Ljung L (1986) System identification: theory for the user. Prentice-Hall, Inc., Upper Saddle River Ljung L (1986) System identification: theory for the user. Prentice-Hall, Inc., Upper Saddle River
Zurück zum Zitat Ljung L (1999) System identification. Wiley, New York Ljung L (1999) System identification. Wiley, New York
Zurück zum Zitat Mangalova E, Agafonov E (2012) Time series forecasting using ensemble of ar models with time-varying structure. In: 2012 IEEE conference on evolving and adaptive intelligent systems (EAIS), pp 198–203 Mangalova E, Agafonov E (2012) Time series forecasting using ensemble of ar models with time-varying structure. In: 2012 IEEE conference on evolving and adaptive intelligent systems (EAIS), pp 198–203
Zurück zum Zitat Mood AM (1954) On the asymptotic efficiency of certain nonparametric two-sample tests. Ann Math Stat 25(3):514–522 Mood AM (1954) On the asymptotic efficiency of certain nonparametric two-sample tests. Ann Math Stat 25(3):514–522
Zurück zum Zitat Perry MB, Pignatiello JJ (2010) Identifying the time of step change in the mean of autocorrelated processes. J Appl Stat 37(1):119–136MathSciNetCrossRef Perry MB, Pignatiello JJ (2010) Identifying the time of step change in the mean of autocorrelated processes. J Appl Stat 37(1):119–136MathSciNetCrossRef
Zurück zum Zitat Ross GJ (2013) Parametric and nonparametric sequential change detection in R: The cpm package. J Stat Softw (forthcoming) Ross GJ (2013) Parametric and nonparametric sequential change detection in R: The cpm package. J Stat Softw (forthcoming)
Zurück zum Zitat Ross GJ, Tasoulis DK, Adams NM (2011) Nonparametric monitoring of data streams for changes in location and scale. Technometrics 53(4):379–389MathSciNetCrossRef Ross GJ, Tasoulis DK, Adams NM (2011) Nonparametric monitoring of data streams for changes in location and scale. Technometrics 53(4):379–389MathSciNetCrossRef
Zurück zum Zitat Ross G, Adams NM (2012) Two nonparametric control charts for detecting arbitrary distribution changes. J Qual Technol 44(22):102–116 Ross G, Adams NM (2012) Two nonparametric control charts for detecting arbitrary distribution changes. J Qual Technol 44(22):102–116
Zurück zum Zitat Wichard J, Ogorzalek M (2004) Time series prediction with ensemble models. In: Proceedings of 2004 IEEE international joint conference on neural networks, vol 2, pp 1625–1630 Wichard J, Ogorzalek M (2004) Time series prediction with ensemble models. In: Proceedings of 2004 IEEE international joint conference on neural networks, vol 2, pp 1625–1630
Zurück zum Zitat Zhou Z-H (2012) Ensemble methods foundations and algorithms. Chapman & Hall, London Zhou Z-H (2012) Ensemble methods foundations and algorithms. Chapman & Hall, London
Metadaten
Titel
Ensembles of change-point methods to estimate the change point in residual sequences
verfasst von
Cesare Alippi
Giacomo Boracchi
Manuel Roveri
Publikationsdatum
01.11.2013
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 11/2013
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-013-1130-7

Weitere Artikel der Ausgabe 11/2013

Soft Computing 11/2013 Zur Ausgabe

Premium Partner