Skip to main content
Top
Published in: Data Mining and Knowledge Discovery 2/2024

28-08-2023

A semi-supervised interactive algorithm for change point detection

Authors: Zhenxiang Cao, Nick Seeuws, Maarten De Vos, Alexander Bertrand

Published in: Data Mining and Knowledge Discovery | Issue 2/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The goal of change point detection (CPD) is to identify abrupt changes in the statistics of signals or time series that reflect transitions in the underlying system’s properties or states. While many statistical and learning-based approaches have been proposed to address this task, most state-of-the-art methods still treat this problem in an unsupervised setting. As a result, there is often a large gap between the algorithm-detected results and the expected outcomes of the user. To bridge this gap, we propose an active-learning strategy for the CPD problem that combines with the one-class support vector machine (OCSVM) model, resulting in an interactive CPD algorithm that improves itself by querying the end-user. This approach enables us to focus on detecting the desired change points and ignore false-positives or irrelevant change points. We demonstrate that the interactive OCSVM model can be combined with various unsupervised CPD models to function in a semi-supervised setting, resulting in improved detection accuracy. Our experimental results on various simulated and real-life datasets demonstrate a significant improvement in detection performance on both single- and multi-channel time series, even with a limited number of queries.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Adams RP, MacKay DJC (2007) Bayesian online changepoint detection. Mach Learn Adams RP, MacKay DJC (2007) Bayesian online changepoint detection. Mach Learn
go back to reference An J, Cho S (2015) Variational autoencoder based anomaly detection using reconstruction probability. Spec Lect IE 2(1):1–18 An J, Cho S (2015) Variational autoencoder based anomaly detection using reconstruction probability. Spec Lect IE 2(1):1–18
go back to reference Appel U, Brandt AV (1983) Adaptive sequential segmentation of piecewise stationary time series. Inf Sci 29(1):27–56CrossRef Appel U, Brandt AV (1983) Adaptive sequential segmentation of piecewise stationary time series. Inf Sci 29(1):27–56CrossRef
go back to reference Basseville M, Nikiforov IV, et al (1993) Detection of abrupt changes: theory and application, vol 104. Prentice Hall, Englewood Cliffs Basseville M, Nikiforov IV, et al (1993) Detection of abrupt changes: theory and application, vol 104. Prentice Hall, Englewood Cliffs
go back to reference Bosc M, Heitz F, Armspach J-P, Namer I, Gounot D, Rumbach L (2003) Automatic change detection in multimodal serial MRI: application to multiple sclerosis lesion evolution. Neuroimage 20(2):643–656CrossRefPubMed Bosc M, Heitz F, Armspach J-P, Namer I, Gounot D, Rumbach L (2003) Automatic change detection in multimodal serial MRI: application to multiple sclerosis lesion evolution. Neuroimage 20(2):643–656CrossRefPubMed
go back to reference Brandt AV (1983) Detecting and estimating parameter jumps using ladder algorithms and likelihood ratio tests. In: ICASSP’83. IEEE international conference on acoustics, speech, and signal processing, vol 8. IEEE, pp 1017–1020 Brandt AV (1983) Detecting and estimating parameter jumps using ladder algorithms and likelihood ratio tests. In: ICASSP’83. IEEE international conference on acoustics, speech, and signal processing, vol 8. IEEE, pp 1017–1020
go back to reference Breunig MM, Kriegel H-P, Ng RT, Sander J (2000) LOF: identifying density-based local outliers. In: Proceedings of the 2000 ACM SIGMOD international conference on management of data, pp 93–104 Breunig MM, Kriegel H-P, Ng RT, Sander J (2000) LOF: identifying density-based local outliers. In: Proceedings of the 2000 ACM SIGMOD international conference on management of data, pp 93–104
go back to reference Chandola V, Vatsavai RR (2010) Scalable time series change detection for biomass monitoring using gaussian process. In: CIDU, pp 69–82 Chandola V, Vatsavai RR (2010) Scalable time series change detection for biomass monitoring using gaussian process. In: CIDU, pp 69–82
go back to reference Chandola V, Banerjee A, Kumar V (2009) Anomaly detection: a survey. ACM Comput Surv (CSUR) 41(3):1–58CrossRef Chandola V, Banerjee A, Kumar V (2009) Anomaly detection: a survey. ACM Comput Surv (CSUR) 41(3):1–58CrossRef
go back to reference Cheng KC, Miller EL, Hughes MC, Aeron S (2020) On matched filtering for statistical change point detection. IEEE Open J Signal Process 1:159–176CrossRef Cheng KC, Miller EL, Hughes MC, Aeron S (2020) On matched filtering for statistical change point detection. IEEE Open J Signal Process 1:159–176CrossRef
go back to reference Cho H, Fryzlewicz P(2015) Multiple-change-point detection for high dimensional time series via sparsified binary segmentation. J R Sta Soc Ser B Stat Methodol 475–507 Cho H, Fryzlewicz P(2015) Multiple-change-point detection for high dimensional time series via sparsified binary segmentation. J R Sta Soc Ser B Stat Methodol 475–507
go back to reference Cleland I, Han M, Nugent C, Lee H, McClean S, Zhang S, Lee S (2014) Evaluation of prompted annotation of activity data recorded from a smart phone. Sensors 14(9):15861–15879ADSCrossRefPubMedPubMedCentral Cleland I, Han M, Nugent C, Lee H, McClean S, Zhang S, Lee S (2014) Evaluation of prompted annotation of activity data recorded from a smart phone. Sensors 14(9):15861–15879ADSCrossRefPubMedPubMedCentral
go back to reference De Brabandere A, Cao Z, De Vos M, Bertrand A, Davis J (2022) Semi-supervised change point detection using active learning. In: International conference on discovery science. Springer, pp 74–88 De Brabandere A, Cao Z, De Vos M, Bertrand A, Davis J (2022) Semi-supervised change point detection using active learning. In: International conference on discovery science. Springer, pp 74–88
go back to reference De Ryck T, De Vos M, Bertrand A (2021) Change point detection in time series data using autoencoders with a time-invariant representation. IEEE Trans Signal Process De Ryck T, De Vos M, Bertrand A (2021) Change point detection in time series data using autoencoders with a time-invariant representation. IEEE Trans Signal Process
go back to reference Deldari S, Smith DV, Xue H, Salim FD (2021) Time series change point detection with self-supervised contrastive predictive coding. In: Proceedings of the web conference 2021, pp 3124–3135 Deldari S, Smith DV, Xue H, Salim FD (2021) Time series change point detection with self-supervised contrastive predictive coding. In: Proceedings of the web conference 2021, pp 3124–3135
go back to reference Ducré-Robitaille J-F, Vincent LA, Boulet G (2003) Comparison of techniques for detection of discontinuities in temperature series. Int J Climatol A J R Meteorol Soc 23(9):1087–1101CrossRef Ducré-Robitaille J-F, Vincent LA, Boulet G (2003) Comparison of techniques for detection of discontinuities in temperature series. Int J Climatol A J R Meteorol Soc 23(9):1087–1101CrossRef
go back to reference Ebrahimzadeh Z, Zheng M, Karakas S, Kleinberg S (2019) Deep learning for multi-scale changepoint detection in multivariate time series Ebrahimzadeh Z, Zheng M, Karakas S, Kleinberg S (2019) Deep learning for multi-scale changepoint detection in multivariate time series
go back to reference Itoh N, Kurths J (2010) Change-point detection of climate time series by nonparametric method. In: Proceedings of the world congress on engineering and computer science, vol 1. Citeseer, pp 445–448 Itoh N, Kurths J (2010) Change-point detection of climate time series by nonparametric method. In: Proceedings of the world congress on engineering and computer science, vol 1. Citeseer, pp 445–448
go back to reference Li J, Lei P, Todorovic S (2019) Weakly supervised energy-based learning for action segmentation. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 6243–6251 Li J, Lei P, Todorovic S (2019) Weakly supervised energy-based learning for action segmentation. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 6243–6251
go back to reference Liu FT, Ting KM, Zhou Z-H (2008) Isolation forest. In: 2008 Eighth IEEE international conference on data mining. IEEE, pp 413–422 Liu FT, Ting KM, Zhou Z-H (2008) Isolation forest. In: 2008 Eighth IEEE international conference on data mining. IEEE, pp 413–422
go back to reference Liu S, Yamada M, Collier N, Sugiyama M (2013) Change-point detection in time-series data by relative density-ratio estimation. Neural Netw 43:72–83CrossRefPubMed Liu S, Yamada M, Collier N, Sugiyama M (2013) Change-point detection in time-series data by relative density-ratio estimation. Neural Netw 43:72–83CrossRefPubMed
go back to reference Liu W, Li JQ, Wenying Yu, Yang G (2021) Change-point detection approaches for pavement dynamic segmentation. J Transp Eng Part B: Pavements 147(2):06021001 Liu W, Li JQ, Wenying Yu, Yang G (2021) Change-point detection approaches for pavement dynamic segmentation. J Transp Eng Part B: Pavements 147(2):06021001
go back to reference Malladi R, Kalamangalam GP, Aazhang B (2013) Online Bayesian change point detection algorithms for segmentation of epileptic activity. In: 2013 Asilomar conference on signals, systems and computers. IEEE, pp 1833–1837 Malladi R, Kalamangalam GP, Aazhang B (2013) Online Bayesian change point detection algorithms for segmentation of epileptic activity. In: 2013 Asilomar conference on signals, systems and computers. IEEE, pp 1833–1837
go back to reference Munir M, Siddiqui SA, Dengel A, Ahmed S (2018) DeePanT: A deep learning approach for unsupervised anomaly detection in time series. IEEE Access 7:1991–2005CrossRef Munir M, Siddiqui SA, Dengel A, Ahmed S (2018) DeePanT: A deep learning approach for unsupervised anomaly detection in time series. IEEE Access 7:1991–2005CrossRef
go back to reference Perslev M, Jensen MH, Darkner S, Jennum PJ, Igel C (2019) U-time: a fully convolutional network for time series segmentation applied to sleep staging. arXiv:1910.11162 Perslev M, Jensen MH, Darkner S, Jennum PJ, Igel C (2019) U-time: a fully convolutional network for time series segmentation applied to sleep staging. arXiv:​1910.​11162
go back to reference Reddy S, Mun M, Burke J, Estrin D, Hansen M, Srivastava M (2010) Using mobile phones to determine transportation modes. ACM Trans Sens Netw (TOSN) 6(2):1–27CrossRef Reddy S, Mun M, Burke J, Estrin D, Hansen M, Srivastava M (2010) Using mobile phones to determine transportation modes. ACM Trans Sens Netw (TOSN) 6(2):1–27CrossRef
go back to reference Reeves J, Chen J, Wang XL, Lund R, Qi Qi L (2007) A review and comparison of changepoint detection techniques for climate data. J Appl Meteorol Climatol 46(6):900–915ADSCrossRef Reeves J, Chen J, Wang XL, Lund R, Qi Qi L (2007) A review and comparison of changepoint detection techniques for climate data. J Appl Meteorol Climatol 46(6):900–915ADSCrossRef
go back to reference Schölkopf B, Williamson RC, Smola A, Shawe-Taylor J, Platt J (1999) Support vector method for novelty detection. Adv Neural Inf Process Syst 12 Schölkopf B, Williamson RC, Smola A, Shawe-Taylor J, Platt J (1999) Support vector method for novelty detection. Adv Neural Inf Process Syst 12
go back to reference Shi Z, Chehade A (2021) A dual-LSTM framework combining change point detection and remaining useful life prediction. Reliab Eng Syst Saf 205:107257CrossRef Shi Z, Chehade A (2021) A dual-LSTM framework combining change point detection and remaining useful life prediction. Reliab Eng Syst Saf 205:107257CrossRef
go back to reference Shou MZ, Lei SW, Wang W, Ghadiyaram D, Feiszli M (2021) Generic event boundary detection: a benchmark for event segmentation. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 8075–8084 Shou MZ, Lei SW, Wang W, Ghadiyaram D, Feiszli M (2021) Generic event boundary detection: a benchmark for event segmentation. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 8075–8084
go back to reference Staudacher M, Telser S, Amann A, Hinterhuber H, Ritsch-Marte M (2005) A new method for change-point detection developed for on-line analysis of the heart beat variability during sleep. Physica A 349(3–4):582–596ADSCrossRef Staudacher M, Telser S, Amann A, Hinterhuber H, Ritsch-Marte M (2005) A new method for change-point detection developed for on-line analysis of the heart beat variability during sleep. Physica A 349(3–4):582–596ADSCrossRef
go back to reference Tax DMJ, Duin RPW (2004) Support vector data description. Mach Learn 54:45–66CrossRef Tax DMJ, Duin RPW (2004) Support vector data description. Mach Learn 54:45–66CrossRef
go back to reference Turner RD (2012) Gaussian processes for state space models and change point detection. PhD thesis, University of Cambridge Turner RD (2012) Gaussian processes for state space models and change point detection. PhD thesis, University of Cambridge
go back to reference van den Burg GJJ, Williams CKI (2020) An evaluation of change point detection algorithms van den Burg GJJ, Williams CKI (2020) An evaluation of change point detection algorithms
go back to reference Xuan X, Murphy K (2007) Modeling changing dependency structure in multivariate time series. In: Proceedings of the 24th international conference on machine learning, ICML ’07. Association for Computing Machinery, New York, NY, USA, pp 1055–1062. https://doi.org/10.1145/1273496.1273629 Xuan X, Murphy K (2007) Modeling changing dependency structure in multivariate time series. In: Proceedings of the 24th international conference on machine learning, ICML ’07. Association for Computing Machinery, New York, NY, USA, pp 1055–1062. https://​doi.​org/​10.​1145/​1273496.​1273629
go back to reference Zhang R, Hao Y, Yu D, Chang W-C, Lai G, Yang Y (2020) Correlation-aware unsupervised change-point detection via graph neural networks Zhang R, Hao Y, Yu D, Chang W-C, Lai G, Yang Y (2020) Correlation-aware unsupervised change-point detection via graph neural networks
go back to reference Zhou C, Paffenroth RC (2017) Anomaly detection with robust deep autoencoders. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, pp 665–674 Zhou C, Paffenroth RC (2017) Anomaly detection with robust deep autoencoders. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, pp 665–674
Metadata
Title
A semi-supervised interactive algorithm for change point detection
Authors
Zhenxiang Cao
Nick Seeuws
Maarten De Vos
Alexander Bertrand
Publication date
28-08-2023
Publisher
Springer US
Published in
Data Mining and Knowledge Discovery / Issue 2/2024
Print ISSN: 1384-5810
Electronic ISSN: 1573-756X
DOI
https://doi.org/10.1007/s10618-023-00974-0

Other articles of this Issue 2/2024

Data Mining and Knowledge Discovery 2/2024 Go to the issue

Premium Partner