Skip to main content
Erschienen in:
Buchtitelbild

2020 | OriginalPaper | Buchkapitel

Robust Functional Regression for Outlier Detection

verfasst von : Harjit Hullait, David S. Leslie, Nicos G. Pavlidis, Steve King

Erschienen in: Advanced Analytics and Learning on Temporal Data

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper we propose an outlier detection algorithm for temperature sensor data from jet engine tests. Effective identification of outliers would enable engine problems to be examined and resolved efficiently. Outlier detection in this data is challenging because a human controller determines the speed of the engine during each manoeuvre. This introduces variability which can mask abnormal behaviour in the engine response. We therefore suggest modelling the dependency between speed and temperature in the process of identifying abnormalities. The engine temperature has a delayed response with respect to the engine speed, which we will model using robust functional regression. We then apply functional depth with respect to the residuals to rank the samples and identify the outliers. The effectiveness of the outlier detection algorithm is shown in a simulation study. The algorithm is also applied to real engine data, and identifies samples that warrant further investigation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Agulló, J., Croux, C., Van Aelst, S.: The multivariate least-trimmed squares estimator. J. Multivar. Anal. 99(3), 311–338 (2008)MathSciNetCrossRef Agulló, J., Croux, C., Van Aelst, S.: The multivariate least-trimmed squares estimator. J. Multivar. Anal. 99(3), 311–338 (2008)MathSciNetCrossRef
2.
Zurück zum Zitat Arribas-Gil, A., Romo, J.: Shape outlier detection and visualization for functional data: the outliergram. Biostatistics 15(4), 603–619 (2014)CrossRef Arribas-Gil, A., Romo, J.: Shape outlier detection and visualization for functional data: the outliergram. Biostatistics 15(4), 603–619 (2014)CrossRef
3.
Zurück zum Zitat Bali, J.L., Boente, G., Tyler, D.E., Wang, J.L.: Robust functional principal components: a projection-pursuit approach. Ann. Stat. 39(6), 2852–2882 (2011)MathSciNetCrossRef Bali, J.L., Boente, G., Tyler, D.E., Wang, J.L.: Robust functional principal components: a projection-pursuit approach. Ann. Stat. 39(6), 2852–2882 (2011)MathSciNetCrossRef
4.
Zurück zum Zitat Boente, G., Salibian-Barrera, M.: S-estimators for functional principal component analysis. J. Am. Stat. Assoc. 110(511), 1100–1111 (2015)MathSciNetCrossRef Boente, G., Salibian-Barrera, M.: S-estimators for functional principal component analysis. J. Am. Stat. Assoc. 110(511), 1100–1111 (2015)MathSciNetCrossRef
5.
Zurück zum Zitat Chiou, J.M., Yang, Y.F., Chen, Y.T.: Multivariate functional linear regression and prediction. J. Multivar. Anal. 146, 301–312 (2016). Special Issue on Statistical Models and Methods for High or Infinite Dimensional SpacesMathSciNetCrossRef Chiou, J.M., Yang, Y.F., Chen, Y.T.: Multivariate functional linear regression and prediction. J. Multivar. Anal. 146, 301–312 (2016). Special Issue on Statistical Models and Methods for High or Infinite Dimensional SpacesMathSciNetCrossRef
6.
Zurück zum Zitat Cuevas, A., Febrero, M., Fraiman, R.: Robust estimation and classification for functional data via projection-based depth notions. Comput. Stat. 22(3), 481–496 (2007)MathSciNetCrossRef Cuevas, A., Febrero, M., Fraiman, R.: Robust estimation and classification for functional data via projection-based depth notions. Comput. Stat. 22(3), 481–496 (2007)MathSciNetCrossRef
7.
Zurück zum Zitat Dai, W., Genton, M.G.: Multivariate functional data visualization and outlier detection. J. Comput. Graph. Stat. 27(4), 923–934 (2018)MathSciNetCrossRef Dai, W., Genton, M.G.: Multivariate functional data visualization and outlier detection. J. Comput. Graph. Stat. 27(4), 923–934 (2018)MathSciNetCrossRef
8.
Zurück zum Zitat Febrero-Bande, M., Galeano, P., Gonzãlez-Manteiga, W.: Outlier detection in functional data by depth measures, with application to identify abnormal NOX levels. Environmetrics 19, 331–345 (2008)MathSciNetCrossRef Febrero-Bande, M., Galeano, P., Gonzãlez-Manteiga, W.: Outlier detection in functional data by depth measures, with application to identify abnormal NOX levels. Environmetrics 19, 331–345 (2008)MathSciNetCrossRef
9.
Zurück zum Zitat Hayton, P.M., Schölkopf, B., Tarassenko, L., Anuzis, P.: Support vector novelty detection applied to jet engine vibration spectra, pp. 946–952 (2001) Hayton, P.M., Schölkopf, B., Tarassenko, L., Anuzis, P.: Support vector novelty detection applied to jet engine vibration spectra, pp. 946–952 (2001)
10.
Zurück zum Zitat Hubert, M., Rousseeuw, P.J., Segaert, P.: Multivariate functional outlier detection. Stat. Methods Appl. 24(2), 177–202 (2015)MathSciNetCrossRef Hubert, M., Rousseeuw, P.J., Segaert, P.: Multivariate functional outlier detection. Stat. Methods Appl. 24(2), 177–202 (2015)MathSciNetCrossRef
11.
Zurück zum Zitat Ivanescu, A.E., Staicu, A.M., Scheipl, F., Greven, S.: Penalized function-on-function regression. Comput. Stat. 30(2), 539–568 (2015)MathSciNetCrossRef Ivanescu, A.E., Staicu, A.M., Scheipl, F., Greven, S.: Penalized function-on-function regression. Comput. Stat. 30(2), 539–568 (2015)MathSciNetCrossRef
12.
Zurück zum Zitat Matsui, H.: Quadratic regression for functional response models. arXiv e-prints (2017) Matsui, H.: Quadratic regression for functional response models. arXiv e-prints (2017)
13.
Zurück zum Zitat Morris, J.S.: Functional regression. Annual Rev. Stat. Appl. 2, 321–359 (2015)CrossRef Morris, J.S.: Functional regression. Annual Rev. Stat. Appl. 2, 321–359 (2015)CrossRef
14.
Zurück zum Zitat Nairac, A., Townsend, N.W., Carr, R., King, S., Cowley, P., Tarassenko, L.: A system for the analysis of jet engine vibration data. Integr. Comput. Aided Eng. 6, 53–66 (1999)CrossRef Nairac, A., Townsend, N.W., Carr, R., King, S., Cowley, P., Tarassenko, L.: A system for the analysis of jet engine vibration data. Integr. Comput. Aided Eng. 6, 53–66 (1999)CrossRef
15.
Zurück zum Zitat Nieto-Reyes, A., Battey, H.: A topologically valid definition of depth for functional data. Stat. Sci. 31(1), 61–79 (2016)MathSciNetCrossRef Nieto-Reyes, A., Battey, H.: A topologically valid definition of depth for functional data. Stat. Sci. 31(1), 61–79 (2016)MathSciNetCrossRef
16.
Zurück zum Zitat Ramsay, J.O., Dalzell, C.J.: Some tools for functional data analysis. J. Roy. Stat. Soc. Ser. B (Methodol.) 53(3), 539–572 (1991) MathSciNetMATH Ramsay, J.O., Dalzell, C.J.: Some tools for functional data analysis. J. Roy. Stat. Soc. Ser. B (Methodol.) 53(3), 539–572 (1991) MathSciNetMATH
18.
Zurück zum Zitat Rousseeuw, P.J., Driessen, K.V.: A fast algorithm for the minimum covariance determinant estimator. Technometrics 41(3), 212–223 (1999)CrossRef Rousseeuw, P.J., Driessen, K.V.: A fast algorithm for the minimum covariance determinant estimator. Technometrics 41(3), 212–223 (1999)CrossRef
19.
Zurück zum Zitat Rousseeuw, P.J., Raymaekers, J., Hubert, M.: A measure of directional outlyingness with applications to image data and video. J. Comput. Graph. Stat. 27(2), 345–359 (2018)MathSciNetCrossRef Rousseeuw, P.J., Raymaekers, J., Hubert, M.: A measure of directional outlyingness with applications to image data and video. J. Comput. Graph. Stat. 27(2), 345–359 (2018)MathSciNetCrossRef
20.
Zurück zum Zitat Scheipl, F., Staicu, A.M., Greven, S.: Functional additive mixed models. J. Comput. Graph. Stat. 24(2), 477–501 (2015)MathSciNetCrossRef Scheipl, F., Staicu, A.M., Greven, S.: Functional additive mixed models. J. Comput. Graph. Stat. 24(2), 477–501 (2015)MathSciNetCrossRef
21.
Zurück zum Zitat Shang, H.L.: A survey of functional principal component analysis. AStA Adv. Stat. Anal. 98(2), 121–142 (2014)MathSciNetCrossRef Shang, H.L.: A survey of functional principal component analysis. AStA Adv. Stat. Anal. 98(2), 121–142 (2014)MathSciNetCrossRef
23.
Zurück zum Zitat Yao, F., Müller, H.G., Wang, J.L., et al.: Functional linear regression analysis for longitudinal data. Ann. Stat. 33(6), 2873–2903 (2005)MathSciNetCrossRef Yao, F., Müller, H.G., Wang, J.L., et al.: Functional linear regression analysis for longitudinal data. Ann. Stat. 33(6), 2873–2903 (2005)MathSciNetCrossRef
Metadaten
Titel
Robust Functional Regression for Outlier Detection
verfasst von
Harjit Hullait
David S. Leslie
Nicos G. Pavlidis
Steve King
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-39098-3_1