Skip to main content
Top
Published in: International Journal of Data Science and Analytics 4/2021

12-09-2021 | Application

A novel unsupervised method for anomaly detection in time series based on statistical features for industrial predictive maintenance

Authors: Jesimar da Silva Arantes, Márcio da Silva Arantes, Herberth Birck Fröhlich, Laure Siret, Renan Bonnard

Published in: International Journal of Data Science and Analytics | Issue 4/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Industrial production processes are increasingly collecting data from machines in operation due to the cost reduction and popularization of sensor technologies. Valuable information is generated by using the right sensors and proper techniques on the machine’s current state in operation. This extraction allows detecting whether the machine is operating in a degraded state and then, if necessary, interrupts its operation before it goes into a broken state. The detection of the abnormal behavior of a machine is relevant since detection at the right time can reduce financial costs due to machine breakdown and production downtime. This work proposes a novel unsupervised method to detect anomalies in industrial machines and interrupt their operation before this machine goes into a state of breakdown. The proposed method receives as input a set of time series data from several sensors. Using a collection of statistical features, it calculates an indicator that characterizes the failure’s severity, issuing an alert to the machine operator if necessary. The method was evaluated in two benchmarks with known univariate data and two proprietary datasets with multivariate data. Conducted experiments revealed the low computational time spent on training and on evaluation. Overall results measured in Area Under the Receiver Operating Characteristic Curve (AUC) in Yahoo’s benchmark were 89.3%; in Numenta, it was 70.3%, and in the two multivariate datasets evaluated, it was 92.4% and 91.2%. These high AUC values reveal the potential of the proposed method applied in predictive maintenance in a large soybean oil production industry.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ahmad, S., Lavin, A., Purdy, S., Agha, Z.: Unsupervised real-time anomaly detection for streaming data. Neurocomputing 262, 134–147 (2017)CrossRef Ahmad, S., Lavin, A., Purdy, S., Agha, Z.: Unsupervised real-time anomaly detection for streaming data. Neurocomputing 262, 134–147 (2017)CrossRef
2.
go back to reference Amarbayasgalan, T., Pham, V.H., Theera-Umpon, N., Ryu, K.H., et al.: Unsupervised anomaly detection approach for time-series in multi-domains using deep reconstruction error. Symmetry 12(8), 1251 (2020)CrossRef Amarbayasgalan, T., Pham, V.H., Theera-Umpon, N., Ryu, K.H., et al.: Unsupervised anomaly detection approach for time-series in multi-domains using deep reconstruction error. Symmetry 12(8), 1251 (2020)CrossRef
3.
go back to reference Anderson, M.J., Thompson, A.A.: Multivariate control charts for ecological and environmental monitoring. Ecol. Appl. 14(6), 1921–1935 (2004)CrossRef Anderson, M.J., Thompson, A.A.: Multivariate control charts for ecological and environmental monitoring. Ecol. Appl. 14(6), 1921–1935 (2004)CrossRef
4.
go back to reference Attoui, I., Oudjani, B., Boutasseta, N., Fergani, N., Bouakkaz, M.S., Bouraiou, A.: Novel predictive features using a wrapper model for rolling bearing fault diagnosis based on vibration signal analysis. Int. J. Adv. Manuf. Technol. 106(7–8), 3409–3435 (2020)CrossRef Attoui, I., Oudjani, B., Boutasseta, N., Fergani, N., Bouakkaz, M.S., Bouraiou, A.: Novel predictive features using a wrapper model for rolling bearing fault diagnosis based on vibration signal analysis. Int. J. Adv. Manuf. Technol. 106(7–8), 3409–3435 (2020)CrossRef
5.
go back to reference Blanchard, B.S., Verma, D.C., Peterson, E.L.: Maintainability: A Key to Effective Serviceability and Maintenance Management, vol. 13. Wiley, Hoboken (1995) Blanchard, B.S., Verma, D.C., Peterson, E.L.: Maintainability: A Key to Effective Serviceability and Maintenance Management, vol. 13. Wiley, Hoboken (1995)
6.
go back to reference Blázquez-García, A., Conde, A., Mori, U., Lozano, J.A.: A review on outlier/anomaly detection in time series data. arXiv preprint arXiv:2002.04236 (2020) Blázquez-García, A., Conde, A., Mori, U., Lozano, J.A.: A review on outlier/anomaly detection in time series data. arXiv preprint arXiv:​2002.​04236 (2020)
7.
go back to reference Carvalho, T.P., Soares, F.A., Vita, R., Francisco, Rd.P., Basto, J.P., Alcalá, S.G.: A systematic literature review of machine learning methods applied to predictive maintenance. Comput. Ind. Eng. 137, 106024 (2019)CrossRef Carvalho, T.P., Soares, F.A., Vita, R., Francisco, Rd.P., Basto, J.P., Alcalá, S.G.: A systematic literature review of machine learning methods applied to predictive maintenance. Comput. Ind. Eng. 137, 106024 (2019)CrossRef
8.
go back to reference Xy, Chen, Yy, Zhan: Multi-scale anomaly detection algorithm based on infrequent pattern of time series. J. Comput. Appl. Math. 214(1), 227–237 (2008)MathSciNetCrossRef Xy, Chen, Yy, Zhan: Multi-scale anomaly detection algorithm based on infrequent pattern of time series. J. Comput. Appl. Math. 214(1), 227–237 (2008)MathSciNetCrossRef
9.
go back to reference Dias, C.G., da Silva, L.C., Chabu, I.E.: Fuzzy-based statistical feature extraction for detecting broken rotor bars in line-fed and inverter-fed induction motors. Energies 12(12), 2381 (2019)CrossRef Dias, C.G., da Silva, L.C., Chabu, I.E.: Fuzzy-based statistical feature extraction for detecting broken rotor bars in line-fed and inverter-fed induction motors. Energies 12(12), 2381 (2019)CrossRef
10.
go back to reference Ding, N., Ma, H., Gao, H., Ma, Y., Tan, G.: Real-time anomaly detection based on long short-term memory and Gaussian mixture model. Comput. Electr. Eng. 79, 106458 (2019)CrossRef Ding, N., Ma, H., Gao, H., Ma, Y., Tan, G.: Real-time anomaly detection based on long short-term memory and Gaussian mixture model. Comput. Electr. Eng. 79, 106458 (2019)CrossRef
11.
go back to reference Fernandez-Temprano, M., Gardel-Sotomayor, P., Duque-Perez, O., Morinigo-Sotelo, D.: Broken bar condition monitoring of an induction motor under different supplies using a linear discriminant analysis. In: 9th IEEE International Symposium on Diagnostics for Electric Machines. Power Electronics and Drives (SDEMPED), pp. 162–168. IEEE (2013) Fernandez-Temprano, M., Gardel-Sotomayor, P., Duque-Perez, O., Morinigo-Sotelo, D.: Broken bar condition monitoring of an induction motor under different supplies using a linear discriminant analysis. In: 9th IEEE International Symposium on Diagnostics for Electric Machines. Power Electronics and Drives (SDEMPED), pp. 162–168. IEEE (2013)
12.
go back to reference Hochenbaum, J., Vallis, O.S., Kejariwal, A.: Automatic anomaly detection in the cloud via statistical learning. arXiv preprint arXiv:1704.07706 (2017) Hochenbaum, J., Vallis, O.S., Kejariwal, A.: Automatic anomaly detection in the cloud via statistical learning. arXiv preprint arXiv:​1704.​07706 (2017)
13.
go back to reference ISO: Condition monitoring and diagnostics of machines-general guidelines. Standard, International Organization for Standardization (2018) ISO: Condition monitoring and diagnostics of machines-general guidelines. Standard, International Organization for Standardization (2018)
14.
go back to reference Jimenez, J.J.M., Schwartz, S., Vingerhoeds, R., Grabot, B., Salaün, M.: Towards multi-model approaches to predictive maintenance: a systematic literature survey on diagnostics and prognostics. J. Manuf. Syst. 56, 539–557 (2020)CrossRef Jimenez, J.J.M., Schwartz, S., Vingerhoeds, R., Grabot, B., Salaün, M.: Towards multi-model approaches to predictive maintenance: a systematic literature survey on diagnostics and prognostics. J. Manuf. Syst. 56, 539–557 (2020)CrossRef
16.
go back to reference Kim, T.H., White, H.: On more robust estimation of skewness and kurtosis. Financ. Res. Lett. 1(1), 56–73 (2004)CrossRef Kim, T.H., White, H.: On more robust estimation of skewness and kurtosis. Financ. Res. Lett. 1(1), 56–73 (2004)CrossRef
18.
go back to reference Laptev, N., Amizadeh, S., Flint, I.: Generic and scalable framework for automated time-series anomaly detection. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1939–1947 (2015b) Laptev, N., Amizadeh, S., Flint, I.: Generic and scalable framework for automated time-series anomaly detection. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1939–1947 (2015b)
19.
go back to reference Lavin, A., Ahmad, S.: Evaluating real-time anomaly detection algorithms–the numenta anomaly benchmark. In: IEEE 14th International Conference on Machine Learning and Applications (ICMLA), pp. 38–44. IEEE (2015) Lavin, A., Ahmad, S.: Evaluating real-time anomaly detection algorithms–the numenta anomaly benchmark. In: IEEE 14th International Conference on Machine Learning and Applications (ICMLA), pp. 38–44. IEEE (2015)
20.
go back to reference Lee, J., Bagheri, B., Kao, H.: A cyber-physical systems architecture for industry 4.0-based manufacturing systems. Manuf. Lett. 3, 18–23 (2015)CrossRef Lee, J., Bagheri, B., Kao, H.: A cyber-physical systems architecture for industry 4.0-based manufacturing systems. Manuf. Lett. 3, 18–23 (2015)CrossRef
21.
go back to reference Munir, M., Siddiqui, S.A., Dengel, A., Ahmed, S.: DeepAnT: a deep learning approach for unsupervised anomaly detection in time series. IEEE Access 7, 1991–2005 (2018)CrossRef Munir, M., Siddiqui, S.A., Dengel, A., Ahmed, S.: DeepAnT: a deep learning approach for unsupervised anomaly detection in time series. IEEE Access 7, 1991–2005 (2018)CrossRef
22.
go back to reference Nemeth, T., Ansari, F., Sihn, W.: A maturity assessment procedure model for realizing knowledge-based maintenance strategies in smart manufacturing enterprises. Procedia Manuf. 39, 645–654 (2019)CrossRef Nemeth, T., Ansari, F., Sihn, W.: A maturity assessment procedure model for realizing knowledge-based maintenance strategies in smart manufacturing enterprises. Procedia Manuf. 39, 645–654 (2019)CrossRef
23.
go back to reference Olive, D.J.: Applied robust statistics. Preprint M-02-006 (2008) Olive, D.J.: Applied robust statistics. Preprint M-02-006 (2008)
24.
go back to reference Shukla, S., Yadav, R., Sharma, J., Khare, S.: Analysis of statistical features for fault detection in ball bearing. In: IEEE International Conference on Computational Intelligence and Computing Research (ICCIC), pp. 1–8. IEEE (2015) Shukla, S., Yadav, R., Sharma, J., Khare, S.: Analysis of statistical features for fault detection in ball bearing. In: IEEE International Conference on Computational Intelligence and Computing Research (ICCIC), pp. 1–8. IEEE (2015)
25.
go back to reference Stern, S., Farioli, S., Eisenschmidt, E., Morachioli, S., Kienzler, C., Jeske, D., Schaal, N.: The future of maintenance for distributed fixed assets. Technical report, McKinsey Company In collaboration with Lumics (2020) Stern, S., Farioli, S., Eisenschmidt, E., Morachioli, S., Kienzler, C., Jeske, D., Schaal, N.: The future of maintenance for distributed fixed assets. Technical report, McKinsey Company In collaboration with Lumics (2020)
26.
go back to reference Sullivan, G. P, Pugh, R., Melendez, A. P.: Operations and maintenance best practices—a guide to achieving operational efficiency. Technical report, Pacific Northwest National Lab., Richland, WA (US) (2002) Sullivan, G. P, Pugh, R., Melendez, A. P.: Operations and maintenance best practices—a guide to achieving operational efficiency. Technical report, Pacific Northwest National Lab., Richland, WA (US) (2002)
27.
go back to reference Susto, G.A., Schirru, A., Pampuri, S., McLoone, S., Beghi, A.: Machine learning for predictive maintenance: a multiple classifier approach. IEEE Trans. Ind. Inf. 11(3), 812–820 (2014)CrossRef Susto, G.A., Schirru, A., Pampuri, S., McLoone, S., Beghi, A.: Machine learning for predictive maintenance: a multiple classifier approach. IEEE Trans. Ind. Inf. 11(3), 812–820 (2014)CrossRef
28.
go back to reference Wang, J., Zhao, R., Gao, R.X.: Probabilistic transfer factor analysis for machinery autonomous diagnosis cross various operating conditions. IEEE Trans. Instrum. Meas. 69, 5335–5344 (2020)CrossRef Wang, J., Zhao, R., Gao, R.X.: Probabilistic transfer factor analysis for machinery autonomous diagnosis cross various operating conditions. IEEE Trans. Instrum. Meas. 69, 5335–5344 (2020)CrossRef
29.
go back to reference Wu, J., Zeng, W., Yan, F.: Hierarchical temporal memory method for time-series-based anomaly detection. Neurocomputing 273, 535–546 (2018)CrossRef Wu, J., Zeng, W., Yan, F.: Hierarchical temporal memory method for time-series-based anomaly detection. Neurocomputing 273, 535–546 (2018)CrossRef
30.
go back to reference Xia, Z., Xia, S., Wan, L., Cai, S.: Spectral regression based fault feature extraction for bearing accelerometer sensor signals. Sensors 12(10), 13694–13719 (2012)CrossRef Xia, Z., Xia, S., Wan, L., Cai, S.: Spectral regression based fault feature extraction for bearing accelerometer sensor signals. Sensors 12(10), 13694–13719 (2012)CrossRef
31.
go back to reference Yaacob, A. H., Tan, I. K., Chien SF, Tan, H. K.: Arima based network anomaly detection. In: Second International Conference on Communication Software and Networks, pp. 205–209. IEEE (2010) Yaacob, A. H., Tan, I. K., Chien SF, Tan, H. K.: Arima based network anomaly detection. In: Second International Conference on Communication Software and Networks, pp. 205–209. IEEE (2010)
32.
go back to reference Zheng, D., Li, F., Zhao, T.: Self-adaptive statistical process control for anomaly detection in time series. Expert Syst. Appl. 57, 324–336 (2016)CrossRef Zheng, D., Li, F., Zhao, T.: Self-adaptive statistical process control for anomaly detection in time series. Expert Syst. Appl. 57, 324–336 (2016)CrossRef
Metadata
Title
A novel unsupervised method for anomaly detection in time series based on statistical features for industrial predictive maintenance
Authors
Jesimar da Silva Arantes
Márcio da Silva Arantes
Herberth Birck Fröhlich
Laure Siret
Renan Bonnard
Publication date
12-09-2021
Publisher
Springer International Publishing
Published in
International Journal of Data Science and Analytics / Issue 4/2021
Print ISSN: 2364-415X
Electronic ISSN: 2364-4168
DOI
https://doi.org/10.1007/s41060-021-00283-z

Other articles of this Issue 4/2021

International Journal of Data Science and Analytics 4/2021 Go to the issue

Premium Partner