Skip to main content

2020 | OriginalPaper | Buchkapitel

Use Machine Learning Methods to Predict Lifetimes of Storage Devices

verfasst von : Yingxuan Zhu, Bowen Jiang, Yong Wang, Tim Tingqiu Yuan, Jian Li

Erschienen in: Performance Evaluation and Benchmarking for the Era of Cloud(s)

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Erase count is a key performance indicator of hard drives, and it shows the lifetime of a device. Analysis of erase counts helps us understand the performance of a device and prevent the failure of it. In this paper, a machine learning based framework is proposed to predict the curves of erase counts. Specifically, probabilities and erase-count curves of different hard drives are first calculated from training data. The probabilities are for deciding disk type in testing data. The erase-count curves from training data serve as references to testing data. Long short-term memory is utilized to model the erase-count difference between a reference device and a testing device, and to predict the lifetime of the testing device. Preliminary results of synthetic data show that our method can follow references and precisely predict erase counts.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Anantharaman, P., Qiao, M., Jadav, D.: Large scale predictive analytics for hard disk remaining useful life estimation. In: Proceedings of the IEEE International Congress on Big Data, July 2018 Anantharaman, P., Qiao, M., Jadav, D.: Large scale predictive analytics for hard disk remaining useful life estimation. In: Proceedings of the IEEE International Congress on Big Data, July 2018
2.
Zurück zum Zitat Botezatu, M.M., Giurgiu, I., Bogojeska, J., Wiesmann, D.: Predicting disk replacement towards reliable data centers. In: Proceedings of the 2016 ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, August 2016, New York, NY. ACM Press (2016) Botezatu, M.M., Giurgiu, I., Bogojeska, J., Wiesmann, D.: Predicting disk replacement towards reliable data centers. In: Proceedings of the 2016 ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, August 2016, New York, NY. ACM Press (2016)
4.
Zurück zum Zitat dos Santos Lima, F.D., Amaral, G.M.R., de Moura Leite, L.G., Gomes, J.P.P., de Castro Machado, J.: Predicting failures in hard drives with LSTM networks. In: Proceedings of the 2017 Brazilian Conference on Intelligent Systems, pp. 222–227, October 2017 dos Santos Lima, F.D., Amaral, G.M.R., de Moura Leite, L.G., Gomes, J.P.P., de Castro Machado, J.: Predicting failures in hard drives with LSTM networks. In: Proceedings of the 2017 Brazilian Conference on Intelligent Systems, pp. 222–227, October 2017
6.
Zurück zum Zitat Hamerly, G., Elkan, C.: Bayesian approaches to failure prediction for disk drives. In: Proceedings of the International Conference on Machine Learning, San Francisco, CA, June 2001, pp. 202–209. Morgan Kaufmann Publishers Inc. (2001) Hamerly, G., Elkan, C.: Bayesian approaches to failure prediction for disk drives. In: Proceedings of the International Conference on Machine Learning, San Francisco, CA, June 2001, pp. 202–209. Morgan Kaufmann Publishers Inc. (2001)
7.
Zurück zum Zitat Hughes, G.F., Murray, J.F., Kreutz-Delgado, K., Elkan, C.: Improved disk-drive failure warnings. IEEE Trans. Reliab. 51(3), 350–357 (2002)CrossRef Hughes, G.F., Murray, J.F., Kreutz-Delgado, K., Elkan, C.: Improved disk-drive failure warnings. IEEE Trans. Reliab. 51(3), 350–357 (2002)CrossRef
10.
Zurück zum Zitat Meza, J., Wu, Q., Kumar, S., Mutlu, O.: A large-scale study of flash memory failures in the field. In: Proceedings of the 2015 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer System, June 2015 Meza, J., Wu, Q., Kumar, S., Mutlu, O.: A large-scale study of flash memory failures in the field. In: Proceedings of the 2015 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer System, June 2015
11.
Zurück zum Zitat Murray, J.F., Hughes, G.F., Kreutz-Delgado, K.: Machine learning methods for predicting failures in hard drives: a multiple-instance application. J. Mach. Learn. Res. 6, 783–816 (2005)MathSciNetMATH Murray, J.F., Hughes, G.F., Kreutz-Delgado, K.: Machine learning methods for predicting failures in hard drives: a multiple-instance application. J. Mach. Learn. Res. 6, 783–816 (2005)MathSciNetMATH
12.
Zurück zum Zitat Narayanan, I., et al.: SSD failures in datacenters: what? when? and why? In: Proceedings of the 9th ACM International on Systems and Storage Conference, June 2016 Narayanan, I., et al.: SSD failures in datacenters: what? when? and why? In: Proceedings of the 9th ACM International on Systems and Storage Conference, June 2016
14.
Zurück zum Zitat Schroeder, B., Merchant, A., Lagisetty, R.: Reliability of nand-based SSDS: what field studies tell us. In: Proceedings of the IEEE, vol. 105, pp. 1751–1769. IEEE, September 2017 Schroeder, B., Merchant, A., Lagisetty, R.: Reliability of nand-based SSDS: what field studies tell us. In: Proceedings of the IEEE, vol. 105, pp. 1751–1769. IEEE, September 2017
15.
Zurück zum Zitat Shu, G., Jang, J.E.: Proactive storage health management to reduce data center downtime, December 2017 Shu, G., Jang, J.E.: Proactive storage health management to reduce data center downtime, December 2017
Metadaten
Titel
Use Machine Learning Methods to Predict Lifetimes of Storage Devices
verfasst von
Yingxuan Zhu
Bowen Jiang
Yong Wang
Tim Tingqiu Yuan
Jian Li
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-55024-0_11

Neuer Inhalt