Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Editors’ Introduction and Roadmap Read chapter Read first chapter

2018 | OriginalPaper | Chapter

Scheduling for Fault-Tolerance: An Introduction

Authors : Guillaume Aupy, Yves Robert

Published in: Topics in Parallel and Distributed Computing

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Parallel execution time is expected to decrease as the number of processors increases. We show in this chapter that this is not as easy as it seems, even for perfectly parallel applications. In particular, processors are subject to faults. The more processors are available, the more likely faults will strike during execution. The main strategy to cope with faults in High Performance Computing is checkpointing. We introduce the reader to this approach, and explain how to determine the optimal checkpointing period through scheduling techniques. We also detail how to combine checkpointing with prediction and with replication.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Energy Efficiency Issues in Computing Systems
next chapter MapReduce – The Scalable Distributed Data Processing Solution
Appendix
Available only for authorised users
Footnotes
1
As a side note, one needs only 23 persons for the probability of a common birthday to reach 0.5 (a question often asked in geek evenings).
 
2
By the way, there is a nice little exercise in “Appendix 6: Scheduling a Linear Chain of Tasks” if you are motivated to help.
 
Literature
1.
G. Aupy, Y. Robert, F. Vivien, and D. Zaidouni. Checkpointing strategies with prediction windows. In Dependable Computing (PRDC), 2013 IEEE 19th Pacific Rim International Symposium on, pages 1–10. IEEE, 2013.
2.
G. Aupy, Y. Robert, F. Vivien, and D. Zaidouni. Checkpointing algorithms and fault prediction. Journal of Parallel and Distributed Computing, 74(2):2048–2064, 2014.CrossRef
3.
M. Bougeret, H. Casanova, M. Rabie, Y. Robert, and F. Vivien. Checkpointing strategies for parallel jobs. In Proceedings of SC’11, 2011.
4.
F. Cappello, A. Geist, B. Gropp, L. V. Kalé, B. Kramer, and M. Snir. Toward Exascale Resilience. Int. Journal of High Performance Computing Applications, 23(4):374–388, 2009.CrossRef
5.
H. Casanova, Y. Robert, F. Vivien, and D. Zaidouni. Combining process replication and checkpointing for resilience on exascale systems. Research report RR-7951, INRIA, May 2012.
6.
J. T. Daly. A higher order estimate of the optimum checkpoint interval for restart dumps. FGCS, 22(3):303–312, 2004.CrossRef
7.
C. Engelmann, H. H. Ong, and S. L. Scorr. The case for modular redundancy in large-scale highh performance computing systems. In Proc. of the 8th IASTED Infernational Conference on Parallel and Distributed Computing and Networks (PDCN), pages 189–194, 2009.
8.
K. Ferreira, J. Stearley, J. H. I. Laros, R. Oldfield, K. Pedretti, R. Brightwell, R. Riesen, P. G. Bridges, and D. Arnold. Evaluating the Viability of Process Replication Reliability for Exascale Systems. In Proc. of the ACM/IEEE SC Conf., 2011.
9.
P. Flajolet, P. J. Grabner, P. Kirschenhofer, and H. Prodinger. On Ramanujan’s Q-Function. J. Computational and Applied Mathematics, 58:103–116, 1995.MathSciNetCrossRef
10.
A. Gainaru, F. Cappello, and W. Kramer. Taming of the shrew: Modeling the normal and faulty behavior of large-scale hpc systems. In Proc. IPDPS’12, 2012.
11.
A. Gainaru, F. Cappello, M. Snir, and W. Kramer. Failure prediction for hpc systems and applications: Current situation and open issues. Int. J. High Perform. Comput. Appl., 27(3):273–282, 2013.CrossRef
12.
F. Gärtner. Fundamentals of fault-tolerant distributed computing in asynchronous environments. ACM Computing Surveys, 31(1), 1999.CrossRef
13.
T. Hérault and Y. Robert, editors. Fault-Tolerance Techniques for High-Performance Computing, Computer Communications and Networks. Springer Verlag, 2015.
14.
O. Kella and W. Stadje. Superposition of renewal processes and an application to multi-server queues. Statistics & probability letters, 76(17):1914–1924, 2006.MathSciNetCrossRef
15.
D. Kondo, A. Chien, and H. Casanova. Scheduling Task Parallel Applications for Rapid Application Turnaround on Enterprise Desktop Grids. J. Grid Computing, 5(4):379–405, 2007.CrossRef
16.
S. M. Ross. Introduction to Probability Models, Eleventh Edition. Academic Press, 2009.
17.
B. Schroeder and G. Gibson. Understanding failures in petascale computers. Journal of Physics: Conference Series, 78(1), 2007.
18.
J. W. Young. A first order approximation to the optimum checkpoint interval. Comm. of the ACM, 17(9):530–531, 1974.CrossRef
19.
L. Yu, Z. Zheng, Z. Lan, and S. Coghlan. Practical online failure prediction for blue gene/p: Period-based vs event-driven. In Dependable Systems and Networks Workshops (DSN-W), pages 259–264, 2011.
20.
Z. Zheng and Z. Lan. Reliability-aware scalability models for high performance computing. In Proc. of the IEEE Conference on Cluster Computing, 2009.
21.
Z. Zheng, Z. Lan, R. Gupta, S. Coghlan, and P. Beckman. A practical failure prediction with location and lead time for blue gene/p. In Dependable Systems and Networks Workshops (DSN-W), pages 15–22, 2010.
Metadata
Title
Scheduling for Fault-Tolerance: An Introduction
Authors
Guillaume Aupy
Yves Robert
Copyright Year
2018
Book
Topics in Parallel and Distributed Computing

Print ISBN: 978-3-319-93108-1

Electronic ISBN: 978-3-319-93109-8

Copyright Year: 2018

DOI
https://doi.org/10.1007/978-3-319-93109-8_6

Premium Partner

    Image Credits