Skip to main content
Top

2017 | OriginalPaper | Chapter

11. Parallel Computing

Authors : Laura Igual, Santi Seguí

Published in: Introduction to Data Science

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this chapter, we will introduce the parallel capabilities of IPython that, through applying a set of techniques, reduce execution time drastically. In a non-computational example, if one painter would spend T units of time painting a house, having N painters can reduce the total time to T/N units of time. As will be shown, two ways of scaling the computational units can be chosen: multicore or distributed computing. IPython hides the differences between them to the programmer; the same commands can be used in both. The ways of sending tasks to computing units will be introduced with the direct and balanced interfaces. Finally, an example with a database made up of millions of entries will show the advantages of parallelism.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
For a more detailed description please see http://​ipyparallel.​readthedocs.​io/​en/​stable/​intro.​html. Last seen July 2016.
 
2
More information on ipcluster profiles can be found at http://​ipython.​readthedocs.​io/​en/​stable/​.
 
4
Changing this behavior is beyond the scope of this chapter. You can find more details here: http://​ipyparallel.​readthedocs.​io/​en/​stable/​task.​html#schedulers. Last seen November 2015.
 
Literature
1.
go back to reference M. Herlihy, N. Shavit, The art of multiprocessor programming (Morgan Kaufmann, 2008) M. Herlihy, N. Shavit, The art of multiprocessor programming (Morgan Kaufmann, 2008)
2.
go back to reference T.K.G.B.G. Coulouris, J. Dollimore, Distributed Systems (Pearson, 2012) T.K.G.B.G. Coulouris, J. Dollimore, Distributed Systems (Pearson, 2012)
Metadata
Title
Parallel Computing
Authors
Laura Igual
Santi Seguí
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-50017-1_11

Premium Partner