Skip to main content
Top

2021 | OriginalPaper | Chapter

The Dataflow Runtime Environment of DFC

Authors : Jing Zhang, Jinrong Li, Zheng Du, Jiwu Shu, Qiuming Luo

Published in: Parallel and Distributed Computing, Applications and Technologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we introduce the DFC dataflow language and its runtime environment. DFC runtime library is in charge of constructing the DAG of the dataflow graph, firing the DFC tasks and the synchronizations between the tasks of successive passes. Basing on an elaborately implemented thread pool and queued Active Data, DFC runtime shows an ideal performance comparing with DSPatch. The experiment of a simple dataflow graph shows that DFC has better performance for the cases that the parallelism beneath the core number, while DSPatch shows a better scalability for the cases of the parallelism exceed the core number. As DFC is still a prototype language, it lacks the ability to construct the DAG dynamically, which leads to low efficiency when coding for a well-structured dataflow graph.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Sterling, T., Brodowicz, M., Anderson, M.: High Performance Computing: Modern Systems and Practices, Morgan Kaufmann, pp. 616–618 (2018) Sterling, T., Brodowicz, M., Anderson, M.: High Performance Computing: Modern Systems and Practices, Morgan Kaufmann, pp. 616–618 (2018)
6.
go back to reference Portero, A., Yu, Z., Giorgi, R.: Teraflux: exploiting tera-device computing challenges. Procedia CS 7, 146–147 (2011) Portero, A., Yu, Z., Giorgi, R.: Teraflux: exploiting tera-device computing challenges. Procedia CS 7, 146–147 (2011)
8.
go back to reference Chavarrias, M., Pescador, F., Juárez, E., Garrido, M.J.: An automatic tool for the static distribution of actors in RVC-CAL based multicore designs, pp. 1–6. Design of Circuits and Integrated Systems, Madrid (2014) Chavarrias, M., Pescador, F., Juárez, E., Garrido, M.J.: An automatic tool for the static distribution of actors in RVC-CAL based multicore designs, pp. 1–6. Design of Circuits and Integrated Systems, Madrid (2014)
9.
go back to reference Lin, H., Lin, Z., Diaz, J.M., Li, M., An, H., Gao, G.R.: swFLOW: a dataflow deep learning framework on sunway taihulight supercomputer. In: 2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS), Zhangjiajie, China, 2019, pp. 2467–2475 (2019) Lin, H., Lin, Z., Diaz, J.M., Li, M., An, H., Gao, G.R.: swFLOW: a dataflow deep learning framework on sunway taihulight supercomputer. In: 2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS), Zhangjiajie, China, 2019, pp. 2467–2475 (2019)
10.
go back to reference Du, Z., Zhang, J., Sha, S., Luo, Q.: Implementing the matrix multiplication with DFC on kunlun small scale computer. In: 2019 20th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT), Gold Coast, Australia, 2019, pp. 115–120 (2019) Du, Z., Zhang, J., Sha, S., Luo, Q.: Implementing the matrix multiplication with DFC on kunlun small scale computer. In: 2019 20th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT), Gold Coast, Australia, 2019, pp. 115–120 (2019)
Metadata
Title
The Dataflow Runtime Environment of DFC
Authors
Jing Zhang
Jinrong Li
Zheng Du
Jiwu Shu
Qiuming Luo
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-69244-5_5

Premium Partner