Skip to main content
Top

2018 | OriginalPaper | Chapter

Capturing Provenance for Runtime Data Analysis in Computational Science and Engineering Applications

Authors : Vítor Silva, Renan Souza, Jose Camata, Daniel de Oliveira, Patrick Valduriez, Alvaro L. G. A. Coutinho, Marta Mattoso

Published in: Provenance and Annotation of Data and Processes

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Capturing provenance data for runtime analysis has several challenges in high performance computational science engineering applications. The main issues are avoiding significant overhead in data capture, loading and runtime query support; and coupling provenance capture mechanisms with applications built with highly efficient numerical libraries, and visualization frameworks targeted to high performance environments. This work presents DfA-prov, an approach to capture provenance data and domain data aiming at high performance applications.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Rüde, U., Willcox, K., McInnes, L.C., Sterck, H.D., Biros, G., et al.: Research and Education in Computational Science and Engineering. CoRR. abs/1610.02608 (2016) Rüde, U., Willcox, K., McInnes, L.C., Sterck, H.D., Biros, G., et al.: Research and Education in Computational Science and Engineering. CoRR. abs/1610.02608 (2016)
3.
go back to reference Bernholdt, D., Dubey, A., Heroux, M., Klinvex, A., McInnes, L.C.: Improving reproducibility through better software practices. In: SIAM Conference on CSE, Atlanta, GA (2017) Bernholdt, D., Dubey, A., Heroux, M., Klinvex, A., McInnes, L.C.: Improving reproducibility through better software practices. In: SIAM Conference on CSE, Atlanta, GA (2017)
4.
go back to reference Alnæs, M., Blechta, J., Hake, J., Johansson, A., Kehlet, B., et al.: Archive of Numerical Software: The FEniCS Project Version 1.5. University Library Heidelberg (2015) Alnæs, M., Blechta, J., Hake, J., Johansson, A., Kehlet, B., et al.: Archive of Numerical Software: The FEniCS Project Version 1.5. University Library Heidelberg (2015)
6.
go back to reference Moreau, L., Batlajery, B.V., Huynh, T.D., Michaelides, D., Packer, H.: A templating system to generate provenance. IEEE Trans. Softw. Eng. 44, 103–121 (2018)CrossRef Moreau, L., Batlajery, B.V., Huynh, T.D., Michaelides, D., Packer, H.: A templating system to generate provenance. IEEE Trans. Softw. Eng. 44, 103–121 (2018)CrossRef
7.
go back to reference Pimentel, J.F., Murta, L., Braganholo, V., Freire, J.: noWorkflow: a tool for collecting, analyzing, and managing provenance from python scripts. PVLDB 10, 1841–1844 (2017) Pimentel, J.F., Murta, L., Braganholo, V., Freire, J.: noWorkflow: a tool for collecting, analyzing, and managing provenance from python scripts. PVLDB 10, 1841–1844 (2017)
8.
go back to reference Miles, S., Groth, P., Munroe, S., Moreau, L.: PrIMe: a methodology for developing provenance-aware applications. ACM Trans. Softw. Eng. Methodol. 20, 1–42 (2011)CrossRef Miles, S., Groth, P., Munroe, S., Moreau, L.: PrIMe: a methodology for developing provenance-aware applications. ACM Trans. Softw. Eng. Methodol. 20, 1–42 (2011)CrossRef
9.
go back to reference Silva, V., De Oliveira, D., Valduriez, P., Mattoso, M.: DfAnalyzer: runtime dataflow analysis of scientific applications using provenance. In: PVLDB, Rio de Janeiro, Brazil (2018) Silva, V., De Oliveira, D., Valduriez, P., Mattoso, M.: DfAnalyzer: runtime dataflow analysis of scientific applications using provenance. In: PVLDB, Rio de Janeiro, Brazil (2018)
10.
go back to reference Camata, J.J., Silva, V., Valduriez, P., Mattoso, M., Coutinho, A.L.G.A.: In situ visualization and data analysis for turbidity currents simulation. Comput. Geosci. 110, 23–31 (2018)CrossRef Camata, J.J., Silva, V., Valduriez, P., Mattoso, M., Coutinho, A.L.G.A.: In situ visualization and data analysis for turbidity currents simulation. Comput. Geosci. 110, 23–31 (2018)CrossRef
Metadata
Title
Capturing Provenance for Runtime Data Analysis in Computational Science and Engineering Applications
Authors
Vítor Silva
Renan Souza
Jose Camata
Daniel de Oliveira
Patrick Valduriez
Alvaro L. G. A. Coutinho
Marta Mattoso
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-98379-0_15

Premium Partner