Skip to main content
Top

2017 | OriginalPaper | Chapter

UniProv: A Flexible Provenance Tracking System for UNICORE

Authors : André Giesler, Myriam Czekala, Björn Hagemeier, Richard Grunzke

Published in: High-Performance Scientific Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper we present a flexible provenance management system called UniProv. UniProv is an ongoing development project providing provenance tracking in scientific workflows and data management particularly in the field of neuroscience, thus allowing users to validate and reproduce tasks and results of their experiments.
The primary goal is to equip the commonly used Grid middleware UNICORE [1] and its incorporated workflow engine with the provenance capturing mechanism of UniProv. We also explain an approach for using predefined patterns to ensure compatibility with the W3C PROV [2] Data Model and to map the provenance information properly to a neo4j graph database.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Streit, A., Bala, P., Beck-Ratzka, A., Benedyczak, K., et al.: UNICORE 6 - recent and future advancements. Ann. Telecommun. - annales des Télécommunications 65, 757–762 (2010). SpringerCrossRef Streit, A., Bala, P., Beck-Ratzka, A., Benedyczak, K., et al.: UNICORE 6 - recent and future advancements. Ann. Telecommun. - annales des Télécommunications 65, 757–762 (2010). SpringerCrossRef
4.
go back to reference Deelman, E., Gil, Y.: NSF Workshop on Challenges of Scientific Workflows. Technical report, NSF (2006) Deelman, E., Gil, Y.: NSF Workshop on Challenges of Scientific Workflows. Technical report, NSF (2006)
5.
go back to reference Wolstencroft, K., Haines, R., Fellows, D., Sufi, S., Goble, C., et al.: The Taverna workflow suite: designing and executing workflows of web services on the desktop, web or in the cloud. Nucleic Acids Res. 41(W1), W557–W561 (2013). doi:10.1093/nar/gkt328 CrossRef Wolstencroft, K., Haines, R., Fellows, D., Sufi, S., Goble, C., et al.: The Taverna workflow suite: designing and executing workflows of web services on the desktop, web or in the cloud. Nucleic Acids Res. 41(W1), W557–W561 (2013). doi:10.​1093/​nar/​gkt328 CrossRef
9.
go back to reference Benabdelkader, A., van Kampen, A.H.C., Olabarriaga, S.D.: PROV-man: a PROV-compliant toolkit for provenance management. PeerJ PrePr. 3, e1102 (2015)CrossRef Benabdelkader, A., van Kampen, A.H.C., Olabarriaga, S.D.: PROV-man: a PROV-compliant toolkit for provenance management. PeerJ PrePr. 3, e1102 (2015)CrossRef
10.
go back to reference Demuth, B., Schuller, B., Holl, S., Daivandy, J., Giesler, A., Huber, V., Sild, S.: The UNICORE Rich Client: facilitating the automated execution of scientific workflows. In: 2010 IEEE Sixth International Conference on e-Science (e-Science), pp. 238–245 (2010) Demuth, B., Schuller, B., Holl, S., Daivandy, J., Giesler, A., Huber, V., Sild, S.: The UNICORE Rich Client: facilitating the automated execution of scientific workflows. In: 2010 IEEE Sixth International Conference on e-Science (e-Science), pp. 238–245 (2010)
11.
go back to reference Amunts, K., Bücker, O., Axer, M.: Towards a multiscale, high-resolution model of the human brain. In: Grandinetti, L., Lippert, T., Petkov, N. (eds.) BrainComp 2013. LNCS, vol. 8603, pp. 3–14. Springer, Heidelberg (2014). doi:10.1007/978-3-319-12084-3_1 Amunts, K., Bücker, O., Axer, M.: Towards a multiscale, high-resolution model of the human brain. In: Grandinetti, L., Lippert, T., Petkov, N. (eds.) BrainComp 2013. LNCS, vol. 8603, pp. 3–14. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-12084-3_​1
12.
go back to reference Hagemeier, B., Giesler, A., Saini, R., Schuller, B., Buecker, O.: A workflow for polarized light imaging using UNICORE workflow services. In: UNICORE Summit, Poznan, Poland (2014) Hagemeier, B., Giesler, A., Saini, R., Schuller, B., Buecker, O.: A workflow for polarized light imaging using UNICORE workflow services. In: UNICORE Summit, Poznan, Poland (2014)
15.
go back to reference Miles, S., Groth, P., Deelman, E., Vahi, K., Mehta, G., Moreau, L.: Provenance: the bridge between experiments and data. Comput. Sci. Eng. 10, 38–46 (2008). AIP PublishingCrossRef Miles, S., Groth, P., Deelman, E., Vahi, K., Mehta, G., Moreau, L.: Provenance: the bridge between experiments and data. Comput. Sci. Eng. 10, 38–46 (2008). AIP PublishingCrossRef
16.
go back to reference Zhao, Y., Wilde, M., Foster, I.: Applying the virtual data provenance model. In: Moreau, L., Foster, I. (eds.) IPAW 2006. LNCS, vol. 4145, pp. 148–161. Springer, Heidelberg (2006). doi:10.1007/11890850_16 CrossRef Zhao, Y., Wilde, M., Foster, I.: Applying the virtual data provenance model. In: Moreau, L., Foster, I. (eds.) IPAW 2006. LNCS, vol. 4145, pp. 148–161. Springer, Heidelberg (2006). doi:10.​1007/​11890850_​16 CrossRef
17.
go back to reference McPhillips, T., Bowers, S., Belhajjame, K., Ludäscher, B.: Retrospective provenance without a runtime provenance recorder. In: Proceedings of TAPP 2014 (2015) McPhillips, T., Bowers, S., Belhajjame, K., Ludäscher, B.: Retrospective provenance without a runtime provenance recorder. In: Proceedings of TAPP 2014 (2015)
23.
go back to reference Korolev, V., Joshi, A., Korolev, V., Grasso, M.A., Joshi, A., et al.: PROB: a tool for tracking provenance and reproducibility of big data experiments. In: Reproduce 2014, HPCA 2014, vol. 11, pp. 264–286 (2014) Korolev, V., Joshi, A., Korolev, V., Grasso, M.A., Joshi, A., et al.: PROB: a tool for tracking provenance and reproducibility of big data experiments. In: Reproduce 2014, HPCA 2014, vol. 11, pp. 264–286 (2014)
24.
go back to reference De Nies, T., Magliacane, S., Verborgh, R., Coppens, S., Groth, P., Mannens, E., Van de Walle, R.: Git2PROV: exposing version control system content as W3C PROV. In: Proceedings of the 2013th International Conference on Posters & Demonstrations Track, vol. 1035, pp. 125–128 (2013) De Nies, T., Magliacane, S., Verborgh, R., Coppens, S., Groth, P., Mannens, E., Van de Walle, R.: Git2PROV: exposing version control system content as W3C PROV. In: Proceedings of the 2013th International Conference on Posters & Demonstrations Track, vol. 1035, pp. 125–128 (2013)
Metadata
Title
UniProv: A Flexible Provenance Tracking System for UNICORE
Authors
André Giesler
Myriam Czekala
Björn Hagemeier
Richard Grunzke
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-53862-4_20

Premium Partner