Skip to main content
Erschienen in: Datenbank-Spektrum 3/2015

01.11.2015 | SCHWERPUNKTBEITRAG

VAT: A System for Visualizing, Analyzing and Transforming Spatial Data in Science

verfasst von: Christian Authmann, Christian Beilschmidt, Johannes Drönner, Michael Mattig, Bernhard Seeger

Erschienen in: Datenbank-Spektrum | Ausgabe 3/2015

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The amount of available data changes the style of research in geo-scientific domains, and thus influences the requirements for spatial processing systems. To support data-driven research and exploratory workflows, we propose the Visualization, Analysis & Transformation system (VAT). We first identify ten fundamental requirements, which span from supporting spatial data types over low latency computations to visualization techniques. Based on these we evaluate state-of-the-art systems from the domains of spatial frameworks, GIS, workflow systems, scientific databases and Big Data solutions. The goal of the VAT system is to overcome the identified limitations by a holistic approach to raster and vector data, demand-driven and tiled processing, and the efficient usage of heterogeneous hardware architectures. A first comparison with other systems shows the validity of our approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Aji A, Wang F, Vo H et al (2013) Hadoop-GIS: a High Performance Spatial Data Warehousing System over MapReduce. Proceedings VLDB Endowment 6(11): 1009-1020 Aji A, Wang F, Vo H et al (2013) Hadoop-GIS: a High Performance Spatial Data Warehousing System over MapReduce. Proceedings VLDB Endowment 6(11): 1009-1020
2.
Zurück zum Zitat Andrienko G, Andrienko N, Demsar U, Dransch D, Dykes J, Fabrikant SI, Jern M, Kraak MJ, Schumann H, Tominski C (2010) Space, time and visual analytics. Int J Geogr Inf Sci 24(10):1577–1600 Andrienko G, Andrienko N, Demsar U, Dransch D, Dykes J, Fabrikant SI, Jern M, Kraak MJ, Schumann H, Tominski C (2010) Space, time and visual analytics. Int J Geogr Inf Sci 24(10):1577–1600
3.
Zurück zum Zitat Authmann C, Beilschmidt C, Drönner J, Mattig M, Seeger B (2015) Rethinking Spatial Processing in Data-Intensive Science. BTW 2015 Workshop Authmann C, Beilschmidt C, Drönner J, Mattig M, Seeger B (2015) Rethinking Spatial Processing in Data-Intensive Science. BTW 2015 Workshop
4.
Zurück zum Zitat Bach K, Schäfer D, Enke N et al (2012) A comparative evaluation of technical solutions for long-term data repositories in integrative biodiversity research. Ecological Informatics 11:16–24 Bach K, Schäfer D, Enke N et al (2012) A comparative evaluation of technical solutions for long-term data repositories in integrative biodiversity research. Ecological Informatics 11:16–24
5.
Zurück zum Zitat Baumann P, Dehmel A, Furtado P et al (1998) The Multidimensional Database System RasDaMan. In: ACM SIGMOD Conference '98, pp. 575–577. ACM Baumann P, Dehmel A, Furtado P et al (1998) The Multidimensional Database System RasDaMan. In: ACM SIGMOD Conference '98, pp. 575–577. ACM
6.
Zurück zum Zitat Baumgärtner L, Strack C, Hossbach B, Seidemann M, Seeger B, Freisleben B (2015) Complex Event Processing for Reactive Security Monitoring in Virtualized Computer Systems. The 9th ACM International Conference on Distributed Event-Based Systems Baumgärtner L, Strack C, Hossbach B, Seidemann M, Seeger B, Freisleben B (2015) Complex Event Processing for Reactive Security Monitoring in Virtualized Computer Systems. The 9th ACM International Conference on Distributed Event-Based Systems
7.
Zurück zum Zitat Bose R, Frew J (2005) Lineage retrieval for scientific data processing: a survey. ACM Computing Surveys 37 (CSUR) (1):1–28 Bose R, Frew J (2005) Lineage retrieval for scientific data processing: a survey. ACM Computing Surveys 37 (CSUR) (1):1–28
8.
Zurück zum Zitat Brown PG (2010) Overview of sciDB: large scale array storage, processing and analysis. In: Proc. of the ACM SIGMOD Conference, pp. 963–968 Brown PG (2010) Overview of sciDB: large scale array storage, processing and analysis. In: Proc. of the ACM SIGMOD Conference, pp. 963–968
9.
Zurück zum Zitat Corvalan C, Hales S, McMichael AJ (2005) Ecosystems and human well-being: health synthesis. World health organization Corvalan C, Hales S, McMichael AJ (2005) Ecosystems and human well-being: health synthesis. World health organization
10.
Zurück zum Zitat Cuevas-Vicenttín V, Dey S et al Scientific Workflows and Provenance: Introduction and Research Opportunities. Datenbank-Spektrum 12 (3), 193–203 (2012) Cuevas-Vicenttín V, Dey S et al Scientific Workflows and Provenance: Introduction and Research Opportunities. Datenbank-Spektrum 12 (3), 193–203 (2012)
11.
Zurück zum Zitat Dean J, Ghemawat S (2008) Mapreduce. Comm. of the ACM 51(1):107 Dean J, Ghemawat S (2008) Mapreduce. Comm. of the ACM 51(1):107
12.
Zurück zum Zitat Diepenbroek M, Glöckner F, Grobe P et al (2014) Towards an Integrated Biodiversity and Ecological Research Data Management and Archiving Platform: The German Federation for the Curation of Biological Data (GFBio). GI: Informatik 2014 – Big Data Komplexität meistern Diepenbroek M, Glöckner F, Grobe P et al (2014) Towards an Integrated Biodiversity and Ecological Research Data Management and Archiving Platform: The German Federation for the Curation of Biological Data (GFBio). GI: Informatik 2014 – Big Data Komplexität meistern
13.
Zurück zum Zitat Garcia-Molina H, Ullman JD, Widom J (2000) Database system implementation, vol. 654. Prentice Hall Upper Saddle River, NJ Garcia-Molina H, Ullman JD, Widom J (2000) Database system implementation, vol. 654. Prentice Hall Upper Saddle River, NJ
14.
Zurück zum Zitat Hey AJ, Tansley S, Tolle KM et al (2009) The Fourth Paradigm: Data-Intensive Scientific Discovery, vol. 1. Microsoft Research Redmond, WA Hey AJ, Tansley S, Tolle KM et al (2009) The Fourth Paradigm: Data-Intensive Scientific Discovery, vol. 1. Microsoft Research Redmond, WA
15.
Zurück zum Zitat Hijmans RJ, Cameron SE, Parra JL et al (2005) Very high resolution interpolated climate surfaces for global land areas. Int J Climatol 25(15):1965–1978 Hijmans RJ, Cameron SE, Parra JL et al (2005) Very high resolution interpolated climate surfaces for global land areas. Int J Climatol 25(15):1965–1978
16.
Zurück zum Zitat Jetz W, McPherson JM, Guralnick RP (2012) Integrating biodiversity distribution knowledge: toward a global map of life. Trends Ecol & Evol 27(3):151–159 Jetz W, McPherson JM, Guralnick RP (2012) Integrating biodiversity distribution knowledge: toward a global map of life. Trends Ecol & Evol 27(3):151–159
17.
Zurück zum Zitat Kini A, Emanuele R (2014) Geotrellis: Adding Geospatial Capabilities to Spark. Spark Summit 2014 Kini A, Emanuele R (2014) Geotrellis: Adding Geospatial Capabilities to Spark. Spark Summit 2014
18.
Zurück zum Zitat Kyriazis G (2012) Heterogeneous system architecture: a technical review. AMD Fusion Developer Summit Kyriazis G (2012) Heterogeneous system architecture: a technical review. AMD Fusion Developer Summit
19.
Zurück zum Zitat Lam C (2010) Hadoop in Action, 1st edn. Manning Pub., Greenwich, CT, USA Lam C (2010) Hadoop in Action, 1st edn. Manning Pub., Greenwich, CT, USA
20.
Zurück zum Zitat Manyika J, Chui M, Brown B et al (2011) Big data: the next frontier for innovation, competition, and productivity. McKinsey Global Institute Manyika J, Chui M, Brown B et al (2011) Big data: the next frontier for innovation, competition, and productivity. McKinsey Global Institute
21.
Zurück zum Zitat McLennan M, Clark S, Deelman E, Rynge M, Vahi K, McKenna F, Kearney D, Song C (2013) Bringing scientific workflow to the masses via Pegasus and HUBzero. Proceedings of the 5th International Workshop on Science Gateways 13 p. 14 McLennan M, Clark S, Deelman E, Rynge M, Vahi K, McKenna F, Kearney D, Song C (2013) Bringing scientific workflow to the masses via Pegasus and HUBzero. Proceedings of the 5th International Workshop on Science Gateways 13 p. 14
22.
Zurück zum Zitat {Open Geospatial Consortium Inc.} (2011) OpenGIS Implementation Standard for Geographic information - Simple feature access - Part 1: Common architecture {Open Geospatial Consortium Inc.} (2011) OpenGIS Implementation Standard for Geographic information - Simple feature access - Part 1: Common architecture
23.
Zurück zum Zitat Vitolo C, Elkhatib Y, Reusser D et al (2015) Web technologies for environmental Big Data. Environmental Modelling & Software 63 pp. 185–198 Vitolo C, Elkhatib Y, Reusser D et al (2015) Web technologies for environmental Big Data. Environmental Modelling & Software 63 pp. 185–198
24.
Zurück zum Zitat Warmerdam F (2008) The geospatial data abstraction library. Open Source Approaches in Spatial Data Handling. Springer, Berlin Heidelberg pp. 87–104 Warmerdam F (2008) The geospatial data abstraction library. Open Source Approaches in Spatial Data Handling. Springer, Berlin Heidelberg pp. 87–104
25.
Zurück zum Zitat Zaharia M, Chowdhury M, Das T, Dave A, Ma J, McCauley M, Franklin MJ, Shenker S, Stoica I (2012) Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation. USENIX Association Zaharia M, Chowdhury M, Das T, Dave A, Ma J, McCauley M, Franklin MJ, Shenker S, Stoica I (2012) Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation. USENIX Association
Metadaten
Titel
VAT: A System for Visualizing, Analyzing and Transforming Spatial Data in Science
verfasst von
Christian Authmann
Christian Beilschmidt
Johannes Drönner
Michael Mattig
Bernhard Seeger
Publikationsdatum
01.11.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Datenbank-Spektrum / Ausgabe 3/2015
Print ISSN: 1618-2162
Elektronische ISSN: 1610-1995
DOI
https://doi.org/10.1007/s13222-015-0197-y

Weitere Artikel der Ausgabe 3/2015

Datenbank-Spektrum 3/2015 Zur Ausgabe

EDITORIAL

Editorial

COMMUNITY

News

DISSERTATIONEN

Dissertationen