Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Earth Science Informatics
Published in: Earth Science Informatics 1/2018

19-07-2017 | Research Article

CyberConnector: a service-oriented system for automatically tailoring multisource Earth observation data to feed Earth science models

Authors: Ziheng Sun, Liping Di, Haosheng Hao, Xiaoqing Wu, Daniel Q. Tong, Chen Zhang, Cora Virgei, Hui Fang, Eugene Yu, Xicheng Tan, Peng Yue, Li Lin

Published in: Earth Science Informatics | Issue 1/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Feeding multisource Earth observation (EO) data into Earth science models (ESM) remains a daunting challenge. This paper presents a service-oriented approach as an alternative solution. It uses geospatial web services to process the EO data and geoprocessing workflow for automation. Different from existing approaches, it takes advantage of virtual data products (VDP) to release modelers from intensive data processing. It can directly connect ESMs to public EO sources via Cyberinfrastructure. A prototype called CyberConnector is implemented. CyberConnector supports intuitive building of VDP, automatic execution of workflows and effortless retrieval of model-ready input files. We used it to stream multiple datasets to several ESMs including finite-volume coastal ocean model (FVCOM) and cloud-resolving model (CRM). The results show that CyberConnector can truly benefit modelers on time saving and effort minimizing.
next article Predicting future urban impervious surface distribution using cellular automata and regression analysis

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Appendix
Available only for authorised users
Literature
Allison ML, Ahern T, Arctur D, Bowring J, Crane G, DeLuca C, Fox G, Hood C, Leetaru H, Lehnert K (2012) EarthCube governance roadmap: documentation, Research, and Recommendations, Version 20 August
Amanchi SK, Durbha SS, King RL, Bheemireddy S, Younan NH (2009) Mobile computing and sensor web services for coastal buoys. Geoscience and Remote Sensing Symposium,2009 I.E. International, IGARSS 2009 5:465–468
Benlian A, Hess T (2011) Opportunities and risks of software-as-a-service: findings from a survey of IT executives. Decis Support Syst 52(1):232–246CrossRef
Berners-Lee TJ (1992) The world-wide web. Computer Networks and ISDN Systems 25(4):454–459CrossRef
Berners-Lee T, Hendler J, Lassila O, (2001) The Semantic Web. Sci Am 284 (5):34–43
Bröring A, Jürrens EH, Jirka S, Stasch C (2009) Development of sensor web applications with open source software. In: First Open Source GIS UK Conference (OSGIS 2009). Nottingham, UK
Buxmann P, Hess T, Lehmann D (2008) Software as a service. Wirtschaftsinformatik 50(6):500–503CrossRef
Chassignet EP, Hurlburt HE, Smedstad OM, Halliwell GR, Hogan PJ, Wallcraft AJ, Baraille R, Bleck R (2007) The HYCOM (hybrid coordinate ocean model) data assimilative system. J Mar Syst 65(1):60–83CrossRef
Chen C, Beardsley RC, Cowles G (2006) An unstructured grid, finite-volume coastal ocean model (FVCOM) system. Oceanography 19(1):78–89CrossRef
Chen A, Di L, Wei Y, Bai Y, Liu Y (2009a) Use of grid computing for modeling virtual geospatial products. Int J Geogr Inf Sci 23(5):581–604CrossRef
Chen N, Di L, Yu G, Gong J (2010) Geo-processing workflow driven wildfire hot pixel detection under sensor web environment. Comput Geosci 36(3):362–372CrossRef
Chen N, Di L, Yu G, Min M (2009b) A flexible geospatial sensor observation service for diverse sensor data based on web service. ISPRS J Photogramm Remote Sens 64(2):234–242CrossRef
Chen C, Huang H, Beardsley RC, Xu Q, Limeburner R, Cowles GW, Sun Y, Qi J, Lin H (2011) Tidal dynamics in the Gulf of Maine and New England shelf: an application of FVCOM. J Geophys Res Oceans 116(C12010):1–14
Chen C, Liu H, Beardsley RC (2003) An unstructured grid, finite-volume, three-dimensional, primitive equations ocean model: application to coastal ocean and estuaries. J Atmos Ocean Technol 20(1):159–186CrossRef
Chen C, Qi J, Li C, Beardsley RC, Lin H, Walker R, Gates K (2008) Complexity of the flooding/drying process in an estuarine tidal-creek salt-marsh system: an application of FVCOM. J Geophys Res Oceans 113(C7052):1–21
Ciesielski PE, Yu H, Johnson RH, Yoneyama K, Katsumata M, Long CN, Wang J, Loehrer SM, Young K, Williams SF (2014) Quality-controlled upper-air sounding dataset for DYNAMO/CINDY/AMIE: Development and corrections. J Atmos Ocean Technol 31(4):741–764CrossRef
Delin KA, Jackson SP (2001) Sensor web: a new instrument concept. In: Symposium on integrated optics, p 1–9
Delin KA, Jackson SP, Some RR (1999) Sensor webs. NASA Tech Briefs 23:80
Di L (2007) Geospatial sensor web and self-adaptive Earth predictive systems (SEPS). In: Proceedings of the Earth science Technology office (ESTO)/advanced information system Technology (AIST) sensor web principal investigator (PI) Meeting, San Diego, USA. p 1–4
Díaz L, Granell C, Gould M, Huerta J (2011) Managing user-generated information in geospatial cyberinfrastructures. Futur Gener Comput Syst 27(3):304–314
Egenhofer MJ (2002) Toward the semantic geospatial web. In: Proceedings of the 10th ACM international symposium on Advances in geographic information systems. Mclean, Virginia 1–4
Fonseca F, Sheth A (2002) The geospatial semantic web. In: Wilson JP, Fotheringham SA (eds) The handbook of geographic information science. John Wiley & Sons, Oxford, pp 367–376
Fraternali P (1999) Tools and approaches for developing data-intensive web applications: a survey. ACM Computing Surveys (CSUR) 31(3):227–263CrossRef
Fridlind A, Ackerman A, Chaboureau JP, Fan J, Grabowski WW, Hill A, Jones T, Khaiyer M, Liu G, Minnis P (2012) A comparison of TWP-ICE observational data with cloud-resolving model results. J Geophys Res Atmos 117(D5204):1–28
Gaber N, Laniak G, Linker L (2008) Integrated modeling for integrated environmental decision making. US Environmental Protection Agency, Washington, DC
Geller GN, Melton F (2008) Looking forward: applying an ecological model web to assess impacts of climate change. Biodiversity 9(3–4):79–83CrossRef
Goodall JL, Horsburgh JS, Whiteaker TL, Maidment DR, Zaslavsky I (2008) A first approach to web services for the National Water Information System. Environ Model Softw 23(4):404–411
Goodall JL, Robinson BF, Castronova AM, (2011) Modeling water resource systems using a serviceoriented computing paradigm. Environ Model Softw 26(5):573–582
Grabowski WW, Wu X, Moncrieff MW (1996) Cloud-resolving modeling of tropical cloud systems during phase III of GATE. Part I: two-dimensional experiments. J Atmos Sci 53(24):3684–3709CrossRef
Granell C, Díaz L, Gould, M (2010) Service-oriented applications for environmental models: Reusable geospatial services. Environ Model Softw 25(2):182–198
Hey T, Trefethen AE (2005) Cyberinfrastructure for e-science. Science 308(5723):817–821CrossRef
Horsburgh JS, Tarboton DG, Piasecki M, Maidment DR, Zaslavsky I, Valentine D, Whitenack T (2009) An integrated system for publishing environmental observations data. Environ Model Softw 24(8):879–888
Jirka S, Bröring A, Stasch C (2009) Applying OGC sensor web enablement to risk monitoring and disaster management. In: GSDI 11 world Conference, Rotterdam, Netherlands
Johnson RH, Ciesielski PE (2013) Structure and properties of Madden–Julian oscillations deduced from DYNAMO sounding arrays. J Atmos Sci 70(10):3157–3179CrossRef
Kerr PC, Donahue AS, Westerink JJ, Luettich RA, Zheng L, Weisberg RH, Huang Y, Wang H, Teng Y, Forrest D (2013) US IOOS coastal and ocean modeling testbed: inter-model evaluation of tides, waves, and hurricane surge in the Gulf of Mexico. J Geophys Res Oceans 118(10):5129–5172CrossRef
Khairoutdinov MF, Randall DA (2001) A cloud resolving model as a cloud parameterization in the NCAR Community climate system model: preliminary results. Geophys Res Lett 28(18):3617–3620CrossRef
Khairoutdinov M, Randall D, DeMott C (2005) Simulations of the Atmospheric general circulation using a cloud-resolving model as a Superparameterization of physical processes. J Atmos Sci 62(7):2136–2154CrossRef
Kofler M (2001) What is MySQL?, MySQL Apress, 3–19
Martinek, P., Szikora, B., 2007. Semantic execution of BPEL processes. Advances in Information Systems Development, Vol 1, 361–367, 550.
Mesinger F, DiMego G, Kalnay E, Mitchell K, Shafran PC, Ebisuzaki W, Jovic D, Woollen J, Rogers E, Berbery EH (2006) North American regional reanalysis. Bull Am Meteorol Soc 87(3):343–360CrossRef
Nativi S, Mazzetti P, Geller GN (2013) Environmental model access and interoperability: the GEO model web initiative. Environ Model Softw 39:214–228CrossRef
Norris JM (2010) US Geological Survey Streamgage Operation and Maintenance Cost Evaluation... from the National Streamflow Information Program. US Geological Survey
Rew R, Davis G, Emmerson S, Davies H (1997) NetCDF user’s guide for C. Unidata Program Center
Richard SM, Pearthree G, Aufdenkampe AK, Cutcher-Gershenfeld J, Daniels M, Gomez B, Kinkade D, Percivall G (2014) Community-developed Geoscience cyberinfrastructure. Eos, Trans American Geophysical Union 95(20):165–166CrossRef
Roman D, Schade S (2009) Model as a service (MaaS). In: AGILE workshop: grid technologies for geospatial applications. Hannover, Germany
Santos E, Poco J, Wei Y, Liu S, Cook B, Williams DN, Silva CT (2013) UV-CDAT: analyzing climate datasets from a user’s perspective. Computing in Science & Engineering 15(1):94–103CrossRef
Shen Y, Carriere L, Nadeau D, Potter G, Peters J, Winter E, Cinquini L, Blodgett D, McInerney M, (2014) Combining ESGF data node with its complementary data services at the NASA Center for climate simulation. In: AGU Fall Meeting Abstracts. 3771
Sun Z, Peng C, Deng M, Chen A, Yue P, Fang H, Di L (2014) Automation of customized and near-real-time vegetation condition index generation through cyberinfrastructure-based geoprocessing workflows. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 7(11):4512–4522CrossRef
Sun Z, Yue P, Hu L, Gong J, Zhang L, Lu X (2013) GeoPWProv: interleaving map and faceted metadata for provenance visualization and navigation. IEEE Trans Geosci Remote Sens 51(11):5131–5136CrossRef
Sun Z, Yue P, Lu X, Zhai X, Hu L (2012) A task ontology driven approach for live geoprocessing in a service oriented environment. Trans GIS 16(6):867–884CrossRef
Tsou MH, Kim I-H (2011) Creating GIS simulation models on a TeraGrid-enabled geospatial web portal: A demonstration of geospatial cyberinfrastructure. Advances in web-based GIS, mapping services and applications, 55–70
Turner M, Budgen D, Brereton P (2003) Turning software into a service. Computer 36(10):38–44CrossRef
Wang S (2010) A CyberGIS framework for the synthesis of cyberinfrastructure, GIS, and spatial analysis. Ann Assoc Am Geogr 100(3):535–557CrossRef
Wang S, Anselin L, Bhaduri B, Crosby C, Goodchild MF, Liu Y, Nyerges TL (2013) CyberGIS software: a synthetic review and integration roadmap. Int J Geogr Inf Sci 27(11):2122–2145CrossRef
Williams D (2015) The Earth system grid federation (ESGF): climate science infrastructure for large-scale data management and dissemination. In: AGU Fall Meeting Abstracts http://​adsabs.​harvard.​edu/​abs/​2015AGUFMIN11G.​.​02W
Wright DJ, Wang S (2011) The emergence of spatial cyberinfrastructure. Proc Natl Acad Sci 108(14):5488–5491CrossRef
Wu X, Deng L (2013) Comparison of moist static energy and budget between the GCM-simulated Madden–Julian oscillation and observations over the Indian Ocean and western Pacific. J Clim 26(14):4981–4993CrossRef
Wu X, Li X (2008) A review of cloud-resolving model studies of convective processes. Adv Atmos Sci 25(2):202–212CrossRef
Wu X, Liang X, Park S (2007) Cloud-resolving model simulations over the ARM SGP. Mon Weather Rev 135(8):2841–2853CrossRef
Wu X, Moncrieff MW, Emanuel KA (2000) Evaluation of large-scale forcing during TOGA COARE for cloud-resolving models and single-column models. J Atmos Sci 57(17):2977–2985CrossRef
Xue P, Chen C, Qi J, Beardsley RC, Tian R, Zhao L, Lin H (2014) Mechanism studies of seasonal variability of dissolved oxygen in Mass Bay: a multi-scale FVCOM/UG-RCA application. J Mar Syst 131:102–119CrossRef
Yang C, Nebert D, Taylor DF (2011) Establishing a sustainable and cross-boundary geospatial cyberinfrastructure to enable polar research. Comput Geosci 37(11):1721–1726CrossRef
Yang C, Raskin R, Goodchild M, Gahegan M (2010) Geospatial cyberinfrastructure: past, present and future. Comput Environ Urban Syst 34(4):264–277CrossRef
Yoneyama K, Zhang C, Long CN (2013) Tracking pulses of the Madden-Julian oscillation. Bull Am Meteorol Soc 94(12):1871–1891CrossRef
Yu G, Zhao P, Di L, Chen A, Deng M, Bai Y (2012) BPELPower-A BPEL execution engine for geospatial web services. Comput Geosci 47(0):87–101CrossRef
Yue P, Di L, Yang W, Yu G, Zhao P (2007) Semantics-based automatic composition of geospatial web service chains. Comput Geosci 33(5):649–665CrossRef
Yue P, Di L, Zhao P, Yang W, Yu G, Wei Y (2006) Semantic augmentations for geospatial catalogue service. In: 2006 I.E. International Geoscience and Remote Sensing Symposium (IGARSS06), p 3486–3489
Yue P, Gong J, Di L, He L, Wei Y (2011) Integrating semantic web technologies and geospatial catalog services for geospatial information discovery and processing in cyberinfrastructure. GeoInformatica 15(2):273–303CrossRef
Yue P, He L (2009).Geospatial data provenance in cyberinfrastructure. In: 2009 17th international Conference on Geoinformatics, p 1–4.
Zhang T, Tsou M-H (2009) Developing a grid-enabled spatial web portal for internet GIServices and geospatial cyberinfrastructure. Int J Geogr Inf Sci 23(5):605–630CrossRef
Zhang C, Zhao T, Li W, Osleeb JP (2010) Towards logic-based geospatial feature discovery and integration using web feature service and geospatial semantic web. Int J Geogr Inf Sci 24(6):903–923CrossRef
Metadata
Title
CyberConnector: a service-oriented system for automatically tailoring multisource Earth observation data to feed Earth science models
Authors
Ziheng Sun
Liping Di
Haosheng Hao
Xiaoqing Wu
Daniel Q. Tong
Chen Zhang
Cora Virgei
Hui Fang
Eugene Yu
Xicheng Tan
Peng Yue
Li Lin
Publication date
19-07-2017
Publisher
Springer Berlin Heidelberg
Published in
Earth Science Informatics / Issue 1/2018
Print ISSN: 1865-0473
Electronic ISSN: 1865-0481
DOI
https://doi.org/10.1007/s12145-017-0308-4

Other articles of this Issue 1/2018

Earth Science Informatics 1/2018 Go to the issue

Research Article

Predicting future urban impervious surface distribution using cellular automata and regression analysis

Research Article

Corner points localization in electronic topographic maps with deep neural networks

Erratum

Erratum to: Estimating leaf chlorophyll contents by combining multiple spectral indices with an artificial neural network

Research Article

Uncertain spatiotemporal data modeling and algebraic operations based on XML

Methodology Article

Exploring UAV in Indonesian cadastral boundary data acquisition

Research Article

Land use and land cover change and implication to watershed degradation by using GIS and remote sensing in the Koga watershed, North Western Ethiopia

Premium Partner

    Image Credits