Skip to main content
Top

2017 | OriginalPaper | Chapter

Supercomputing Centers Tight Coupling to Face Big Data Processing

Authors : Pierre-Marie Brunet, Jérome Gasperi, Maurice Poncet, Tristan Faure

Published in: Space Operations: Contributions from the Global Community

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

CNES HPC center is involved in multiple federated mission centers. Current and upcoming space missions are tremendous data generators due to sensor improvements.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Brunet, P.M., Montmorry, A., Frezouls, B.: Big data challenges, an insight into the Gaia Hadoop solution. In: SpaceOps 2012, p. 1275512 (Proceedings) Brunet, P.M., Montmorry, A., Frezouls, B.: Big data challenges, an insight into the Gaia Hadoop solution. In: SpaceOps 2012, p. 1275512 (Proceedings)
5.
go back to reference Scogland, T., Subramaniam, B., Feng, W.C.: The Green500 list: escapades to exascale. Comput. Sci. Res. Dev. 28(2–3), 109–117 (2013) (Books) Scogland, T., Subramaniam, B., Feng, W.C.: The Green500 list: escapades to exascale. Comput. Sci. Res. Dev. 28(2–3), 109–117 (2013) (Books)
6.
go back to reference Subramaniam, B., Saunders, W., Scogland, T., Feng, W.C.: Trends in energy-efficient computing: a perspective from the Green500. In Green Computing Conference (IGCC), 2013 International, pp. 1–8. IEEE (2013, June) (Proceedings) Subramaniam, B., Saunders, W., Scogland, T., Feng, W.C.: Trends in energy-efficient computing: a perspective from the Green500. In Green Computing Conference (IGCC), 2013 International, pp. 1–8. IEEE (2013, June) (Proceedings)
7.
go back to reference Poncet, M., Faure, T., Cavet, C., Petiteau, A., Brunet, PM., Keryell-Even, E., Gadioux, S., Burgaud, M.: Enabling collaboration between space agencies using private and cloud based clusters. In: Proc. of the 2016 Conference Big Data from Space (BiDS’16) (Proceedings) Poncet, M., Faure, T., Cavet, C., Petiteau, A., Brunet, PM., Keryell-Even, E., Gadioux, S., Burgaud, M.: Enabling collaboration between space agencies using private and cloud based clusters. In: Proc. of the 2016 Conference Big Data from Space (BiDS’16) (Proceedings)
8.
go back to reference Gasperi, J.: Semantic search within Earth Observation products database based on automatic tagging of image content. In: Proc. of the 2016 conference Big Data From Space (BiDS’14) (Proceedings) Gasperi, J.: Semantic search within Earth Observation products database based on automatic tagging of image content. In: Proc. of the 2016 conference Big Data From Space (BiDS’14) (Proceedings)
13.
go back to reference Felter, W., Ferreira, A., Rajamony, R., Rubio, J.: An updated performance comparison of virtual machines and linux containers. In: Performance Analysis of Systems and Software (ISPASS), 2015 IEEE International Symposium on, pp. 171–172, IEEE (2015, March) (Proceedings) Felter, W., Ferreira, A., Rajamony, R., Rubio, J.: An updated performance comparison of virtual machines and linux containers. In: Performance Analysis of Systems and Software (ISPASS), 2015 IEEE International Symposium on, pp. 171–172, IEEE (2015, March) (Proceedings)
14.
go back to reference Hindman, B., Konwinski, A., Zaharia, M., Ghodsi, A., Joseph, A.D., Katz, R.H., et al.: Mesos: a platform for fine-grained resource sharing in the data center. In: NSDI, vol. 11, pp. 22–22 (2011, March) (Proceedings) Hindman, B., Konwinski, A., Zaharia, M., Ghodsi, A., Joseph, A.D., Katz, R.H., et al.: Mesos: a platform for fine-grained resource sharing in the data center. In: NSDI, vol. 11, pp. 22–22 (2011, March) (Proceedings)
16.
go back to reference Dorigo, A., Elmer, P., Furano, F., Hanushevsky, A.: XROOTD-A highly scalable architecture for data access. WSEAS Trans. Comput. 1(4.3) (2005) (Proceedings) Dorigo, A., Elmer, P., Furano, F., Hanushevsky, A.: XROOTD-A highly scalable architecture for data access. WSEAS Trans. Comput. 1(4.3) (2005) (Proceedings)
17.
go back to reference Colamaria, F., Colella, D., Donvito, G., Elia, D., Franco, A., Luparello, G., et al.: Local storage federation through XRootD architecture for interactive distributed analysis. J. Phys. 664(4), 042013 (2015) (Proceedings) Colamaria, F., Colella, D., Donvito, G., Elia, D., Franco, A., Luparello, G., et al.: Local storage federation through XRootD architecture for interactive distributed analysis. J. Phys. 664(4), 042013 (2015) (Proceedings)
18.
go back to reference Bui, T.: Analysis of Docker security. arXiv preprint arXiv:1501.02967 (2015) (Proceedings) Bui, T.: Analysis of Docker security. arXiv preprint arXiv:1501.02967 (2015) (Proceedings)
19.
go back to reference Toporkov, V., Tselishchev, A., Yemelyanov, D., Potekhin, P.: Metascheduling strategies in distributed computing with non-dedicated resources. In: Dependability Problems of Complex Information Systems, pp. 129–148. Springer, Switzerland (2015) (Books) Toporkov, V., Tselishchev, A., Yemelyanov, D., Potekhin, P.: Metascheduling strategies in distributed computing with non-dedicated resources. In: Dependability Problems of Complex Information Systems, pp. 129–148. Springer, Switzerland (2015) (Books)
20.
go back to reference Bessis, N., Sotiriadis, S., Xhafa, F., Pop, F., Cristea, V.: Meta-scheduling issues in interoperable HPCs, grids and clouds. Int. J. Web Grid Serv. 8(2), 153–172 (2012) (Books) Bessis, N., Sotiriadis, S., Xhafa, F., Pop, F., Cristea, V.: Meta-scheduling issues in interoperable HPCs, grids and clouds. Int. J. Web Grid Serv. 8(2), 153–172 (2012) (Books)
21.
go back to reference Xiao, L., Ren, K., Zheng, Q., Gibson, G.A.: ShardFS vs. IndexFS: replication vs. caching strategies for distributed metadata management in cloud storage systems. In: Proceedings of the Sixth ACM Symposium on Cloud Computing, pp. 236–249. ACM (2015, August) (Proceedings) Xiao, L., Ren, K., Zheng, Q., Gibson, G.A.: ShardFS vs. IndexFS: replication vs. caching strategies for distributed metadata management in cloud storage systems. In: Proceedings of the Sixth ACM Symposium on Cloud Computing, pp. 236–249. ACM (2015, August) (Proceedings)
Metadata
Title
Supercomputing Centers Tight Coupling to Face Big Data Processing
Authors
Pierre-Marie Brunet
Jérome Gasperi
Maurice Poncet
Tristan Faure
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-51941-8_19

Premium Partner