The Euclid science ground segment distributed infrastructure: System 
integration and challenges

Frailis, M.; Belikov, A.; Benson, K.; Bonchi, A.; Dabin, C.; Ealet, A.; Fumana, M.; Grenet, C.; Holliman, M.; Maggio, G.; Maino, D.; McCracken, H. J.; Melchior, M.; Piemonte, A.; Polenta, G.; Poncet, M.; Scala, P. L.; Serrano, S.; Williams, O. R.

Item

ITEM ACTIONSEXPORT

Add to Basket

Local TagsRelease HistoryDetailsSummary

Released

Conference Paper

The Euclid science ground segment distributed infrastructure: System integration and challenges

MPS-Authors

/persons/resource/persons242482

Piemonte, A.
Optical and Interpretative Astronomy, MPI for Extraterrestrial Physics, Max Planck Society;

External Resource

No external resources are shared

Fulltext (restricted access)

There are currently no full texts shared for your IP range.

Fulltext (public)

There are no public fulltexts stored in PuRe

Supplementary Material (public)

There is no public supplementary material available

Citation

Frailis, M., Belikov, A., Benson, K., Bonchi, A., Dabin, C., Ealet, A., et al. (2019). The Euclid science ground segment distributed infrastructure: System integration and challenges.

Cite as: https://hdl.handle.net/21.11116/0000-0004-F7D4-6

Abstract

The Science Ground Segment (SGS) of the Euclid mission provides distributed and redundant data storage and processing, federating nine Science Data Centres (SDCs) and a Science Operations Centre. The SGS reference architecture is based on loosely coupled systems and services, broadly organized into a common infrastructure of transverse software components and the scientific data Processing Functions. The SGS common infrastructure includes: 1) the Euclid Archive System (EAS), a central metadata repository which inventories, indexes and localizes the huge amount of distributed data; 2) a Distributed Storage System of EAS, providing a unified view of the SDCs storage systems and supporting several transfer protocols; 3) an Infrastructure Abstraction Layer, isolating the scientific data processing software from the underlying IT infrastructure and providing a common, lightweight workflow management system; 4) a Common Orchestration System, performing a balanced distribution of data and processing among the SDCs. Virtualization is another key element of the SGS infrastructure. We present the status of the Euclid SGS software infrastructure, the prototypes developed and the continuous system integration and testing performed through the Euclid “SGS Challenges”.