Translator Disclaimer
12 July 2008 ESO scalable architecture for operational databases
Author Affiliations +
The European Organisation for Astronomical Research in the Southern Hemisphere (ESO), headquartered in Garching, Germany, operates different state-of-the-art observing sites in Chile. To manage observatory operations and observation transfer, ESO developed an end-to-end Data Flow System, from Phase I proposal preparation to the final archiving of quality-controlled science, calibration and engineering data. All information pertinent to the data flow is stored in the central databases at ESO headquarters and replicated to and from the observatory database servers. In the ESO's data flow model one can distinguish two groups of databases; the front-end databases, which are replicated from the ESO headquarters to the observing sites, and the back-end databases, where replication is directed from the observations to the headquarters. A part of the front-end database contains the Observation Blocks (OBs), which are sequences of operations necessary to perform an observation, such as instrument setting, target, filter and/or grism ID, exposure time, etc. Observatory operations rely on fast access to the OB database and quick recovery strategies in case of a database outage. After several years of operations, those databases have grown considerably. There was a necessity in reviewing the database architecture to find a solution that support scalability of the operational databases. We present the newly developed concept of distributing the OBs between two databases, containing operational and historical information. We present the architectural design in which OBs in operational databases will be archived periodically at ESO headquarters. This will remedy the scalability problems and keep the size of the operational databases small. The historical databases will only exist in the headquarters, for archiving purposes.
© (2008) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
I. Vera, A. Dobrzycki, A. M. Chavan, P. Nass, and J. S. Lockhart "ESO scalable architecture for operational databases", Proc. SPIE 7016, Observatory Operations: Strategies, Processes, and Systems II, 70161B (12 July 2008);


Design of the VLT data flow model
Proceedings of SPIE (March 21 1997)
ESO Archive data and metadata model
Proceedings of SPIE (September 24 2012)
PROP: ESO's portal for reporting of operational problematics
Proceedings of SPIE (September 13 2012)
Moor web access to end to end data flow...
Proceedings of SPIE (September 16 2004)
DASH--distributed analysis system hierarchy
Proceedings of SPIE (December 19 2002)

Back to Top