Adapting the VLT data flow system for handling high-data rates

Stefano Zampieri; Michele Peron; Olivier Chuzel; Neil Ferguson; Jens Knudstrup; Nick Kornweibel

doi:10.1117/12.551221

Translator Disclaimer

16 September 2004 Adapting the VLT data flow system for handling high-data rates

Stefano Zampieri, Michele Peron, Olivier Chuzel, Neil Ferguson, Jens Knudstrup, Nick Kornweibel

Author Affiliations +

Proceedings Volume 5493, Optimizing Scientific Return for Astronomy through Information Technologies; (2004) https://doi.org/10.1117/12.551221
Event: SPIE Astronomical Telescopes + Instrumentation, 2004, Glasgow, United Kingdom

Abstract

The Data Flow System (DFS) for the ESO VLT provides a global approach to handle the flow of science related data in the VLT environment. It is a distributed system composed of a collection of components for preparation and scheduling of observations, archiving of data, pipeline data reduction and quality control. Although the first version of the system became operational in 1999 together with the first UT, additional developments were necessary to address new operational requirements originating from new and complex instruments which generate large amounts of data. This paper presents the hardware and software changes made to meet those challenges within the back-end infrastructure, including on-line and off-line archive facilities, parallel/distributed pipeline processing and improved association technologies.

Citation Download Citation

Stefano Zampieri, Michele Peron, Olivier Chuzel, Neil Ferguson, Jens Knudstrup, and Nick Kornweibel "Adapting the VLT data flow system for handling high-data rates", Proc. SPIE 5493, Optimizing Scientific Return for Astronomy through Information Technologies, (16 September 2004); https://doi.org/10.1117/12.551221

ACCESS THE FULL ARTICLE