Translator Disclaimer
16 September 2004 SIP: a modern flexible data pipeline
Author Affiliations +
IRAC, the Infrared Array Camera on the Spitzer Space Telescope, generated well over 150,000 images during the in-orbit checkout and science verification phase of the mission. All of these were processed with SIP, the SAO IRAC Pipeline. SIP was created by and for the members of the IRAC instrument team at the Smithsonian Astrophysical Observatory, to allow short-timescale data processing and rapid-turnaround software testing and algorithm modification. SIP makes use of perl scripting and data mirroring to transfer and manage data, a mySQL database to select calibration data, and Python/numarray to process the image data; it is designed to run with no user interaction. SIP is fast, flexible, and robust. We present some 'lessons learned' from the construction and maintenance of SIP, and discuss prospects for future improvement.
© (2004) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Pauline Barmby, Zhong Wang, Massimo Marengo, and Matthew L.N. Ashby "SIP: a modern flexible data pipeline", Proc. SPIE 5493, Optimizing Scientific Return for Astronomy through Information Technologies, (16 September 2004);


JWST science data products
Proceedings of SPIE (July 28 2014)
CNES Cal Val expertise centre for Sentinel 2 in orbit...
Proceedings of SPIE (October 12 2015)
FIRST ground segment and science operations concept
Proceedings of SPIE (July 03 1998)
Data quality analysis at the Spitzer Science Center
Proceedings of SPIE (June 30 2006)
SIRTF science operations system
Proceedings of SPIE (March 05 2003)
Real time time variability analysis of GB to TB datasets...
Proceedings of SPIE (December 24 2002)

Back to Top