Paper
2 January 2002 High-volume synchronized data collection
Terry S. Duncan, Joshua K. Voas, Robert J. Eager, Regina C. Hearn, Michael J. Johnston, Scott C. Newey, Michael S. Sichler, John L. Wynia
Author Affiliations +
Abstract
Traditional methods of data collection typically rely on each instrument storing data locally during each data collect run with the files relayed to a central storage location at a later time. For moderate rate systems this is an acceptable paradigm. However, as ultra-high bandwidth instruments become available, this approach presents two significant limitations. First, the bandwidth required for the transfers can become unrealistic, and the transfer times are prohibitive. Second, the increasing complexity, speed, and breadth of instruments presents significant challenges in combining the data into a coherent data set for analysis. The Starfire Optical Range is in the process of implementing a centralized data storage system that provides multi-gigabyte per second transfer rates and allows each instrument to store directly to the primary data store. Additionally, the architecture provides for absolute synchronization of every data sample throughout all sensors. The result is a single data set with data from all instruments frame by frame synchronized.
© (2002) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Terry S. Duncan, Joshua K. Voas, Robert J. Eager, Regina C. Hearn, Michael J. Johnston, Scott C. Newey, Michael S. Sichler, and John L. Wynia "High-volume synchronized data collection", Proc. SPIE 4844, Observatory Operations to Optimize Scientific Return III, (2 January 2002); https://doi.org/10.1117/12.460668
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Data storage

Sensors

Control systems

Switches

Operating systems

Databases

Standards development

RELATED CONTENT

Operating a petabyte class archive at ESO
Proceedings of SPIE (July 12 2008)
New generation of the health monitoring system SMS 2001
Proceedings of SPIE (August 03 2001)
Management evolution in the LSST project
Proceedings of SPIE (August 04 2010)

Back to Top