We GPU ported with CUDA the solver module of the Astrometric Verification Unit–Global Sphere Reconstruction (AVU–GSR) pipeline for the ESA Gaia mission. The code finds the astrometric parameters of approximately 108 sources, by solving a linear system with the LSQR. The coefficient matrix is large (10–50 TB) and sparse. The CUDA code accelerates over the original MPI + OpenMP solver of approximately 14x on CINECA cluster Marconi100. We migrated the code production to Leonardo, which has 4x GPU memory per node. This speedup was obtained without computing the system covariances, whose total number is Nunk × (Nunk − 1)/2 and occupy approximately 1 EB with Nunk approximately 5 × 108. This “Big Data” problem cannot be solved with standard methods: we defined a two jobs, I/O-based pipeline, where one job writes the files and the second concurrent job reads them, iteratively computes the covariances, and deletes them. The covariances calculation does not significantly slowdown the code until a number of covariances elements equal to approximately 8 × 106 .
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.