XPipeline: Starlight subtraction at scale for MagAO-X [IMA]

http://arxiv.org/abs/2208.07354


MagAO-X is an extreme adaptive optics (ExAO) instrument for the Magellan Clay 6.5-meter telescope at Las Campanas Observatory in Chile. Its high spatial and temporal resolution can produce data rates of 1 TB/hr or more, including all AO system telemetry and science images. We describe the tools and architecture we use for commanding, telemetry, and science data transmission and storage. The high data volumes require a distributed approach to data processing, and we have developed a pipeline that can scale from a single laptop to dozens of HPC nodes. The same codebase can then be used for both quick-look functionality at the telescope and for post-processing. We present the software and infrastructure we have developed for ExAO data post-processing, and illustrate their use with recently acquired direct-imaging data.

Read this paper on arXiv…

J. Long, J. Males, S. Haffert, et. al.
Tue, 16 Aug 22
34/74

Comments: From work presented at the SPIE Astronomical Telescopes and Instrumentation 2022 meeting