Processing astronomical data often comes with huge challenges with regards to data management as well as data processing. MeerKAT telescope is one of the precursor telescopes of the World's largest observatory - Square Kilometre Array. So far, MeerKAT data was processed using the South African computing facility i.e. IDIA, and exploited to make ground-breaking discoveries. However, to process MeerKAT data on UK's IRIS computing facility requires new implementation of the MeerKAT pipeline. This paper focuses on how to transfer MeerKAT data from the South African site to UK's IRIS systems for processing. We discuss about our RapifXfer Data transfer framework for transferring the MeerKAT data from South Africa to the UK, and the MeerKAT job processing framework pertaining to the UK's IRIS resources.
翻译:天文数据的处理通常伴随着数据管理与数据处理的巨大挑战。MeerKAT望远镜是全球最大天文台——平方公里阵列的前导望远镜之一。迄今为止,MeerKAT数据利用南非计算设施(即IDIA)进行处理,并已被用于取得突破性发现。然而,要在英国IRIS计算设施上处理MeerKAT数据,则需要重新实现MeerKAT数据处理流水线。本文聚焦于如何将MeerKAT数据从南非站点传输至英国IRIS系统进行处理。我们讨论了用于将MeerKAT数据从南非传输至英国的RapifXfer数据传输框架,以及与英国IRIS资源相关的MeerKAT作业处理框架。