Modern simulations and observations in Astronomy & Cosmology (A&C) produce massively large data volumes, posing significant challenges for storage, access and data analysis. A long-standing bottleneck in high-performance computing, especially now in the exascale era, has been the requirement to write these large datasets to disks, which limits the performance. A promising solution to this challenge is in-situ processing, where analysis and visualization are performed concurrently with the simulation itself, bypassing the storage of the simulation data. In this work, we present new results from an approach for in-situ processing based on Hecuba, a framework that provides a highly distributed database for streaming A&C simulation data directly into the visualization pipeline to make possible on-line visualization. By integrating Hecuba with the high-performance cosmological simulator ChaNGa, we enable real-time, in-situ visualization of N-body simulation results using tools such as ParaView and VisIVO.

翻译：现代天文学与宇宙学（A&C）的模拟与观测产生海量数据，对存储、访问和数据分析构成重大挑战。高性能计算中长期存在的瓶颈——尤其在当今百亿亿级计算时代——是需将这些庞大数据集写入磁盘，这限制了性能。应对这一挑战的一种有前景的解决方案是原位处理，即在模拟运行的同时进行分析与可视化，从而避免存储模拟数据。本研究基于Hecuba框架提出一种原位处理方法的新成果：该框架提供高度分布式数据库，将A&C模拟数据直接流式传输至可视化管线，实现在线可视化。通过将Hecuba与高性能宇宙学模拟器ChaNGa集成，我们利用ParaView和VisIVO等工具，实现了N体模拟结果的实时原位可视化。