As simulations produce more data than available disk space on supercomputers, many simulations are employing in situ analysis and visualization to reduce the amount of data that needs to be stored. While in situ visualization offers potential for substantial data reduction, its efficacy is hindered by the need for a priori knowledge. First, we need to know what visualization parameters to use to highlight features of interest. Second, we do not know ahead of time how much resources will be needed to run the in situ workflows, e.g. how many compute nodes will be needed for in situ work. In this work, we present SeerX, a lightweight, scalable in-transit in situ service that supports dynamic resource allocation and lossy compression of 3D simulation data. SeerX enables multiple simulations to offload analysis to a shared, elastic service infrastructure without MPI synchronization.
翻译:随着仿真产生的数据量超过超级计算机可用磁盘空间,许多仿真正采用原位分析与可视化技术以减少需存储的数据量。尽管原位可视化具备大幅降低数据量的潜力,但其效果受限于对先验知识的需求。首先,我们需要确定应采用何种可视化参数以突显目标特征。其次,我们无法提前预知运行原位工作流所需的资源量,例如原位工作需要多少计算节点。本研究提出SeerX——一种轻量级、可扩展的传输中原位服务,支持动态资源分配与三维仿真数据的有损压缩。SeerX允许多个仿真将分析任务卸载至共享的弹性服务基础设施,且无需MPI同步。