Radiology report summarization (RRS) is a growing area of research. Given the Findings section of a radiology report, the goal is to generate a summary (called an Impression section) that highlights the key observations and conclusions of the radiology study. However, RRS currently faces essential limitations.First, many prior studies conduct experiments on private datasets, preventing reproduction of results and fair comparisons across different systems and solutions. Second, most prior approaches are evaluated solely on chest X-rays. To address these limitations, we propose a dataset (MIMIC-RRS) involving three new modalities and seven new anatomies based on the MIMIC-III and MIMIC-CXR datasets. We then conduct extensive experiments to evaluate the performance of models both within and across modality-anatomy pairs in MIMIC-RRS. In addition, we evaluate their clinical efficacy via RadGraph, a factual correctness metric.
翻译:放射学报告摘要(RRS)是一个日益发展的研究领域。其目标是基于放射学报告的"发现"部分,生成一份突出关键观察结果和结论的摘要(称为"印象"部分)。然而,当前RRS面临若干关键限制:首先,许多先前研究在私有数据集上进行实验,导致结果无法复现,且不同系统与解决方案之间难以进行公平比较;其次,大多数现有方法仅基于胸部X光片进行评估。为克服这些局限性,我们基于MIMIC-III和MIMIC-CXR数据集构建了一个包含三种新模态和七种新解剖部位的MIMIC-RRS数据集。随后,我们开展了大量实验,评估模型在MIMIC-RRS中同一模态-解剖对内部及跨模态-解剖对之间的表现。此外,我们通过RadGraph(一种事实正确性评估指标)评价了这些模型的临床有效性。