We present a detailed replication study of the BASS framework, an abstractive summarization system based on the notion of Unified Semantic Graphs. Our investigation includes challenges in replicating key components and an ablation study to systematically isolate error sources rooted in replicating novel components. Our findings reveal discrepancies in performance compared to the original work. We highlight the significance of paying careful attention even to reasonably omitted details for replicating advanced frameworks like BASS, and emphasize key practices for writing replicable papers.

翻译：我们呈现了对BASS框架的详细复现研究，该框架是基于统一语义图概念的抽象式摘要系统。本研究涵盖关键组件复现过程中的挑战，并通过消融实验系统隔离由复现新型组件导致的误差源。研究发现揭示了与原始工作的性能差异。我们强调即使是看似合理省略的细节，在复现诸如BASS等先进框架时也需给予充分关注，并着重阐述了撰写可复现论文的关键实践准则。