We present a detailed replication study of the BASS framework, an abstractive summarization system based on the notion of Unified Semantic Graphs. Our investigation includes challenges in replicating key components and an ablation study to systematically isolate error sources rooted in replicating novel components. Our findings reveal discrepancies in performance compared to the original work. We highlight the significance of paying careful attention even to reasonably omitted details for replicating advanced frameworks like BASS, and emphasize key practices for writing replicable papers.

翻译：我们针对BASS框架（一种基于统一语义图概念的抽象式摘要系统）开展了详细的复现研究。我们的研究包含复现关键组件时面临的挑战，以及通过消融实验系统性地隔离源于复现新型组件的错误源。研究结果揭示了与原始工作存在性能差异。我们强调，即使是合理省略的细节，在复现BASS这类先进框架时也需要给予充分关注，并着重阐述了撰写可复现论文的关键实践方法。