There is a lack of quantitative measures to evaluate the progression of topics through time in dynamic topic models (DTMs). Filling this gap, we propose a novel evaluation measure for DTMs that analyzes the changes in the quality of each topic over time. Additionally, we propose an extension combining topic quality with the model's temporal consistency. We demonstrate the utility of the proposed measure by applying it to synthetic data and data from existing DTMs. We also conducted a human evaluation, which indicates that the proposed measure correlates well with human judgment. Our findings may help in identifying changing topics, evaluating different DTMs, and guiding future research in this area.

翻译：当前缺乏定量指标来评估动态主题模型中主题随时间演化的质量。为填补这一空白，我们提出一种新型动态主题模型评估指标，该指标可分析每个主题质量随时间的变化规律。此外，我们提出一种将主题质量与模型时间一致性相结合的扩展方案。通过将所提出的指标应用于合成数据与现有动态主题模型数据，我们验证了其有效性。同时开展的人工评估实验表明，该指标与人类判断具有良好相关性。我们的研究成果将有助于识别演化中的主题、评估不同动态主题模型，并为该领域的后续研究提供指导。