We explore the sensitivity of a document summary quality estimator, BLANC, to human assessment of qualities for the same summaries. In our human evaluations, we distinguish five summary qualities, defined by how fluent, understandable, informative, compact, and factually correct the summary is. We make the case for optimal BLANC parameters, at which the BLANC sensitivity to almost all of summary qualities is about as good as the sensitivity of a human annotator.

翻译：我们探讨文件摘要质量估计员(BLANC)对同一摘要的人文素质评估的敏感性。 在我们的人类评价中,我们区分了五种摘要质量,其定义是摘要的流利、易懂、信息丰富、紧凑和事实正确。 我们提出最佳的BLANC参数的理由,在这种参数中,BLANC对几乎所有摘要质量的敏感性与人文说明员的敏感性一样好。