Recent years have seen impressive progress in AI-assisted writing, yet the developments in AI-assisted reading are lacking. We propose inline commentary as a natural vehicle for AI-based reading assistance, and present CARE: the first open integrated platform for the study of inline commentary and reading. CARE facilitates data collection for inline commentaries in a commonplace collaborative reading environment, and provides a framework for enhancing reading with NLP-based assistance, such as text classification, generation or question answering. The extensible behavioral logging allows unique insights into the reading and commenting behavior, and flexible configuration makes the platform easy to deploy in new scenarios. To evaluate CARE in action, we apply the platform in a user study dedicated to scholarly peer review. CARE facilitates the data collection and study of inline commentary in NLP, extrinsic evaluation of NLP assistance, and application prototyping. We invite the community to explore and build upon the open source implementation of CARE.
翻译:摘要:近年来,AI辅助写作领域取得了显著进展,但AI辅助阅读的发展仍显不足。我们提出将内联注释作为基于AI的阅读辅助的自然载体,并介绍CARE:首个用于研究内联注释与阅读的开放集成平台。该平台可在常见的协作阅读环境中支持内联注释数据的采集,并提供基于自然语言处理(NLP)的辅助框架(如文本分类、生成或问答)以增强阅读体验。其可扩展的行为日志系统可深入洞察阅读与注释行为,灵活配置使其易于部署至新场景。为评估CARE的实际效果,我们将其应用于学术同行评审的用户研究中。该平台不仅助力NLP领域内联注释的数据采集与研究,还支持NLP辅助技术的外部评估及应用原型开发。我们诚邀学界共同探索并基于CARE的开源实现进行拓展。