We present the DURel tool that implements the annotation of semantic proximity between uses of words into an online, open source interface. The tool supports standardized human annotation as well as computational annotation, building on recent advances with Word-in-Context models. Annotator judgments are clustered with automatic graph clustering techniques and visualized for analysis. This allows to measure word senses with simple and intuitive micro-task judgments between use pairs, requiring minimal preparation efforts. The tool offers additional functionalities to compare the agreement between annotators to guarantee the inter-subjectivity of the obtained judgments and to calculate summary statistics giving insights into sense frequency distributions, semantic variation or changes of senses over time.
翻译:我们提出DURel工具,它将词语使用间语义接近度的标注功能实现为在线开源界面。该工具基于词义上下文模型的最新进展,支持标准化人工标注与计算标注。标注者的判断结果通过自动图聚类技术进行聚类,并以可视化方式呈现以供分析。这种方法通过词对使用间的简单直观微任务判断来测量词义,所需准备工作极少。该工具还提供额外功能,可比较标注者间的一致性以保证所获判断的主体间性,并计算摘要统计量,以揭示词义频率分布、语义变异或词义随时间的变化。