WordNet provides a carefully constructed repository of semantic relations, created by specialists. But there is another source of information on semantic relations, the intuition of language users. We present the first systematic study of the degree to which these two sources are aligned. Investigating the cases of misalignment could make proper use of WordNet and facilitate its improvement. Our analysis which uses templates to elicit responses from human participants, reveals a general misalignment of semantic relation knowledge between WordNet and human intuition. Further analyses find a systematic pattern of mismatch among synonymy and taxonomic relations~(hypernymy and hyponymy), together with the fact that WordNet path length does not serve as a reliable indicator of human intuition regarding hypernymy or hyponymy relations.
翻译:WordNet提供了一个由专家精心构建的语义关系知识库。然而,语义关系还存在另一个信息来源——语言使用者的直觉。本文首次系统研究了这两种信息来源的一致程度。探究二者错位的情况有助于合理利用WordNet并促进其改进。我们通过设计模板收集人类参与者的反馈进行分析,揭示了WordNet语义关系知识与人类直觉之间存在普遍错位。进一步分析发现同义关系和分类关系(上下位关系)存在系统性错配模式,同时WordNet路径长度并不能作为人类对上下位关系直觉的可靠指标。