Entity Set Expansion (ESE) is a critical task aiming to expand entities of the target semantic class described by a small seed entity set. Most existing ESE methods are retrieval-based frameworks that need to extract the contextual features of entities and calculate the similarity between seed entities and candidate entities. To achieve the two purposes, they should iteratively traverse the corpus and the entity vocabulary provided in the datasets, resulting in poor efficiency and scalability. The experimental results indicate that the time consumed by the retrieval-based ESE methods increases linearly with entity vocabulary and corpus size. In this paper, we firstly propose a generative ESE framework, Generative Entity Set Expansion (GenExpan), which utilizes a generative pre-trained language model to accomplish ESE task. Specifically, a prefix tree is employed to guarantee the validity of entity generation, and automatically generated class names are adopted to guide the model to generate target entities. Moreover, we propose Knowledge Calibration and Generative Ranking to further bridge the gap between generic knowledge of the language model and the goal of ESE task. Experiments on publicly available datasets show that GenExpan is efficient and effective. For efficiency, expansion time consumed by GenExpan is independent of entity vocabulary and corpus size, and GenExpan achieves an average 600% speedup compared to strong baselines. For expansion performance, our framework outperforms previous state-of-the-art ESE methods.
翻译:实体集合扩展(Entity Set Expansion, ESE)是一项关键任务,旨在通过少量种子实体集描述的目标语义类别来扩展实体。现有大多数ESE方法基于检索框架,需要提取实体的上下文特征,并计算种子实体与候选实体之间的相似度。为实现这两个目标,它们必须迭代遍历语料库和数据集提供的实体词汇表,导致效率低下且可扩展性差。实验结果表明,基于检索的ESE方法所消耗的时间随实体词汇表和语料库规模线性增长。本文首次提出一种生成式ESE框架——生成式实体集合扩展(Generative Entity Set Expansion, GenExpan),该框架利用生成式预训练语言模型完成ESE任务。具体而言,采用前缀树确保实体生成的有效性,并利用自动生成的类别名称引导模型生成目标实体。此外,我们提出知识校准与生成式排序,进一步弥合语言模型的通用知识与ESE任务目标之间的差距。在公开数据集上的实验表明,GenExpan兼具高效性与有效性。在效率方面,GenExpan的扩展消耗时间与实体词汇表和语料库规模无关,相比强基线方法实现平均600%的加速。在扩展性能方面,我们的框架优于先前最先进的ESE方法。