The emergence of ChatGPT has recently garnered significant attention from the computational linguistics community. To demonstrate its capabilities as a keyphrase generator, we conduct a preliminary evaluation of ChatGPT for the keyphrase generation task. We evaluate its performance in various aspects, including keyphrase generation prompts, keyphrase generation diversity, multi-domain keyphrase generation, and long document understanding. Our evaluation is based on six benchmark datasets, and we adopt the prompt suggested by OpenAI while extending it to six candidate prompts. We find that ChatGPT performs exceptionally well on all six candidate prompts, with minor performance differences observed across the datasets. Based on our findings, we conclude that ChatGPT has great potential for keyphrase generation. Moreover, we discover that ChatGPT still faces challenges when it comes to generating absent keyphrases. Meanwhile, in the final section, we also present some limitations and future expansions of this report.

翻译：摘要：ChatGPT的出现近期引起了计算语言学界的广泛关注。为验证其作为关键词生成器的能力，我们对ChatGPT在关键词生成任务中的表现进行了初步评估。我们从关键词生成提示、关键词生成多样性、多领域关键词生成以及长篇文档理解等多个维度评估其性能。基于六个基准数据集，我们采用OpenAI建议的提示方案，并将其扩展为六种候选提示。研究发现，ChatGPT在所有六种候选提示下均表现优异，仅在数据集间存在细微性能差异。基于这些发现，我们得出结论：ChatGPT在关键词生成领域具有巨大潜力。此外，我们发现ChatGPT在生成缺失关键词方面仍面临挑战。最后，本文还探讨了本研究的局限性及未来拓展方向。