One of the challenges in text generation is to control text generation as intended by the user. Previous studies proposed specifying the keywords that should be included in the generated text. However, this approach is insufficient to generate text that reflect the user's intent. For example, placing an important keyword at the beginning of the text would help attract the reader's attention; however, existing methods do not enable such flexible control. In this paper, we tackle a novel task of controlling not only keywords but also the position of each keyword in the text generation. To this end, we propose a task-independent method that uses special tokens to control the relative position of keywords. Experimental results on summarization and story generation tasks show that the proposed method can control keywords and their positions. The experimental results also demonstrate that controlling the keyword positions can generate summary texts that are closer to the user's intent than baseline.
翻译:文本生成面临的挑战之一是按用户意图控制生成结果。已有研究提出了指定生成文本中应包含的关键词的方法,但该方法不足以生成反映用户意图的文本。例如,将重要关键词置于文本开头有助于吸引读者注意力,然而现有方法无法实现这种灵活控制。本文探讨了一个新任务:不仅控制关键词,还需控制每个关键词在文本中的位置。为此,我们提出一种与任务无关的方法,通过特殊标记控制关键词的相对位置。在摘要生成和故事生成任务上的实验结果表明,所提方法能够有效控制关键词及其位置。实验还证实,控制关键词位置可生成比基线方法更贴近用户意图的摘要文本。