The development of Natural Language Generation models has led to the creation of powerful Artificial Intelligence-assisted writing tools. These tools are capable of predicting users' needs and actively providing suggestions as they write. In this work, we conduct a comparative user-study between such tools from an information retrieval lens: pull and push. Specifically, we investigate the user demand of AI-assisted writing, the impact of the two paradigms on quality, ownership of the writing product, and efficiency and enjoyment of the writing process. We also seek to understand the impact of bias of AI-assisted writing. Our findings show that users welcome seamless assistance of AI in their writing. Furthermore, AI helped users to diversify the ideas in their writing while keeping it clear and concise more quickly. Users also enjoyed the collaboration with AI-assisted writing tools and did not feel a lack of ownership. Finally, although participants did not experience bias in our experiments, they still expressed explicit and clear concerns that should be addressed in future AI-assisted writing tools.
翻译:自然语言生成模型的发展催生了强大的人工智能辅助写作工具。这些工具能够预测用户需求,并在用户写作过程中主动提供建议。本研究从信息检索视角——拉取与推送——对这类工具进行了比较性用户研究。具体而言,我们探究了用户对人工智能辅助写作的需求、两种范式对写作质量、作品归属感以及写作过程效率与愉悦度的影响,并试图理解人工智能辅助写作中偏见的影响。研究结果表明,用户欢迎人工智能在其写作中实现无缝辅助。此外,人工智能帮助用户更快地丰富写作中的思想多样性,同时保持行文清晰简洁。用户也享受与人工智能辅助写作工具的协作,并未感到作品归属感的缺失。最后,尽管参与者在实验中未体验到偏见,但他们仍明确表达了担忧,这些担忧应在未来的人工智能辅助写作工具中得到解决。