Publicly deploying research chatbots is a nuanced topic involving necessary risk-benefit analyses. While there have recently been frequent discussions on whether it is responsible to deploy such models, there has been far less focus on the interaction paradigms and design approaches that the resulting interfaces should adopt, in order to achieve their goals more effectively. We aim to pose, ground, and attempt to answer HCI questions involved in this scope, by reporting on a mixed-methods user study conducted on a recent research chatbot. We find that abstract anthropomorphic representation for the agent has a significant effect on user's perception, that offering AI explainability may have an impact on feedback rates, and that two (diegetic and extradiegetic) levels of the chat experience should be intentionally designed. We offer design recommendations and areas of further focus for the research community.

翻译：公开部署研究型聊天机器人是一个涉及必要风险-收益分析的复杂议题。尽管近期学界频繁讨论此类模型是否应当被负责任地部署，但对于如何通过交互范式与设计方法构建更高效实现目标的用户界面，相关研究仍显不足。本文旨在通过一项针对最新研究型聊天机器人的混合方法用户研究，提出、论证并尝试回答该领域的人机交互问题。研究发现：智能体拟人化抽象表征显著影响用户感知，提供AI可解释性可能对反馈率产生影响，且会话体验需从叙事层与非叙事层两个维度进行刻意设计。我们为学界提供了设计建议及需要进一步聚焦的研究方向。