We argue that enabling human-AI dialogue, purposed to support joint reasoning (i.e., 'inquiry'), is important for ensuring that AI decision making is aligned with human values and preferences. In particular, we point to logic-based models of argumentation and dialogue, and suggest that the traditional focus on persuasion dialogues be replaced by a focus on inquiry dialogues, and the distinct challenges that joint inquiry raises. Given recent dramatic advances in the performance of large language models (LLMs), and the anticipated increase in their use for decision making, we provide a roadmap for research into inquiry dialogues for supporting joint human-LLM reasoning tasks that are ethically salient, and that thereby require that decisions are value aligned.

翻译：我们认为，实现以支持联合推理（即“探究”）为目的的人机对话，对于确保人工智能决策与人类价值观及偏好保持一致至关重要。本文特别指出基于逻辑的论证与对话模型，并建议将传统上对说服性对话的关注转向探究性对话，以及联合探究所引发的独特挑战。鉴于大型语言模型（LLM）性能近期取得的显著进展，以及其预期在决策支持中日益增长的应用，我们为相关研究提出了路线图，旨在探索如何通过探究性对话支持涉及伦理敏感性的人-LLM联合推理任务，从而确保决策过程符合价值对齐要求。