This paper addresses the challenge of leveraging imperfect language models to guide human decision-making in the context of a grounded navigation task. We show that an imperfect instruction generation model can be complemented with an effective communication mechanism to become more successful at guiding humans. The communication mechanism we build comprises models that can detect potential hallucinations in instructions and suggest practical alternatives, and an intuitive interface to present that information to users. We show that this approach reduces the human navigation error by up to 29% with no additional cognitive burden. This result underscores the potential of integrating diverse communication channels into AI systems to compensate for their imperfections and enhance their utility for humans.
翻译:本文针对在具体导航任务中利用不完美语言模型引导人类决策的挑战展开研究。我们证明,通过构建有效的沟通机制,可弥补不完美指令生成模型的缺陷,使其在引导人类时更为成功。该沟通机制包含:检测指令中潜在语法错误并提出实用替代方案的检测模型,以及向用户呈现此类信息的直观界面。实验表明,该方法在未增加额外认知负担的情况下,将人类导航错误率降低高达29%。该结果凸显了将多样化沟通渠道融入人工智能系统以补偿其缺陷、增强其实用性的潜力。