As human-robot interaction (HRI) systems advance, so does the difficulty of evaluating and understanding the strengths and limitations of these systems in different environments and with different users. To this end, previous methods have algorithmically generated diverse scenarios that reveal system failures in a shared control teleoperation task. However, these methods require directly evaluating generated scenarios by simulating robot policies and human actions. The computational cost of these evaluations limits their applicability in more complex domains. Thus, we propose augmenting scenario generation systems with surrogate models that predict both human and robot behaviors. In the shared control teleoperation domain and a more complex shared workspace collaboration task, we show that surrogate assisted scenario generation efficiently synthesizes diverse datasets of challenging scenarios. We demonstrate that these failures are reproducible in real-world interactions.

翻译：随着人机交互（HRI）系统的发展，评估和理解这些系统在不同环境及不同用户中的优势与局限也愈发困难。为此，先前的方法已能在共享控制遥操作任务中通过算法生成多样化场景，以揭示系统故障。然而，这些方法需要直接通过模拟机器人策略和人类行为来评估所生成的场景。此类评估的计算成本限制了其在更复杂领域的应用。因此，我们提出利用代理模型来增强场景生成系统，该模型能同时预测人类和机器人的行为。在共享控制遥操作领域及更复杂的共享工作空间协作任务中，我们证明代理辅助的场景生成能够高效地合成具有挑战性的场景的多样化数据集。同时，我们验证了这些故障在现实交互中是可复现的。