We designed and evaluated an AI pilot in a planetarium visualization software, OpenSpace, for public shows in science centers. The piloting role is usually given to a human working in close collaboration with the guide on stage. We recruited 7 professional guides with extensive experience in giving shows to the public to study the impact of the AI-piloting on the overall experience. The AI-pilot is a conversational AI-agent listening to the guide and interpreting the verbal statements as commands to execute camera motions, change simulation time, or toggle visual assets. Our results show that, while AI pilots lack several critical skills for live shows, they could become useful as co-pilots to reduce workload of human pilots and allow multitasking. We propose research directions toward implementing visualization pilots and co-pilots in live settings.
翻译:我们设计并评估了在天文馆可视化软件OpenSpace中为科学中心公众展览部署的AI操控系统。操控角色通常由与台上讲解员密切协作的人类操作员担任。我们招募了7位具有丰富公众展览经验的专业讲解员,以研究AI操控对整体体验的影响。该AI操控系统是一个对话式智能体,能够听取讲解员的语音指令,将其解析为执行镜头运动、调整模拟时间或切换可视化资源的控制命令。我们的研究结果表明,尽管AI操控员在实时展览中缺乏多项关键技能,但作为协同操控员仍具有应用价值,可减轻人类操作员的工作负荷并实现多任务处理。我们提出了在实时场景中实现可视化主操控与协同操控系统的研究方向。