Multi-agent human-robot teaming allows for the potential to gather information about various environments more efficiently by exploiting and combining the strengths of humans and robots. In industries like defense, search and rescue, first-response, and others alike, heterogeneous human-robot teams show promise to accelerate data collection and improve team safety by removing humans from unknown and potentially hazardous situations. This work builds upon AugRE, an Augmented Reality (AR) based scalable human-robot teaming framework. It enables users to localize and communicate with 50+ autonomous agents. Through our efforts, users are able to command, control, and supervise agents in large teams, both line-of-sight and non-line-of-sight, without the need to modify the environment prior and without requiring users to use typical hardware (i.e. joysticks, keyboards, laptops, tablets, etc.) in the field. The demonstrated work shows early indications that combining these AR-HMD-based user interaction modalities for command, control, and supervision will help improve human-robot team collaboration, robustness, and trust.

翻译：多智能体人机协同通过利用和结合人类与机器人的优势，能够更高效地收集各类环境信息。在国防、搜索救援、应急响应等类似行业中，异构人机团队在加速数据采集和提升团队安全性方面展现出潜力——通过将人类从未知及潜在危险环境中撤离。本研究基于AugRE这一可扩展的增强现实（AR）人机协同框架，支持用户对50个以上自主智能体进行定位与通信。通过本工作，用户无需预先改造环境，也无需在实地使用传统硬件（如操纵杆、键盘、笔记本电脑、平板电脑等），即可对大规模团队中的智能体执行视线内及非视线内的指挥、控制与监督任务。实验表明，将基于AR头戴式显示器的交互模态用于指挥、控制与监督，有望提升人机团队协作效率、鲁棒性与信任度。