AI and robotics technologies have witnessed remarkable advancements in the past decade, revolutionizing work patterns and opportunities in various domains. The application of these technologies has propelled society towards an era of symbiosis between humans and machines. To facilitate efficient communication between humans and intelligent robots, we propose the "Avatar" system, an immersive low-latency panoramic human-robot interaction platform. We have designed and tested a prototype of a rugged mobile platform integrated with edge computing units, panoramic video capture devices, power batteries, robot arms, and network communication equipment. Under favorable network conditions, we achieved a low-latency high-definition panoramic visual experience with a delay of 357ms. Operators can utilize VR headsets and controllers for real-time immersive control of robots and devices. The system enables remote control over vast physical distances, spanning campuses, provinces, countries, and even continents (New York to Shenzhen). Additionally, the system incorporates visual SLAM technology for map and trajectory recording, providing autonomous navigation capabilities. We believe that this intuitive system platform can enhance efficiency and situational experience in human-robot collaboration, and with further advancements in related technologies, it will become a versatile tool for efficient and symbiotic cooperation between AI and humans.
翻译:人工智能与机器人技术在过去十年取得了显著进步,革新了各领域的工作模式并创造了新的机遇。这些技术的应用推动社会进入人机共生时代。为促进人与智能机器之间的高效交互,我们提出了"Avatar"系统——一种沉浸式低延迟全景人机交互平台。我们设计并测试了集成边缘计算单元、全景视频采集设备、动力电池、机械臂及网络通信设备的坚固移动平台原型。在良好网络条件下,该系统实现了延迟为357毫秒的低延迟高清全景视觉体验。操作员可通过VR头显与控制器对机器人及设备进行实时沉浸式操控。该系统支持跨越校园、省际、国家乃至洲际(纽约至深圳)的广域物理空间远程控制。此外,系统集成视觉SLAM技术实现地图构建与轨迹记录,提供自主导航能力。我们相信,这种直观的系统平台能够提升人机协作中的效率与情境体验,随着相关技术的进一步发展,它将成为实现人工智能与人类高效共生协作的多功能工具。