AI and robotics technologies have witnessed remarkable advancements in the past decade, revolutionizing work patterns and opportunities in various domains. The application of these technologies has propelled society towards an era of symbiosis between humans and machines. To facilitate efficient communication between humans and intelligent robots, we propose the "Avatar" system, an immersive low-latency panoramic human-robot interaction platform. We have designed and tested a prototype of a rugged mobile platform integrated with edge computing units, panoramic video capture devices, power batteries, robot arms, and network communication equipment. Under favorable network conditions, we achieved a low-latency high-definition panoramic visual experience with a delay of 357ms. Operators can utilize VR headsets and controllers for real-time immersive control of robots and devices. The system enables remote control over vast physical distances, spanning campuses, provinces, countries, and even continents (New York to Shenzhen). Additionally, the system incorporates visual SLAM technology for map and trajectory recording, providing autonomous navigation capabilities. We believe that this intuitive system platform can enhance efficiency and situational experience in human-robot collaboration, and with further advancements in related technologies, it will become a versatile tool for efficient and symbiotic cooperation between AI and humans.
翻译:人工智能与机器人技术在过去十年间取得了显著进展,深刻改变了各领域的工作模式与发展机遇。这些技术的应用推动社会迈向人机共生的新时代。为实现人类与智能机器人之间的高效交互,我们提出"阿凡达"系统——一种沉浸式低延迟全景人机交互平台。我们设计并测试了集成边缘计算单元、全景视频采集装置、动力电池、机械臂及网络通信设备的坚固移动平台原型。在良好网络条件下,系统实现了延迟为357毫秒的低延迟高清全景视觉体验。操作人员可通过VR头显与控制器对机器人及设备进行实时沉浸式控制。该系统支持跨越校园、省际、国家乃至洲际(纽约至深圳)的远程物理操控。此外,系统融合视觉SLAM技术实现地图构建与轨迹记录,具备自主导航能力。我们相信,这种直观的系统平台能够提升人机协作效率与情景体验,随着相关技术的进一步发展,它将成为实现人工智能与人类高效共生协作的通用工具。