Augmented reality technology has been widely used in industrial design interaction, exhibition guide, information retrieval and other fields. The combination of artificial intelligence and augmented reality technology has also become a future development trend. This project is an AR visualization system for ship detection and recognition based on AI, which mainly includes three parts: artificial intelligence module, Unity development module and Hololens2AR module. This project is based on R3Det algorithm to complete the detection and recognition of ships in remote sensing images. The recognition rate of model detection trained on RTX 2080Ti can reach 96%. Then, the 3D model of the ship is obtained by ship categories and information and generated in the virtual scene. At the same time, voice module and UI interaction module are added. Finally, we completed the deployment of the project on Hololens2 through MRTK. The system realizes the fusion of computer vision and augmented reality technology, which maps the results of object detection to the AR field, and makes a brave step toward the future technological trend and intelligent application.
翻译:增强现实技术已广泛应用于工业设计交互、展览导览、信息检索等领域。人工智能与增强现实技术的融合亦成为未来发展趋势。本项目构建了基于AI的船舶检测与识别增强现实可视化系统,主要由三大模块构成:人工智能模块、Unity开发模块及Hololens2AR模块。系统基于R3Det算法完成遥感图像中船舶的检测与识别,在RTX 2080Ti上训练得到的模型检测识别率可达96%。随后,通过船舶类别与信息获取三维模型,并在虚拟场景中生成该模型。同时,系统集成了语音模块与UI交互模块。最终,借助MRTK完成项目在Hololens2上的部署。本系统实现了计算机视觉与增强现实技术的融合,将目标检测结果映射至AR领域,为未来技术趋势与智能化应用迈出了重要一步。