The Metaverse through VR headsets is a rapidly growing concept, but the high cost of entry currently limits access for many users. This project aims to provide an accessible entry point to the immersive Metaverse experience by leveraging web technologies. The platform developed allows users to engage with rendered avatars using only a web browser, microphone, and webcam. By employing the WebGL and MediaPipe face tracking AI model from Google, the application generates real-time 3D face meshes for users. It uses a client-to-client streaming cluster to establish a connection, and clients negotiate SRTP protocol through WebRTC for direct data streaming. Additionally, the project addresses backend challenges through an architecture that is serverless, distributive, auto-scaling, highly resilient, and secure. The platform offers a scalable, hardware-free solution for users to experience a near-immersive Metaverse, with the potential for future integration with game server clusters. This project provides an important step toward a more inclusive Metaverse accessible to a wider audience.

翻译：通过VR头显实现的元宇宙是一个快速发展的概念，但高昂的入门成本目前限制了许多用户的访问。本项目旨在通过利用Web技术，为沉浸式元宇宙体验提供一个可访问的入口。所开发的平台允许用户仅使用网页浏览器、麦克风和摄像头与渲染的化身进行交互。通过采用谷歌的WebGL和MediaPipe面部追踪AI模型，该应用为用户生成实时的3D面部网格。它使用客户端到客户端的流式传输集群建立连接，客户端通过WebRTC协商SRTP协议进行直接数据流式传输。此外，该项目通过一种无服务器、分布式、自动扩展、高弹性且安全的架构解决了后端挑战。该平台为用户提供了一种可扩展、无需硬件的方案来体验接近沉浸式的元宇宙，并具备未来与游戏服务器集群集成的潜力。该项目为迈向更广泛用户可访问、更具包容性的元宇宙迈出了重要一步。