Although humans have five basic senses, sight, hearing, touch, smell, and taste, most multimedia systems in current systems only capture two of them, namely, sight and hearing. With the development of the metaverse and related technologies, there is a growing need for a more immersive media format that leverages all human senses. Multisensory media(Mulsemedia) that can stimulate multiple senses will play a critical role in the near future. This paper provides an overview of the history, background, use cases, existing research, devices, and standards of mulsemedia. Emerging mulsemedia technologies such as Extended Reality (XR) and Holographic-Type Communication (HTC) are introduced. Additionally, the challenges in mulsemedia research from the perspective of wireless communication and networking are discussed. The potential of 6G wireless systems to address these challenges is highlighted, and several research directions that can advance mulsemedia communications are identified.
翻译:尽管人类拥有视觉、听觉、触觉、嗅觉和味觉五种基本感官,但目前大多数多媒体系统仅能捕捉其中两种(即视觉和听觉)。随着元宇宙及相关技术的发展,业界对能够调动人类全部感官的沉浸式媒体格式需求日益增长。能够刺激多种感官的多感官媒体(Mulsemedia)在不远的将来将发挥关键作用。本文概述了多感官媒体的历史沿革、背景知识、应用场景、现有研究、设备及标准,介绍了扩展现实(XR)和全息通信(HTC)等新兴多感官媒体技术。此外,从无线通信与组网的角度探讨了多感官媒体研究面临的挑战,强调了6G无线系统在应对这些挑战方面的潜力,并提出了能够推动多感官媒体通信发展的若干研究方向。