Although humans have five basic senses, sight, hearing, touch, smell, and taste, most multimedia systems in current systems only capture two of them, namely, sight and hearing. With the development of the metaverse and related technologies, there is a growing need for a more immersive media format that leverages all human senses. Multisensory media(Mulsemedia) that can stimulate multiple senses will play a critical role in the near future. This paper provides an overview of the history, background, use cases, existing research, devices, and standards of mulsemedia. Emerging mulsemedia technologies such as Extended Reality (XR) and Holographic-Type Communication (HTC) are introduced. Additionally, the challenges in mulsemedia research from the perspective of wireless communication and networking are discussed. The potential of 6G wireless systems to address these challenges is highlighted, and several research directions that can advance mulsemedia communications are identified.
翻译:尽管人类拥有五种基本感官,即视觉、听觉、触觉、嗅觉和味觉,但当前大多数多媒体系统仅捕获其中两种:视觉和听觉。随着元宇宙及相关技术的发展,业界对能够充分利用人类所有感官的沉浸式媒体格式的需求日益增长。能够刺激多种感官的多感官媒体(Mulsemedia)将在不久的将来发挥关键作用。本文综述了多感官媒体的历史背景、应用场景、现有研究、设备及标准,并介绍了扩展现实(XR)与全息通信(HTC)等新兴多感官媒体技术。此外,从无线通信与网络视角探讨了多感官媒体研究所面临的挑战,重点阐明了6G无线系统应对这些挑战的潜力,并指出了可推动多感官媒体通信发展的若干研究方向。