Although humans have five basic senses, sight, hearing, touch, smell, and taste, most multimedia systems in current systems only capture two of them, namely, sight and hearing. With the development of the metaverse and related technologies, there is a growing need for a more immersive media format that leverages all human senses. Multisensory media(Mulsemedia) that can stimulate multiple senses will play a critical role in the near future. This paper provides an overview of the history, background, use cases, existing research, devices, and standards of mulsemedia. Emerging mulsemedia technologies such as Extended Reality (XR) and Holographic-Type Communication (HTC) are introduced. Additionally, the challenges in mulsemedia research from the perspective of wireless communication and networking are discussed. The potential of 6G wireless systems to address these challenges is highlighted, and several research directions that can advance mulsemedia communications are identified.
翻译:尽管人类拥有视觉、听觉、触觉、嗅觉和味觉五种基本感官,但目前大多数多媒体系统仅捕获其中两种,即视觉和听觉。随着元宇宙及相关技术的发展,对能够调动人类所有感官的沉浸式媒体格式的需求日益增长。能够刺激多种感官的多感官媒体(Mulsemedia)将在不久的将来发挥关键作用。本文概述了多感官媒体的历史背景、应用场景、现有研究、设备及标准,介绍了新兴的多感官媒体技术,如扩展现实(XR)和全息型通信(HTC)。同时,从无线通信与网络的角度探讨了多感官媒体研究所面临的挑战,强调了6G无线系统应对这些挑战的潜力,并指出了能够推动多感官媒体通信发展的若干研究方向。