The research communities studying visualization and sonification for data display and analysis share exceptionally similar goals, essentially making data of any kind interpretable to humans. One community does so by using visual representations of data, and the other community employs auditory (non-speech) representations of data. While the two communities have a lot in common, they developed mostly in parallel over the course of the last few decades. With this STAR, we discuss a collection of work that bridges the borders of the two communities, hence a collection of work that aims to integrate the two techniques into one form of audiovisual display, which we argue to be "more than the sum of the two." We introduce and motivate a classification system applicable to such audiovisual displays and categorize a corpus of 57 academic publications that appeared between 2011 and 2023 in categories such as reading level, dataset type, or evaluation system, to mention a few. The corpus also enables a meta-analysis of the field, including regularly occurring design patterns such as type of visualization and sonification techniques, or the use of visual and auditory channels, showing an overall diverse field with different designs. An analysis of a co-author network of the field shows individual teams without many interconnections. The body of work covered in this STAR also relates to three adjacent topics: audiovisual monitoring, accessibility, and audiovisual data art. These three topics are discussed individually in addition to the systematically conducted part of this research. The findings of this report may be used by researchers from both fields to understand the potentials and challenges of such integrated designs while hopefully inspiring them to collaborate with experts from the respective other field.

翻译：研究数据可视化和声化的两个学术共同体在数据展示与分析领域拥有极其相似的目标——本质上都是为了让人类能够理解任何类型的数据。一个共同体通过视觉数据表征实现这一目标，另一个则采用听觉（非语言）数据表征。尽管这两个领域存在诸多共性，但在过去数十年间，它们基本沿着平行轨迹发展。在这篇STAR（最新技术综述）报告中，我们讨论了一系列跨越两个领域边界的研究成果，即旨在将两种技术融合为一种视听显示形式的研究工作。我们认为这种融合形式"超越了两者简单相加"。我们提出并论证了一套适用于此类视听显示的分类体系，对2011年至2023年间发表的57篇学术文献，按照阅读水平、数据集类型、评估体系等维度进行了系统归类。该文献库还支撑了该领域的元分析，包括可视化与声化技术的类型选择、视听通道的使用等反复出现的设计模式，揭示了该领域整体呈现的多样性设计特征。对合作者网络的分析显示，该领域存在多个各自为战的独立研究团队。本文涵盖的研究工作还涉及三个相邻主题：视听监控、无障碍设计、视听数据艺术。除系统化研究部分外，我们对这三个主题分别进行了独立讨论。本报告的研究发现可帮助两个领域的研究者理解此类融合设计的潜力与挑战，同时期望能激发他们与另一领域的专家开展合作。