The research communities studying visualization and sonification for data display and analysis share exceptionally similar goals, essentially making data of any kind interpretable to humans. One community does so by using visual representations of data, the other community does so by employing auditory (non-speech) representations of data. While the two communities have a lot in common, they developed mostly in parallel over the course of the last few decades. With this STAR, we discuss a collection of work that bridges the borders of the two communities, hence a collection of work that aims to integrate the two techniques to one form of audiovisual display, which we argue to be "more than the sum of the two." We introduce and motivate a classification system applicable to such audiovisual displays and categorize a corpus of 57 academic publications that appeared between 2011 and 2023 in categories such as reading level, dataset type, or evaluation system, to mention a few. The corpus also enables a meta-analysis of the field, including regularly occurring design patterns such as type of visualization and sonification techniques, or the use of visual and auditory channels, and the analysis of a co-author network of the field which shows individual teams without much interconnection. The body of work covered in this STAR also relates to three adjacent topics: audiovisual monitoring, accessibility, and audiovisual data art. These three topics are discussed individually in addition to the systematically conducted part of this research. The findings of this report may be used by researchers from both fields to understand the potentials and challenges of such integrated designs, while inspiring them for future collaboration with experts from the respective other field.

翻译：研究数据可视化与听音化（数据声音化）的两个学术共同体，在数据展示与分析领域追求极为相似的目标——本质上都是让各类数据成为人类可理解的形态。一个共同体通过数据的视觉表征实现这一目标，另一个则采用听觉（非语音）表征。尽管这两个共同体拥有众多共同点，但在过去数十年间，它们主要呈并行发展态势。本报告（STAR）聚焦于跨越这两个共同体边界的研究工作合集，即旨在将两种技术整合为视听一体化呈现形式——我们认为这种整合"超越两者简单之和"。我们提出并论证了一种适用于此类视听呈现的分类体系，对2011年至2023年间发表的57篇学术文献进行了系统归类，涵盖阅读难度等级、数据集类型、评估体系等维度。该语料库还支持对该领域的元分析，包括揭示可视化与听音化技术的常见设计模式、视觉与听觉通道的运用方式，以及对该领域合著者网络的分析——该网络显示，研究团队之间缺乏充分互联。本报告涉及的研究工作还延伸至三个相邻领域：视听监控、无障碍设计及视听数据艺术。除系统化研究部分外，我们对这三个主题分别进行了专题讨论。本报告的研究成果可供两个领域的研究者理解此类整合设计的潜力与挑战，同时激发他们与跨领域专家开展未来合作。