Systems that support users in the automatic creation of visualizations must address several subtasks - understand the semantics of data, enumerate relevant visualization goals and generate visualization specifications. In this work, we pose visualization generation as a multi-stage generation problem and argue that well-orchestrated pipelines based on large language models (LLMs) such as ChatGPT/GPT-4 and image generation models (IGMs) are suitable to addressing these tasks. We present LIDA, a novel tool for generating grammar-agnostic visualizations and infographics. LIDA comprises of 4 modules - A SUMMARIZER that converts data into a rich but compact natural language summary, a GOAL EXPLORER that enumerates visualization goals given the data, a VISGENERATOR that generates, refines, executes and filters visualization code and an INFOGRAPHER module that yields data-faithful stylized graphics using IGMs. LIDA provides a python api, and a hybrid user interface (direct manipulation and multilingual natural language) for interactive chart, infographics and data story generation. Learn more about the project here - https://microsoft.github.io/lida/
翻译:支持用户自动创建可视化系统的系统需要处理多个子任务——理解数据语义、枚举相关可视化目标以及生成可视化规范。在本工作中,我们将可视化生成视为一个多阶段生成问题,并论证基于大型语言模型(如ChatGPT/GPT-4)和图像生成模型的精心编排管道适合解决这些任务。我们提出LIDA——一种用于生成语法无关的可视化与信息图的新型工具。LIDA包含四个模块:SUMMARIZER(将数据转换为丰富但紧凑的自然语言摘要)、GOAL EXPLORER(根据数据枚举可视化目标)、VISGENERATOR(生成、优化、执行并过滤可视化代码)以及INFOGRAPHER(利用图像生成模型生成忠实于数据的风格化图形)。LIDA提供Python API和混合用户界面(直接操作与多语言自然语言)以支持交互式图表、信息图及数据故事生成。了解更多项目信息请访问:https://microsoft.github.io/lida/