The rise of AI agents introduces a fundamental shift in Visual Analytics (VA), in which agents act as a new user group. Current agentic approaches - based on computer vision and raw DOM access - fail to perform VA tasks accurately and efficiently. This paper introduces the Visual Analytics Context Protocol (VACP), a framework designed to make VA applications "agent-ready" that extends generic protocols by explicitly exposing application state, available interactions, and mechanisms for direct execution. To support our context protocol, we contribute a formal specification of AI agent requirements and knowledge representations in VA interfaces. We instantiate VACP as a library compatible with major visualization grammars and web frameworks, enabling augmentation of existing systems and the development of new ones. Our evaluation across representative VA tasks demonstrates that VACP-enabled agents achieve higher success rates in interface interpretation and execution compared to current agentic approaches, while reducing token consumption and latency. VACP closes the gap between human-centric VA interfaces and machine perceivability, ensuring agents can reliably act as collaborative users in VA systems.
翻译:人工智能代理的兴起引发了视觉分析领域的一项根本性转变,即代理作为新的用户群体出现。当前基于计算机视觉和原始DOM访问的代理方法无法准确高效地执行视觉分析任务。本文介绍了视觉分析上下文协议(VACP),这是一个旨在使视觉分析应用程序具备“代理就绪”能力的框架,该框架通过显式暴露应用程序状态、可用交互及直接执行机制来扩展通用协议。为支撑我们的上下文协议,我们提出了视觉分析界面中人工智能代理需求与知识表征的形式化规范。我们将VACP实例化为一个兼容主流可视化语法和Web框架的库,从而支持对现有系统的增强及新系统的开发。在典型视觉分析任务上的评估表明,与当前的代理方法相比,启用VACP的代理在界面解读与执行方面取得了更高的成功率,同时降低了令牌消耗和延迟。VACP弥合了以人为中心的视觉分析界面与机器可感知性之间的鸿沟,确保代理能够可靠地在视觉分析系统中作为协作用户发挥作用。