Generative AI (GenAI) systems promise to transform knowledge work by automating a range of tasks, yet their deployment in enterprise settings remains hindered by the lack of systematic quality assurance mechanisms. We present an Expert Validation Framework that places domain experts at the center of building software with GenAI components, enabling them to maintain authoritative control over system behavior through structured specification, testing, validation, and continuous monitoring processes. Our framework addresses the critical gap between AI capabilities and organizational trust by establishing a rigorous, expert-driven methodology for ensuring quality across diverse GenAI applications. Through a four-stage implementation process encompassing specification, system creation, validation, and production monitoring, the framework enables organizations to leverage GenAI capabilities while maintaining expert oversight and quality standards.
翻译:生成式人工智能(GenAI)系统有望通过自动化一系列任务来变革知识工作,但其在企业环境中的部署仍因缺乏系统化的质量保证机制而受阻。本文提出一种专家验证框架,将领域专家置于构建含GenAI组件的软件的核心位置,使其能够通过结构化的规范制定、测试、验证和持续监控流程,保持对系统行为的权威控制。该框架通过建立一套严谨的、由专家驱动的方法论来确保各类GenAI应用的质量,从而弥合人工智能能力与组织信任之间的关键鸿沟。通过涵盖规范制定、系统构建、验证和生产监控的四阶段实施流程,本框架使组织能够在利用GenAI能力的同时,保持专家监督与质量标准。