In this paper, we present a novel framework that combines large language models (LLMs), digital twins and industrial automation system to enable intelligent planning and control of production processes. We retrofit the automation system for a modular production facility and create executable control interfaces of fine-granular functionalities and coarse-granular skills. Low-level functionalities are executed by automation components, and high-level skills are performed by automation modules. Subsequently, a digital twin system is developed, registering these interfaces and containing additional descriptive information about the production system. Based on the retrofitted automation system and the created digital twins, LLM-agents are designed to interpret descriptive information in the digital twins and control the physical system through service interfaces. These LLM-agents serve as intelligent agents on different levels within an automation system, enabling autonomous planning and control of flexible production. Given a task instruction as input, the LLM-agents orchestrate a sequence of atomic functionalities and skills to accomplish the task. We demonstrate how our implemented prototype can handle un-predefined tasks, plan a production process, and execute the operations. This research highlights the potential of integrating LLMs into industrial automation systems in the context of smart factory for more agile, flexible, and adaptive production processes, while it also underscores the critical insights and limitations for future work. Demos at: https://github.com/YuchenXia/GPT4IndustrialAutomation

翻译：本文提出了一种新颖框架，该框架融合大型语言模型（LLMs）、数字孪生与工业自动化系统，旨在实现生产过程的智能规划与控制。我们对模块化生产设施的自动化系统进行改造，创建了细粒度功能与粗粒度技能的可执行控制接口。低层次功能由自动化组件执行，高层次技能则由自动化模块实现。随后，我们开发了数字孪生系统，注册这些接口并包含生产系统的附加描述信息。基于改造后的自动化系统与构建的数字孪生体，我们设计了LLM智能体，以解读数字孪生体中的描述信息，并通过服务接口控制物理系统。这些LLM智能体作为自动化系统中不同层次的智能体，为柔性生产的自主规划与控制提供支持。给定任务指令作为输入，LLM智能体将编排一系列原子化功能与技能序列以完成任务。我们展示了所实现的原型如何应对非预设任务、规划生产流程并执行操作。本研究凸显了在智能工厂背景下将LLMs集成到工业自动化系统中以实现更敏捷、灵活、自适应生产过程的潜力，同时指出了未来工作的关键洞察与局限性。演示地址：https://github.com/YuchenXia/GPT4IndustrialAutomation