Navigating the landscape of particle accelerators has become increasingly challenging with recent surges in contributions. These intricate devices challenge comprehension, even within individual facilities. To address this, we introduce PACuna, a fine-tuned language model refined through publicly available accelerator resources like conferences, pre-prints, and books. We automated data collection and question generation to minimize expert involvement and make the data publicly available. PACuna demonstrates proficiency in addressing intricate accelerator questions, validated by experts. Our approach shows adapting language models to scientific domains by fine-tuning technical texts and auto-generated corpora capturing the latest developments can further produce pre-trained models to answer some intricate questions that commercially available assistants cannot and can serve as intelligent assistants for individual facilities.
翻译:随着近期研究贡献的激增,在粒子加速器领域中进行导航变得愈发具有挑战性。这些精密设备即便在单个设施内部也难以全面理解。为解决这一问题,我们提出了PACuna——一种通过公开可获取的加速器资源(如会议论文、预印本和专著)进行微调的语言模型。我们实现了数据收集与问题生成的自动化,以最大限度减少专家参与,并向公众开放了相关数据。经专家验证,PACuna在处理复杂的加速器问题方面展现出专业能力。本研究表明,通过技术文本微调以及捕捉最新进展的自动生成语料库,将语言模型适配至科学领域,能够进一步催生出可回答商用助手无法处理的复杂问题的预训练模型,并可作为单个设施的智能助手。