In this work, we present empirical results regarding the feasibility of using offline large language models (LLMs) in the context of electronic design automation (EDA). The goal is to investigate and evaluate a contemporary language model's (Llama-2-7B) ability to function as a microelectronic Q & A expert as well as its reasoning, and generation capabilities in solving microelectronic-related problems. Llama-2-7B was tested across a variety of adaptation methods, including introducing a novel low-rank knowledge distillation (LoRA-KD) scheme. Our experiments produce both qualitative and quantitative results.
翻译:本研究针对离线大型语言模型在电子设计自动化领域的应用可行性进行了实证分析。旨在探究并评估当代语言模型(Llama-2-7B)作为微电子问答专家的能力,及其在解决微电子相关问题时的推理与生成性能。我们通过多种适配方法对Llama-2-7B进行了测试,包括引入新型低秩知识蒸馏方案。实验获得了定性与定量的双重结果。