The recent advances in Large Language Models (LLMs) have stimulated interest among researchers and industry professionals, particularly in their application to tasks concerning mobile user interfaces (UIs). This position paper investigates the use of LLMs for UI layout generation. Central to our exploration is the introduction of UI grammar -- a novel approach we proposed to represent the hierarchical structure inherent in UI screens. The aim of this approach is to guide the generative capacities of LLMs more effectively and improve the explainability and controllability of the process. Initial experiments conducted with GPT-4 showed the promising capability of LLMs to produce high-quality user interfaces via in-context learning. Furthermore, our preliminary comparative study suggested the potential of the grammar-based approach in improving the quality of generative results in specific aspects.
翻译:近年来,大型语言模型(LLMs)的进展激发了研究人员和行业从业者的兴趣,尤其是在移动用户界面(UI)相关任务中的应用。本立场论文探讨了LLMs在UI布局生成中的使用。我们探索的核心是引入UI语法——这是一种我们提出的新方法,用于表示UI屏幕中固有的层次结构。该方法的目的是更有效地引导LLMs的生成能力,并提高该过程的可解释性和可控性。使用GPT-4进行的初步实验表明,LLMs通过上下文学习能够生成高质量的用户界面。此外,我们的初步对比研究暗示,基于语法的方法在特定方面有潜力提升生成结果的质量。