Graphical User Interface (or simply UI) is a primary mean of interaction between users and their device. In this paper, we discuss three major complementary approaches on how to use Artificial Intelligence (AI) to support app designers create better, more diverse, and creative UI of mobile apps. First, designers can prompt a Large Language Model (LLM) like GPT to directly generate and adjust one or multiple UIs. Second, a Vision-Language Model (VLM) enables designers to effectively search a large screenshot dataset, e.g. from apps published in app stores. The third approach is to train a Diffusion Model (DM) specifically designed to generate app UIs as inspirational images. We discuss how AI should be used, in general, to inspire and assist creative app design rather than automating it.
翻译:图形用户界面(简称UI)是用户与其设备交互的主要方式。本文探讨了三种主要的互补性方法,旨在利用人工智能(AI)支持应用程序设计师创建更优质、更多样化且更具创意的移动应用UI。首先,设计师可以通过提示大型语言模型(如GPT)直接生成并调整一个或多个UI。其次,视觉语言模型使设计师能够高效搜索大型截图数据集,例如来自应用商店已发布应用的截图。第三种方法是训练专门用于生成应用UI作为灵感图像的扩散模型。我们总体讨论了应如何利用AI来启发和辅助创造性的应用设计,而非实现其自动化。