Designing user interfaces (UIs) is a critical step when launching products, building portfolios, or personalizing projects, yet end users without design expertise often struggle to articulate their intent and to trust design choices. Existing example-based tools either promote broad exploration, which can cause overwhelm and design drift, or require adapting a single example, risking design fixation. We present UI Remix, an interactive system that supports mobile UI design through an example-driven design workflow. Powered by a multimodal retrieval-augmented generation (MMRAG) model, UI Remix enables iterative search, selection, and adaptation of examples at both the global (whole interface) and local (component) level. To foster trust, it presents source transparency cues such as ratings, download counts, and developer information. In an empirical study with 24 end users, UI Remix significantly improved participants' ability to achieve their design goals, facilitated effective iteration, and encouraged exploration of alternative designs. Participants also reported that source transparency cues enhanced their confidence in adapting examples. Our findings suggest new directions for AI-assisted, example-driven systems that empower end users to design with greater control, trust, and openness to exploration.
翻译:设计用户界面(UI)是发布产品、构建作品集或个性化项目时的关键步骤,然而不具备设计专业知识的终端用户常常难以清晰表达其意图,并对设计选择缺乏信心。现有的基于示例的工具要么鼓励广泛探索(这可能导致信息过载和设计偏离),要么要求基于单一示例进行修改(存在设计固化的风险)。我们提出了UI Remix,这是一个通过示例驱动设计流程支持移动端UI设计的交互式系统。该系统由多模态检索增强生成(MMRAG)模型驱动,支持在全局(整个界面)和局部(组件)级别对设计示例进行迭代式搜索、选择与适配。为建立信任,系统提供了来源透明度提示,如评分、下载量和开发者信息。在一项包含24名终端用户的实证研究中,UI Remix显著提升了参与者实现其设计目标的能力,促进了有效迭代,并鼓励了对替代设计的探索。参与者还反馈,来源透明度提示增强了他们修改示例时的信心。我们的研究结果为人工智能辅助的示例驱动系统指明了新方向,这类系统能够赋能终端用户,使其在设计过程中拥有更强的控制力、信任感以及对探索的开放性。