Game UI development is essential to the game industry. However, the traditional workflow requires substantial manual effort to integrate pairwise UI and UX designs into a cohesive game user interface (GameUI). The inconsistency between the aesthetic UI design and the functional UX design typically results in mismatches and inefficiencies. To address the issue, we present an automatic system, AutoGameUI, for efficiently and accurately constructing GameUI. The system centers on a two-stage multimodal learning pipeline to obtain the optimal correspondences between UI and UX designs. The first stage learns the comprehensive representations of UI and UX designs from multimodal perspectives. The second stage incorporates grouped cross-attention modules with constrained integer programming to estimate the optimal correspondences through top-down hierarchical matching. The optimal correspondences enable the automatic GameUI construction. We create the GAMEUI dataset, comprising pairwise UI and UX designs from real-world games, to train and validate the proposed method. Besides, an interactive web tool is implemented to ensure high-fidelity effects and facilitate human-in-the-loop construction. Extensive experiments on the GAMEUI and RICO datasets demonstrate the effectiveness of our system in maintaining consistency between the constructed GameUI and the original designs. When deployed in the workflow of several mobile games, AutoGameUI achieves a 3$\times$ improvement in time efficiency, conveying significant practical value for game UI development.

翻译：游戏用户界面开发对游戏产业至关重要。然而，传统工作流程需要大量人工努力将成对的UI与UX设计整合为统一的游戏用户界面（GameUI）。美学UI设计与功能UX设计之间的不一致通常导致匹配错误与效率低下。为解决此问题，我们提出了一种自动系统AutoGameUI，用于高效准确地构建GameUI。该系统的核心是一个两阶段多模态学习流程，旨在获取UI与UX设计之间的最优对应关系。第一阶段从多模态视角学习UI与UX设计的综合表征。第二阶段结合分组交叉注意力模块与约束整数规划，通过自上而下的分层匹配估计最优对应关系。最优对应关系实现了GameUI的自动构建。我们创建了GAMEUI数据集，包含来自真实游戏的成对UI与UX设计，用于训练和验证所提方法。此外，我们实现了一个交互式网络工具，以确保高保真效果并促进人机协同构建。在GAMEUI和RICO数据集上的大量实验表明，我们的系统在保持构建的GameUI与原始设计一致性方面具有显著效果。在多个手机游戏的工作流程中部署时，AutoGameUI实现了3$\times$的时间效率提升，为游戏UI开发带来了重要的实用价值。