The assembly instruction is a mandatory component of Lego-like brick sets.The conventional production of assembly instructions requires a considerable amount of manual fine-tuning, which is intractable for casual users and customized brick sets.Moreover, the traditional paper-based instructions lack expressiveness and interactivity.To tackle the two problems above, we present BrickPal, an augmented reality-based system, which visualizes assembly instructions in an augmented reality head-mounted display. It utilizes Natural Language Processing (NLP) techniques to generate plausible assembly sequences, and provide real-time guidance in the AR headset.Our user study demonstrates BrickPal's effectiveness at assisting users in brick assembly compared to traditional assembly methods. Additionally, the NLP algorithm-generated assembly sequences achieve the same usability with manually adapted sequences.

翻译：组装说明书是乐高式积木套装的必备组成部分。传统组装说明书的制作需要大量人工精细调整，这对普通用户和定制积木套件而言难以实现。此外，传统的纸质说明书缺乏表现力和交互性。针对上述两个问题，我们提出了BrickPal——一款基于增强现实的系统，可将组装说明可视化在增强现实头戴显示器中。该系统利用自然语言处理技术生成合理的组装顺序，并在AR头显中提供实时引导。用户研究表明，与传统组装方法相比，BrickPal在辅助用户完成积木组装方面具有显著效果。此外，由NLP算法生成的组装序列在可用性上与手动调整的序列相当。