Recent advancements in AI foundation models have made it possible for them to be utilized off-the-shelf for creative tasks, including ideating design concepts or generating visual prototypes. However, integrating these models into the creative process can be challenging as they often exist as standalone applications tailored to specific tasks. To address this challenge, we introduce Jigsaw, a prototype system that employs puzzle pieces as metaphors to represent foundation models. Jigsaw allows designers to combine different foundation model capabilities across various modalities by assembling compatible puzzle pieces. To inform the design of Jigsaw, we interviewed ten designers and distilled design goals. In a user study, we showed that Jigsaw enhanced designers' understanding of available foundation model capabilities, provided guidance on combining capabilities across different modalities and tasks, and served as a canvas to support design exploration, prototyping, and documentation.

翻译：摘要：近期AI基础模型的进步使其能够直接用于创造性任务，包括构思设计概念或生成视觉原型。然而，将这些模型融入创作过程仍具挑战性，因为它们通常作为针对特定任务的独立应用存在。为解决这一难题，我们提出Jigsaw原型系统——该系统采用拼图碎片作为隐喻来表征基础模型。通过组装兼容的拼图碎片，Jigsaw使设计师能够整合不同模态下各类基础模型的能力。为完善Jigsaw设计，我们访谈了十位设计师并提炼出设计目标。用户研究表明，Jigsaw不仅增强了设计师对可用基础模型能力的理解，提供了跨模态与跨任务组合能力的指导，还作为创意画布支持设计探索、原型制作与文档记录。