Creative coding tasks are often exploratory in nature. When producing digital artwork, artists usually begin with a high-level semantic construct such as a "stained glass filter" and programmatically implement it by varying code parameters such as shape, color, lines, and opacity to produce visually appealing results. Based on interviews with artists, it can be effortful to translate semantic constructs to program syntax, and current programming tools don't lend well to rapid creative exploration. To address these challenges, we introduce Spellburst, a large language model (LLM) powered creative-coding environment. Spellburst provides (1) a node-based interface that allows artists to create generative art and explore variations through branching and merging operations, (2) expressive prompt-based interactions to engage in semantic programming, and (3) dynamic prompt-driven interfaces and direct code editing to seamlessly switch between semantic and syntactic exploration. Our evaluation with artists demonstrates Spellburst's potential to enhance creative coding practices and inform the design of computational creativity tools that bridge semantic and syntactic spaces.
翻译:创意编程任务通常具有探索性本质。在生成数字艺术作品时,艺术家通常从"彩色玻璃滤镜"等高层次语义概念入手,通过调整形状、颜色、线条、透明度等代码参数进行编程实现,以获得视觉上令人满意的效果。基于对艺术家的访谈,将语义概念转化为程序语法需要耗费大量精力,且现有编程工具难以支持快速创意探索。为解决这些挑战,我们提出了Spellburst——一个由大型语言模型驱动的创意编程环境。Spellburst提供:(1)基于节点的界面,允许艺术家通过分支与合并操作创建生成式艺术并进行变体探索;(2)富有表现力的提示词交互方式,实现语义编程;(3)动态提示驱动界面与直接代码编辑功能,可在语义与语法探索之间无缝切换。通过与艺术家的评估,Spellburst展现了提升创意编程实践的潜力,并为弥合语义与语法空间的计算创造力工具设计提供了参考。