We introduce DrawTalking, a prototype system enabling an approach that empowers users to build interactive worlds by sketching and speaking. The approach emphasizes user control and flexibility, and gives programming-like capability without requiring code. An early open-ended study shows the mechanics resonate and are applicable to many creative-exploratory use cases, with the potential to inspire and inform research in future natural interfaces for creative exploration and authoring.

翻译：我们提出DrawTalking，一个原型系统，它实现了一种通过涂鸦和语音赋予用户构建交互世界能力的方法。该方法强调用户控制与灵活性，无需编写代码即可提供类编程能力。一项早期开放式研究表明，其机制能够引发共鸣并适用于多种创造性探索场景，有望为未来面向创造性探索与创作的天然交互界面研究提供灵感和参考。