Children's drawings have a wonderful inventiveness, creativity, and variety to them. We present a system that automatically animates children's drawings of the human figure, is robust to the variance inherent in these depictions, and is simple and straightforward enough for anyone to use. We demonstrate the value and broad appeal of our approach by building and releasing the Animated Drawings Demo, a freely available public website that has been used by millions of people around the world. We present a set of experiments exploring the amount of training data needed for fine-tuning, as well as a perceptual study demonstrating the appeal of a novel "twisted perspective" retargeting technique. Finally, we introduce the Amateur Drawings Dataset, a first-of-its-kind annotated dataset, collected via the public demo, containing ~180,000 amateur drawings and corresponding user-accepted character bounding box, segmentation mask, and joint location annotations.
翻译:儿童画作充满了奇妙的创意、创造力和多样性。我们提出了一种系统,能够自动为儿童的人物画作添加动画效果,且对画作中固有的差异性具有鲁棒性,同时设计得足够简单直观,任何人都能使用。通过构建并发布“动画画作演示”(Animated Drawings Demo)这一免费公共网站(全球已有数百万人使用),我们展示了该方法的价值和广泛吸引力。我们开展了一系列实验,探究微调所需训练数据的规模,并进行了感知研究,证明了一种新颖的“扭曲透视”(twisted perspective)重定向技术的吸引力。最后,我们介绍了“业余画作数据集”(Amateur Drawings Dataset),这是首个此类带注释的数据集,通过公共演示网站收集,包含约18万幅业余画作及其对应的用户认可的人物边界框、分割掩码和关节位置标注。