Creating visually pleasing stylized ink paintings from 3D models is a challenge in robotic manipulation. We propose a semi-automatic framework that can extract expressive strokes from 3D models and draw them in oriental ink painting styles by using a robotic arm. The framework consists of a simulation stage and a robotic drawing stage. In the simulation stage, geometrical contours were automatically extracted from a certain viewpoint and a neural network was employed to create simplified contours. Then, expressive digital strokes were generated after interactive editing according to user's aesthetic understanding. In the robotic drawing stage, an optimization method was presented for drawing smooth and physically consistent strokes to the digital strokes, and two oriental ink painting styles termed as Noutan (shade) and Kasure (scratchiness) were applied to the strokes by robotic control of a brush's translation, dipping and scraping. Unlike existing methods that concentrate on generating paintings from 2D images, our framework has the advantage of rendering stylized ink paintings from 3D models by using a consumer-grade robotic arm. We evaluate the proposed framework by taking 3 standard models and a user-defined model as examples. The results show that our framework is able to draw visually pleasing oriental ink paintings with expressive strokes.
翻译:在机器人操作中,从3D模型生成视觉优美的风格化水墨画是一项挑战。我们提出了一种半自动框架,能够从3D模型中提取富有表现力的笔触,并通过机械臂以东方水墨画风格进行绘制。该框架包含仿真阶段与机器人绘制阶段。在仿真阶段,首先从特定视角自动提取几何轮廓,并采用神经网络生成简化轮廓;随后根据用户审美理解进行交互式编辑,生成具有表现力的数字笔触。在机器人绘制阶段,提出了一种优化方法以实现对数字笔触的平滑且物理一致的绘制,并通过控制毛笔的平移、蘸墨与刮墨操作,将两种东方水墨画风格——浓淡(Noutan)与枯涩(Kasure)——应用于笔触。与现有聚焦于从二维图像生成绘画的方法不同,本框架的优势在于能够通过消费级机械臂从3D模型渲染出风格化水墨画。我们以三个标准模型与一个用户自定义模型为例对框架进行评估,结果表明该框架能够绘制出具有表现力笔触的视觉优美的东方水墨画。