Scanning Electron Microscopes (SEMs) are widely renowned for their ability to analyze the surface structures of microscopic objects, offering the capability to capture highly detailed, yet only grayscale, images. To create more expressive and realistic illustrations, these images are typically manually colorized by an artist with the support of image editing software. This task becomes highly laborious when multiple images of a scanned object require colorization. We propose facilitating this process by using the underlying 3D structure of the microscopic scene to propagate the color information to all the captured images, from as little as one colorized view. We explore several scene representation techniques and achieve high-quality colorized novel view synthesis of a SEM scene. In contrast to prior work, there is no manual intervention or labelling involved in obtaining the 3D representation. This enables an artist to color a single or few views of a sequence and automatically retrieve a fully colored scene or video. Project page: https://ronly2460.github.io/ArCSEM
翻译:扫描电子显微镜(SEM)以其分析微观物体表面结构的能力而广受赞誉,能够捕获高度详细但仅为灰度的图像。为创建更具表现力和真实感的图示,这些图像通常由艺术家在图像编辑软件支持下进行手动着色。当扫描对象的多个图像需要着色时,该任务变得极为繁琐。我们提出利用微观场景的底层三维结构,将色彩信息从少量(可仅需一幅)着色视图传播至所有捕获图像,以简化此流程。我们探索了多种场景表示技术,实现了SEM场景的高质量着色新视角合成。与先前工作不同,本方法在获取三维表示时无需人工干预或标注。这使得艺术家仅需对序列中的单幅或少量视图进行着色,即可自动获得完整着色的场景或视频。项目页面:https://ronly2460.github.io/ArCSEM