Advanced artificial intelligence and machine learning have great potential to redefine how skin lesions are detected, mapped, tracked and documented. Here, We propose a 3D whole-body imaging system known as 3DSkin-mapper to enable automated detection, evaluation and mapping of skin lesions. A modular camera rig arranged in a cylindrical configuration was designed to automatically capture images of the entire skin surface of a subject synchronously from multiple angles. Based on the images, we developed algorithms for 3D model reconstruction, data processing and skin lesion detection and tracking based on deep convolutional neural networks. We also introduced a customised, user-friendly, and adaptable interface that enables individuals to interactively visualise, manipulate, and annotate the images. The proposed system is developed for skin lesion screening, the focus of this paper is to introduce the system instead of clinical study. Using synthetic and real images we demonstrate the effectiveness of the proposed system by providing multiple views of a target skin lesion, enabling further 3D geometry analysis and longitudinal tracking. It takes only a few seconds to capture the entire skin surface, and about half an hour to process and analyse the images. Our experiments show that the proposed system allow fast and easy whole body 3D imaging. It can be used by dermatological clinics to conduct skin screening, detect and track skin lesions over time, identify suspicious lesions, and document pigmented lesions. The system can potentially save clinicians time and effort significantly. The 3D imaging and analysis has the potential to change the paradigm of whole body photography with many applications in skin diseases, including inflammatory and pigmentary disorders.
翻译:先进的人工智能与机器学习在皮肤病变的检测、定位、追踪与记录方面具有巨大潜力。本文提出一种名为3DSkin-mapper的三维全身成像系统,可实现皮肤病变的自动化检测、评估与映射。我们设计了一套模块化圆柱形相机阵列,可同步从多角度自动拍摄受试者全身皮肤表面图像。基于这些图像,我们开发了基于深度卷积神经网络的算法,用于三维模型重建、数据处理以及皮肤病变检测与追踪。此外,我们引入了一套定制化、用户友好且可适配的交互界面,允许用户对图像进行可视化操作、编辑与标注。该系统专为皮肤病变筛查而设计,本文重点介绍系统本身而非临床研究。通过合成图像与真实图像,我们展示了本系统的有效性:可提供目标皮肤病变的多视角图像,支持进一步的三维几何分析与纵向追踪。该系统仅需数秒即可完成全身皮肤表面图像采集,图像处理与分析耗时约半小时。实验表明,本系统能够实现快速便捷的全身三维成像,可用于皮肤科诊所的皮肤筛查、病变随时间变化的检测与追踪、可疑病变识别以及色素性病变记录。该系统有望显著节省临床医生时间与精力。三维成像与分析技术具有改变全身摄影范式的潜力,可广泛应用于炎症性与色素性皮肤病等多种皮肤疾病的诊治。