Melanoma is the most lethal type of skin cancer. Patients are vulnerable to mental health illnesses which can reduce the effectiveness of the cancer treatment and the patients adherence to drug plans. It is crucial to preserve the mental health of patients while they are receiving treatment. However, current art therapy approaches are not personal and unique to the patient. We aim to provide a well-trained image style transfer model that can quickly generate unique art from personal dermoscopic melanoma images as an additional tool for art therapy in disease management of melanoma. Visual art appreciation as a common form of art therapy in disease management that measurably reduces the degree of psychological distress. We developed a network based on the cycle-consistent generative adversarial network for style transfer that generates personalized and unique artworks from dermoscopic melanoma images. We developed a model that converts melanoma images into unique flower-themed artworks that relate to the shape of the lesion and are therefore personal to the patient. Further, we altered the initial framework and made comparisons and evaluations of the results. With this, we increased the options in the toolbox for art therapy in disease management of melanoma. The development of an easy-to-use user interface ensures the availability of the approach to stakeholders. The transformation of melanoma into flower-themed artworks is achieved by the proposed model and the graphical user interface. This contribution opens a new field of GANs in art therapy and could lead to more personalized disease management.
翻译:黑色素瘤是皮肤癌中致死率最高的一种。患者容易产生心理疾病,这会降低癌症治疗效果及患者对药物方案的依从性。在患者接受治疗期间维护其心理健康至关重要。然而,当前艺术治疗方法缺乏针对患者的个性化和独特性。本研究旨在提供一个训练有素的图像风格迁移模型,能够从个人皮肤镜黑色素瘤图像中快速生成独特艺术品,作为黑色素瘤疾病管理中艺术治疗的辅助工具。视觉艺术欣赏作为疾病管理中常见的艺术治疗形式,能够显著减轻心理困扰程度。我们基于循环一致性生成对抗网络开发了一种用于风格迁移的网络模型,可从皮肤镜黑色素瘤图像生成个性化、独特的艺术品。该模型将黑色素瘤图像转化为与病灶形状相关的花卉主题艺术品,从而实现对患者的个性化定制。此外,我们改进了初始框架,并对结果进行了比较与评估。由此,我们增加了黑色素瘤疾病管理艺术治疗工具箱中的可选方案。简易用户界面的开发确保了利益相关方可获取该技术方法。通过所提出的模型和图形用户界面,成功实现了黑色素瘤图像向花卉主题艺术品的转化。这一贡献开创了生成对抗网络在艺术治疗领域的新方向,并为实现更个性化的疾病管理提供了可能。