We propose an unsupervised image segmentation approach, that combines a variational energy functional and deep convolutional neural networks. The variational part is based on a recent multichannel multiphase Chan-Vese model, which is capable to extract useful information from multiple input images simultaneously. We implement a flexible multiclass segmentation method that divides a given image into $K$ different regions. We use convolutional neural networks (CNNs) targeting a pre-decomposition of the image. By subsequently minimising the segmentation functional, the final segmentation is obtained in a fully unsupervised manner. Special emphasis is given to the extraction of informative feature maps serving as a starting point for the segmentation. The initial results indicate that the proposed method is able to decompose and segment the different regions of various types of images, such as texture and medical images and compare its performance with another multiphase segmentation method.
翻译:我们提出一种无监督图像分割方法,该方法结合了变分能量泛函与深度卷积神经网络。变分部分基于最近提出的多通道多相位Chan-Vese模型,该模型能够同时从多幅输入图像中提取有用信息。我们实现了一种灵活的多类分割方法,将给定图像划分为$K$个不同区域。利用卷积神经网络(CNNs)对图像进行预分解,随后通过最小化分割泛函,以完全无监督的方式获得最终分割结果。特别注重提取信息丰富的特征图,作为分割的起始点。初步结果表明,所提方法能够分解并分割各类图像(如纹理图像和医学图像)中的不同区域,并与另一种多相位分割方法进行了性能对比。