Shape learning, or the ability to leverage shape information, could be a desirable property of convolutional neural networks (CNNs) when target objects have specific shapes. While some research on the topic is emerging, there is no systematic study to conclusively determine whether and under what circumstances CNNs learn shape. Here, we present such a study in the context of segmentation networks where shapes are particularly important. We define shape and propose a new behavioral metric to measure the extent to which a CNN utilizes shape information. We then execute a set of experiments with synthetic and real-world data to progressively uncover under which circumstances CNNs learn shape and what can be done to encourage such behavior. We conclude that (i) CNNs do not learn shape in typical settings but rather rely on other features available to identify the objects of interest, (ii) CNNs can learn shape, but only if the shape is the only feature available to identify the object, (iii) sufficiently large receptive field size relative to the size of target objects is necessary for shape learning; (iv) a limited set of augmentations can encourage shape learning; (v) learning shape is indeed useful in the presence of out-of-distribution data.

翻译：形状学习，即利用形状信息的能力，可能是卷积神经网络（CNN）在目标物体具有特定形状时的一个理想特性。尽管该主题的研究正在兴起，但目前尚无系统性研究能够明确判定CNN是否以及在何种情况下学习形状。本文在形状尤为重要的分割网络背景下，提出了这样一项研究。我们定义了形状，并提出了一种新的行为度量方法，用于衡量CNN利用形状信息的程度。随后，我们通过合成数据与真实数据开展了一系列实验，逐步揭示了CNN在何种情况下学习形状，以及如何促进此类行为。我们的结论表明：（i）在典型设置下，CNN并不学习形状，而是依赖其他可用特征来识别目标物体；（ii）CNN可以学习形状，但前提是形状是识别物体的唯一可用特征；（iii）相对于目标物体尺寸足够大的感受野是形状学习的必要条件；（iv）有限的增强策略可以促进形状学习；（v）在存在分布外数据的情况下，学习形状确实具有实用价值。