Perception datasets for agriculture are limited both in quantity and diversity which hinders effective training of supervised learning approaches. Self-supervised learning techniques alleviate this problem, however, existing methods are not optimized for dense prediction tasks in agriculture domains which results in degraded performance. In this work, we address this limitation with our proposed Injected Noise Discriminator (INoD) which exploits principles of feature replacement and dataset discrimination for self-supervised representation learning. INoD interleaves feature maps from two disjoint datasets during their convolutional encoding and predicts the dataset affiliation of the resultant feature map as a pretext task. Our approach enables the network to learn unequivocal representations of objects seen in one dataset while observing them in conjunction with similar features from the disjoint dataset. This allows the network to reason about higher-level semantics of the entailed objects, thus improving its performance on various downstream tasks. Additionally, we introduce the novel Fraunhofer Potato 2022 dataset consisting of over 16,800 images for object detection in potato fields. Extensive evaluations of our proposed INoD pretraining strategy for the tasks of object detection, semantic segmentation, and instance segmentation on the Sugar Beets 2016 and our potato dataset demonstrate that it achieves state-of-the-art performance.
翻译:农业领域的感知数据集在数量和多样性上均存在局限,这阻碍了监督学习方法的有效训练。自监督学习技术虽能缓解此问题,但现有方法未针对农业场景中的密集预测任务进行优化,导致性能下降。针对这一局限,本文提出注入噪声鉴别器(INoD),该方法利用特征替换与数据集判别原理实现自监督表示学习。INoD在卷积编码过程中交错处理两个不相交数据集的特征图,并以预测最终特征图所属数据集作为前置任务。该方法使网络在观察一个数据集中的目标时,能同时结合另一个数据集中的相似特征进行学习,从而捕获目标对象的明确表征。这促使网络推断目标对象的高层语义,进而提升其在多种下游任务中的性能。此外,我们引入了含16,800余张图像的新型Fraunhofer Potato 2022数据集,用于马铃薯田目标检测。在Sugar Beets 2016数据集及本团队提出的马铃薯数据集上,针对目标检测、语义分割与实例分割任务对INoD预训练策略进行广泛评估,结果表明其达到了当前最优性能。