Self-training is an important technique for solving semi-supervised learning problems. It leverages unlabeled data by generating pseudo-labels and combining them with a limited labeled dataset for training. The effectiveness of self-training heavily relies on the accuracy of these pseudo-labels. In this paper, we introduce doubly robust self-training, a novel semi-supervised algorithm that provably balances between two extremes. When the pseudo-labels are entirely incorrect, our method reduces to a training process solely using labeled data. Conversely, when the pseudo-labels are completely accurate, our method transforms into a training process utilizing all pseudo-labeled data and labeled data, thus increasing the effective sample size. Through empirical evaluations on both the ImageNet dataset for image classification and the nuScenes autonomous driving dataset for 3D object detection, we demonstrate the superiority of the doubly robust loss over the standard self-training baseline.

翻译：自训练是解决半监督学习问题的重要技术。它通过生成伪标签并将其与有限的标记数据集结合来利用未标记数据进行训练。自训练的有效性在很大程度上依赖于这些伪标签的准确性。在本文中，我们引入了双重鲁棒自训练，这是一种新颖的半监督算法，能在两个极端之间实现可证明的平衡。当伪标签完全错误时，我们的方法简化为仅使用标记数据的训练过程。反之，当伪标签完全准确时，我们的方法转变为利用所有伪标记数据和标记数据的训练过程，从而增加有效样本量。通过在用于图像分类的ImageNet数据集和用于3D物体检测的nuScenes自动驾驶数据集上的实证评估，我们证明了双重鲁棒损失相对于标准自训练基线的优越性。