Few-shot classification consists of a training phase where a model is learned on a relatively large dataset and an adaptation phase where the learned model is adapted to previously-unseen tasks with limited labeled samples. In this paper, we empirically prove that the training algorithm and the adaptation algorithm can be completely disentangled, which allows algorithm analysis and design to be done individually for each phase. Our meta-analysis for each phase reveals several interesting insights that may help better understand key aspects of few-shot classification and connections with other fields such as visual representation learning and transfer learning. We hope the insights and research challenges revealed in this paper can inspire future work in related directions. Code and pre-trained models (in PyTorch) are available at https://github.com/Frankluox/CloserLookAgainFewShot.
翻译:小样本分类包括两个阶段:在相对较大的数据集上学习模型的训练阶段,以及将学习到的模型适应到之前未见但仅有少量标注样本的任务的适应阶段。本文通过实验证明,训练算法和适应算法可以完全解耦,从而允许对每个阶段分别进行算法分析和设计。我们对每个阶段的元分析揭示了几个有趣的见解,有助于更深入地理解小样本分类的关键方面及其与视觉表示学习、迁移学习等其他领域的联系。希望本文揭示的见解和研究挑战能够启发未来相关方向的工作。代码和预训练模型(PyTorch版本)可在https://github.com/Frankluox/CloserLookAgainFewShot获取。