Existing approaches on continual learning call for a lot of samples in their training processes. Such approaches are impractical for many real-world problems having limited samples because of the overfitting problem. This paper proposes a few-shot continual learning approach, termed FLat-tO-WidE AppRoach (FLOWER), where a flat-to-wide learning process finding the flat-wide minima is proposed to address the catastrophic forgetting problem. The issue of data scarcity is overcome with a data augmentation approach making use of a ball generator concept to restrict the sampling space into the smallest enclosing ball. Our numerical studies demonstrate the advantage of FLOWER achieving significantly improved performances over prior arts notably in the small base tasks. For further study, source codes of FLOWER, competitor algorithms and experimental logs are shared publicly in \url{https://github.com/anwarmaxsum/FLOWER}.
翻译:现有持续学习方法在训练过程中需要大量样本。由于过拟合问题,此类方法在样本有限的诸多实际应用中难以适用。本文提出一种小样本持续学习方法,称为"平坦到宽广方法"(FLOWER),其中通过平坦到宽广的学习过程寻找平坦-宽广最小值,以解决灾难性遗忘问题。数据稀缺性问题通过数据增强方法得以克服,该方法利用球生成器概念将采样空间限制于最小包围球内。数值实验表明,FLOWER方法在性能上显著超越现有技术,尤其在小基任务中表现突出。为便于后续研究,FLOWER的源代码、对比算法及实验日志已公开于\url{https://github.com/anwarmaxsum/FLOWER}。