Class-Incremental Learning updates a deep classifier with new categories while maintaining the previously observed class accuracy. Regularizing the neural network weights is a common method to prevent forgetting previously learned classes while learning novel ones. However, existing regularizers use a constant magnitude throughout the learning sessions, which may not reflect the varying levels of difficulty of the tasks encountered during incremental learning. This study investigates the necessity of adaptive regularization in Class-Incremental Learning, which dynamically adjusts the regularization strength according to the complexity of the task at hand. We propose a Bayesian Optimization-based approach to automatically determine the optimal regularization magnitude for each learning task. Our experiments on two datasets via two regularizers demonstrate the importance of adaptive regularization for achieving accurate and less forgetful visual incremental learning.

翻译：类增量学习通过引入新类别更新深度分类器，同时保持对先前观测类别的准确率。对神经网络权重进行正则化是一种常见方法，可在学习新类别的同时防止遗忘先前学到的类别。然而，现有正则化器在整个学习阶段使用恒定幅值，这无法反映增量学习过程中各任务难度的变化。本研究探讨了类增量学习中自适应正则化的必要性，该方法能根据当前任务的复杂度动态调整正则化强度。我们提出了一种基于贝叶斯优化的方法，自动为每个学习任务确定最优正则化幅值。基于两个数据集及两种正则化器的实验表明，自适应正则化对于实现高精度且低遗忘的视觉增量学习至关重要。