Class imbalance induces systematic bias in deep neural networks by imposing a skewed effective class prior. This work introduces the Neural Prior Estimator (NPE), a framework that learns feature-conditioned log-prior estimates from latent representations. NPE employs one or more Prior Estimation Modules trained jointly with the backbone via a one-way logistic loss. Under the Neural Collapse regime, NPE is analytically shown to recover the class log-prior up to an additive constant, providing a theoretically grounded adaptive signal without requiring explicit class counts or distribution-specific hyperparameters. The learned estimate is incorporated into logit adjustment, forming NPE-LA, a principled mechanism for bias-aware prediction. Experiments on long-tailed CIFAR and imbalanced semantic segmentation benchmarks (STARE, ADE20K) demonstrate consistent improvements, particularly for underrepresented classes. NPE thus offers a lightweight and theoretically justified approach to learned prior estimation and imbalance-aware prediction.
翻译:类别不平衡通过施加倾斜的有效类别先验,在深度神经网络中引入系统性偏差。本文提出了神经先验估计器(NPE),一个从潜在表示中学习特征条件化对数先验估计的框架。NPE采用一个或多个先验估计模块,通过单向逻辑损失与骨干网络联合训练。在神经坍缩机制下,NPE被解析地证明能够恢复类别对数先验(至多一个加性常数),从而提供一种理论上有依据的自适应信号,无需显式的类别计数或特定于分布的超参数。学习到的估计值被整合到对数调整中,形成NPE-LA,这是一种用于偏差感知预测的原理性机制。在长尾CIFAR数据集以及不平衡语义分割基准(STARE、ADE20K)上的实验表明,该方法带来了持续的性能提升,尤其对于代表性不足的类别。因此,NPE为学习先验估计与不平衡感知预测提供了一种轻量级且理论上有依据的途径。