For deep ordinal classification, learning a well-structured feature space specific to ordinal classification is helpful to properly capture the ordinal nature among classes. Intuitively, when Euclidean distance metric is used, an ideal ordinal layout in feature space would be that the sample clusters are arranged in class order along a straight line in space. However, enforcing samples to conform to a specific layout in the feature space is a challenging problem. To address this problem, in this paper, we propose a novel Constrained Proxies Learning (CPL) method, which can learn a proxy for each ordinal class and then adjusts the global layout of classes by constraining these proxies. Specifically, we propose two kinds of strategies: hard layout constraint and soft layout constraint. The hard layout constraint is realized by directly controlling the generation of proxies to force them to be placed in a strict linear layout or semicircular layout (i.e., two instantiations of strict ordinal layout). The soft layout constraint is realized by constraining that the proxy layout should always produce unimodal proxy-to-proxies similarity distribution for each proxy (i.e., to be a relaxed ordinal layout). Experiments show that the proposed CPL method outperforms previous deep ordinal classification methods under the same setting of feature extractor.
翻译:对于深度有序分类,学习一个针对有序分类特定设计的良好结构化特征空间有助于正确捕捉类别间的有序本质。直观上,当使用欧氏距离度量时,特征空间中理想的有序布局是样本簇按类别顺序沿空间中的一条直线排列。然而,强制样本在特征空间中符合特定布局是一个具有挑战性的问题。为解决该问题,本文提出了一种新颖的约束代理学习(CPL)方法,该方法可为每个有序类别学习一个代理,并通过约束这些代理来调整类别的全局布局。具体而言,我们提出了两种策略:硬布局约束和软布局约束。硬布局约束通过直接控制代理的生成,强制使其处于严格的线性布局或半圆形布局(即严格有序布局的两种实例化)中。软布局约束则通过确保每个代理的代理间相似度分布始终呈单峰形式(即松弛的有序布局)来实现。实验表明,在相同的特征提取器设置下,所提出的CPL方法优于以往的深度有序分类方法。