Algorithmic fairness plays an increasingly critical role in machine learning research. Several group fairness notions and algorithms have been proposed. However, the fairness guarantee of existing fair classification methods mainly depends on specific data distributional assumptions, often requiring large sample sizes, and fairness could be violated when there is a modest number of samples, which is often the case in practice. In this paper, we propose FaiREE, a fair classification algorithm that can satisfy group fairness constraints with finite-sample and distribution-free theoretical guarantees. FaiREE can be adapted to satisfy various group fairness notions (e.g., Equality of Opportunity, Equalized Odds, Demographic Parity, etc.) and achieve the optimal accuracy. These theoretical guarantees are further supported by experiments on both synthetic and real data. FaiREE is shown to have favorable performance over state-of-the-art algorithms.
翻译:算法公平性在机器学习研究中扮演着日益关键的角色。已有多种群体公平性概念和算法被提出。然而,现有公平分类方法的公平性保证主要依赖于特定的数据分布假设,通常需要大样本量,而在实际中常见的小样本情况下,公平性可能无法得到保障。本文提出FaiREE,一种能够满足群体公平性约束并具有有限样本和无分布理论保证的公平分类算法。FaiREE可适配多种群体公平性概念(如机会均等、均等化赔率、人口统计均等性等)并实现最优精度。这些理论保证在合成数据和真实数据的实验中得到了进一步验证。实验表明,FaiREE的性能优于现有最先进算法。