Trustworthy Federated Learning (TFL) typically leverages protection mechanisms to guarantee privacy. However, protection mechanisms inevitably introduce utility loss or efficiency reduction while protecting data privacy. Therefore, protection mechanisms and their parameters should be carefully chosen to strike an optimal tradeoff between \textit{privacy leakage}, \textit{utility loss}, and \textit{efficiency reduction}. To this end, federated learning practitioners need tools to measure the three factors and optimize the tradeoff between them to choose the protection mechanism that is most appropriate to the application at hand. Motivated by this requirement, we propose a framework that (1) formulates TFL as a problem of finding a protection mechanism to optimize the tradeoff between privacy leakage, utility loss, and efficiency reduction and (2) formally defines bounded measurements of the three factors. We then propose a meta-learning algorithm to approximate this optimization problem and find optimal protection parameters for representative protection mechanisms, including Randomization, Homomorphic Encryption, Secret Sharing, and Compression. We further design estimation algorithms to quantify these found optimal protection parameters in a practical horizontal federated learning setting and provide a theoretical analysis of the estimation error.
翻译:可信联邦学习通常借助保护机制来保障隐私。然而,保护机制在保护数据隐私的同时不可避免地会引入效用损失或效率降低。因此,需要谨慎选择保护机制及其参数,以在隐私泄露、效用损失和效率降低三者之间达到最优权衡。为此,联邦学习实践者需要能够衡量这三个因素并优化三者间权衡的工具,从而为当前应用选择最合适的保护机制。基于这一需求,我们提出一个框架,该框架:(1)将可信联邦学习形式化为一个寻找保护机制以优化隐私泄露、效用损失和效率降低之间权衡的问题;(2)正式定义这三个因素的有界度量指标。随后我们提出一种元学习算法来近似求解该优化问题,并为随机化、同态加密、秘密共享和压缩等代表性保护机制寻找最优保护参数。我们进一步设计了估计算法,以便在实际横向联邦学习场景中量化这些找到的最优保护参数,并对估计误差进行了理论分析。