In vanilla federated learning (FL) such as FedAvg, the parameter server (PS) and multiple distributed clients can form a typical buyer's market, where the number of PS/buyers of FL services is far less than the number of clients/sellers. In order to improve the performance of FL and reduce the cost of motivating clients to participate in FL, this paper proposes to differentiate the pricing for services provided by different clients rather than simply providing the same service pricing for different clients. The price is differentiated based on the performance improvements brought to FL and their heterogeneity in computing and communication capabilities. To this end, a price-discrimination game (PDG) is formulated to comprehensively address the distributed resource management problems in FL, including multi-objective trade-off, client selection, and incentive mechanism. As the PDG is a mixed-integer nonlinear programming (MINLP) problem, a distributed semi-heuristic algorithm with low computational complexity and low communication overhead is designed to solve it. The simulation result verifies the effectiveness of the proposed approach.
翻译:在传统联邦学习(如FedAvg)中,参数服务器与多个分布式客户端形成典型的买方市场——联邦服务的购买方(参数服务器)数量远少于服务提供方(客户端)数量。为提升联邦学习性能并降低激励客户端参与的代价,本文提出对不同客户端提供的服务实施差异化定价,而非简单采用统一服务定价。差异化定价依据客户端对联邦学习性能的提升贡献及其在计算与通信能力上的异质性而制定。为此,我们构建了价格歧视博弈模型,系统解决联邦学习中的分布式资源管理问题,包括多目标权衡、客户端选择及激励机制。由于该模型属于混合整数非线性规划问题,本文设计了一种低计算复杂度与低通信开销的分布式半启发式算法进行求解。仿真结果验证了所提方法的有效性。