In vanilla federated learning (FL) such as FedAvg, the parameter server (PS) and multiple distributed clients can form a typical buyer's market, where the number of PS/buyers of FL services is far less than the number of clients/sellers. In order to improve the performance of FL and reduce the cost of motivating clients to participate in FL, this paper proposes to differentiate the pricing for services provided by different clients rather than simply providing the same service pricing for different clients. The price is differentiated based on the performance improvements brought to FL and their heterogeneity in computing and communication capabilities. To this end, a price-discrimination game (PDG) is formulated to comprehensively address the distributed resource management problems in FL, including multi-objective trade-off, client selection, and incentive mechanism. As the PDG is a mixed-integer nonlinear programming (MINLP) problem, a distributed semi-heuristic algorithm with low computational complexity and low communication overhead is designed to solve it. The simulation result verifies the effectiveness of the proposed approach.
翻译:在常规联邦学习(如FedAvg)中,参数服务器与多个分布式客户端可形成典型的买方市场,其中购买联邦服务的参数服务器数量远少于提供服务的客户端数量。为提升联邦学习性能并降低激励客户端参与联邦学习的成本,本文提出对不同客户端所提供的服务实施差异化定价,而非简单地对所有客户端采用统一服务定价。该差异化定价基于客户端为联邦学习带来的性能提升及其计算与通信能力的异质性。为此,构建了价格歧视博弈模型以全面解决联邦学习中的分布式资源管理问题,包括多目标权衡、客户端选择及激励机制。由于该价格歧视博弈属于混合整数非线性规划问题,本文设计了一种低计算复杂度与低通信开销的分布式半启发式算法进行求解。仿真结果验证了所提方法的有效性。