Federated Learning (FL) is a well-known paradigm of distributed machine learning on mobile and IoT devices, which preserves data privacy and optimizes communication efficiency. To avoid the single point of failure problem in FL, decentralized federated learning (DFL) has been proposed to use peer-to-peer communication for model aggregation, which has been considered an attractive solution for machine learning tasks on distributed personal devices. However, this process is vulnerable to attackers who share false models and data. If there exists a group of malicious clients, they might harm the performance of the model by carrying out a poisoning attack. In addition, in DFL, clients often lack the incentives to contribute their computing powers to do model training. In this paper, we proposed Blockchain-based Decentralized Federated Learning (BDFL), which leverages a blockchain for decentralized model verification and auditing. BDFL includes an auditor committee for model verification, an incentive mechanism to encourage the participation of clients, a reputation model to evaluate the trustworthiness of clients, and a protocol suite for dynamic network updates. Evaluation results show that, with the reputation mechanism, BDFL achieves fast model convergence and high accuracy on real datasets even if there exist 30\% malicious clients in the system.
翻译:联邦学习(FL)是移动与物联网设备上分布式机器学习的经典范式,其在保护数据隐私的同时优化了通信效率。为避免FL中的单点故障问题,去中心化联邦学习(DFL)通过采用点对点通信实现模型聚合,被视为分布式个人设备上机器学习任务的理想解决方案。然而,该过程易受共享虚假模型与数据的攻击者威胁。若存在恶意客户端群体,他们可能通过发起投毒攻击损害模型性能。此外,在DFL中,客户端往往缺乏贡献算力参与模型训练的激励。本文提出基于区块链的去中心化联邦学习(BDFL),利用区块链实现去中心化模型验证与审计。BDFL包含用于模型验证的审计委员会、激励客户端参与的奖励机制、评估客户端可信度的信誉模型,以及支持动态网络更新的协议套件。评估结果表明,即使系统中存在30%的恶意客户端,信誉机制仍能使BDFL在真实数据集上实现快速模型收敛与高准确性。