Researchers are solving the challenges of spatial-temporal prediction by combining Federated Learning (FL) and graph models with respect to the constrain of privacy and security. In order to make better use of the power of graph model, some researchs also combine split learning(SL). However, there are still several issues left unattended: 1) Clients might not be able to access the server during inference phase; 2) The graph of clients designed manually in the server model may not reveal the proper relationship between clients. This paper proposes a new GNN-oriented split federated learning method, named node {\bfseries M}asking and {\bfseries M}ulti-granularity {\bfseries M}essage passing-based Federated Graph Model (M$^3$FGM) for the above issues. For the first issue, the server model of M$^3$FGM employs a MaskNode layer to simulate the case of clients being offline. We also redesign the decoder of the client model using a dual-sub-decoders structure so that each client model can use its local data to predict independently when offline. As for the second issue, a new GNN layer named Multi-Granularity Message Passing (MGMP) layer enables each client node to perceive global and local information. We conducted extensive experiments in two different scenarios on two real traffic datasets. Results show that M$^3$FGM outperforms the baselines and variant models, achieves the best results in both datasets and scenarios.
翻译:摘要:研究人员在隐私和安全约束下,通过融合联邦学习(FL)与图模型来解决时空预测的挑战。为更好地利用图模型的优势,部分研究还结合了分割学习(SL)。然而,仍有若干未解决的问题:1)客户端在推理阶段可能无法访问服务器;2)服务器模型中人工设计的客户端图可能无法揭示客户端间的真实关系。针对上述问题,本文提出了一种新的面向GNN的分割联邦学习方法,称为节点掩码与多粒度消息传递联邦图模型(M³FGM)。针对第一个问题,M³FGM的服务器模型采用MaskNode层模拟客户端离线场景,并重新设计客户端模型的解码器为双子解码器结构,使各客户端模型在离线时能利用本地数据独立预测。针对第二个问题,提出名为多粒度消息传递(MGMP)的新型GNN层,使每个客户端节点可感知全局与局部信息。我们在两个真实交通数据集上开展了两种不同场景的广泛实验。结果表明,M³FGM优于基线模型及变体模型,在两类数据集和场景中均取得最佳结果。