Due to its advantages in resource constraint scenarios, Split Federated Learning (SFL) is promising in AIoT systems. However, due to data heterogeneity and stragglers, SFL suffers from the challenges of low inference accuracy and low efficiency. To address these issues, this paper presents a novel SFL approach, named Sliding Split Federated Learning (S$^2$FL), which adopts an adaptive sliding model split strategy and a data balance-based training mechanism. By dynamically dispatching different model portions to AIoT devices according to their computing capability, S$^2$FL can alleviate the low training efficiency caused by stragglers. By combining features uploaded by devices with different data distributions to generate multiple larger batches with a uniform distribution for back-propagation, S$^2$FL can alleviate the performance degradation caused by data heterogeneity. Experimental results demonstrate that, compared to conventional SFL, S$^2$FL can achieve up to 16.5\% inference accuracy improvement and 3.54X training acceleration.
翻译:由于在资源受限场景中的优势,分裂联邦学习(SFL)在AIoT系统中具有广阔前景。然而,受数据异质性和掉队者问题影响,SFL面临推理精度低和效率低下的挑战。针对这些问题,本文提出一种新型SFL方法——滑动分裂联邦学习(S$^2$FL),该方法采用自适应滑动模型拆分策略及基于数据平衡的训练机制。通过根据AIoT设备的计算能力动态分配不同模型部分,S$^2$FL可缓解掉队者导致的训练效率低下问题;通过融合具有不同数据分布的设备上传的特征,生成多个具有均匀分布的大批量用于反向传播,S$^2$FL可缓解数据异质性导致的性能退化。实验结果表明,与传统SFL相比,S$^2$FL的推理精度提升最高达16.5%,训练速度最高加速3.54倍。