We use discrete-event simulation to quantify the impact of fiber latency on the efficacy of geo-distributed AI model training with data parallelism. We conclude that the optimum distances between two AI clusters is 10-100km, over which hollow-core fiber enables 25% higher compute-communication overlap.

翻译：我们采用离散事件模拟方法，量化光纤延迟对基于数据并行性的地理分布式AI模型训练效率的影响。研究结论表明，两个AI集群间的最佳距离为10-100公里，在此距离范围内，空芯光纤可实现计算通信重叠率提升25%。