We present OrbitCache, a new in-network caching architecture that can cache variable-length items to balance a wide range of key-value workloads. Unlike existing works, OrbitCache does not cache hot items in the switch memory. Instead, we make hot items revisit the switch data plane continuously by exploiting packet recirculation. Our approach keeps cached key-value pairs in the switch data plane while freeing them from item size limitations caused by hardware constraints. We implement an OrbitCache prototype on an Intel Tofino switch. Our experimental results show that OrbitCache can balance highly skewed workloads and is robust to various system conditions.

翻译：我们提出OrbitCache，一种新型网内缓存架构，能够缓存可变长度数据项以平衡各类键值工作负载。与现有方案不同，OrbitCache不在交换机内存中缓存热点数据项，而是通过利用数据包再循环机制使热点数据持续流经交换机数据平面。该方法将缓存的键值对保留在交换机数据平面，同时使其摆脱硬件约束导致的数据项大小限制。我们在Intel Tofino交换机上实现了OrbitCache原型系统。实验结果表明，OrbitCache能够有效平衡高度倾斜的工作负载，并对各种系统条件具有鲁棒性。