We present StarCache, a new in-network caching architecture that can cache variable-length items to balance a wide range of key-value workloads. Unlike existing works, StarCache does not cache hot items in the switch memory. Instead, we make hot items revisit the switch data plane continuously by exploiting packet recirculation. Our approach keeps cached key-value pairs in the switch data plane while freeing them from item size limitations caused by hardware constraints. We implement a StarCache prototype on an Intel Tofino switch. Our experimental results show that StarCache can balance highly skewed workloads with various key and value sizes.
翻译:我们提出StarCache,一种新型网络内缓存架构,能够缓存可变长度数据项以平衡广泛的键值工作负载。与现有方案不同,StarCache不在交换机内存中缓存热点数据项,而是通过利用数据包再循环机制使热点数据项持续重访交换机数据平面。该方法将缓存的键值对保留在交换机数据平面中,同时使其摆脱硬件约束导致的数据项大小限制。我们在Intel Tofino交换机上实现了StarCache原型系统。实验结果表明,StarCache能够有效平衡具有不同键值大小的严重倾斜工作负载。