LLM serving runtimes increasingly expose KV-cache primitives that resemble future-reuse controls: retention priority, TTL-like duration, host or storage offload, block events, active no-evict scheduling, and KV-aware routing. This paper argues that such primitives are weaker than accepted future-KV obligations. A runtime can expose priority, offload, events, and routing without accepting responsibility for a future reuse claim. We study ResidentClaim lowering: when a runtime primitive, trusted adapter, or patch can be treated as satisfying an accepted claim about future KV reuse. A conformant lowering must bind behavior to accepted claim identity, a materialization predicate, ordered lifecycle events, and claim-scoped outcomes. We contribute a fail-closed lowering relation, checker, descriptor format, and bad-lowering suite that classify runtime/mode mappings as native conformance, adapter-observational evidence, adapter-policy evidence under controlled pressure, approximation substrate, rejected mapping, or unknown evidence. The checker validates manually curated, anchored runtime descriptors against obligation bundles; it does not prove that unaudited runtime behavior is complete. Public TensorRT-LLM, SGLang/HiCache, and Dynamo expose strong substrates and selected adapter positives, but not native ResidentClaim conformance. The positive systems witness is a local patched vLLM connector/scheduler-boundary mechanism: claim metadata flows through real in-process offload/load behavior, and controlled same-claim restoration failure reaches vLLM's invalid-KV-load path and becomes an ordered claim-scoped fail-closed outcome. The result is a calibrated semantics boundary, not a production performance claim or a compatibility survey.
翻译:LLM服务运行时日益暴露类似于未来复用控制的KV缓存原语:保留优先级、类生存期的时长、主机或存储卸载、块事件、主动无驱逐调度和KV感知路由。本文论证这些原语弱于已接受的未来KV义务。运行时可以暴露优先级、卸载、事件和路由,而无需承担未来复用声明的责任。我们研究居民声明下降:当运行时原语、可信适配器或补丁可被视为满足关于未来KV复用的已接受声明时。合规下降必须将行为绑定到已接受声明标识、物化谓词、有序生命周期事件和声明作用域结果。我们贡献了一种失效关闭式下降关系、检查器、描述符格式和不良下降套件,将运行时/模式映射分类为原生合规、适配器观察证据、受控压力下的适配器策略证据、近似基板、拒绝映射或未知证据。检查器针对义务束验证人工策划的锚定运行时描述符;它不证明未经审计的运行时行为是完整的。公开的TensorRT-LLM、SGLang/HiCache和Dynamo展示了强基板和选定的适配器正面效果,但未展示原生居民声明合规。正面系统证据是本地打补丁的vLLM连接器/调度器边界机制:声明元数据流经真实进程内卸载/加载行为,且受控的相同声明恢复失败进入vLLM的无效KV加载路径,变为有序的声明作用域失效关闭结果。结果是校准的语义边界,而非生产性能声明或兼容性调查。