会员服务
Understanding the Issues, Their Causes and Solutions in Microservices Systems: An Empirical Study
Arxiv
0+阅读 · 2月19日
FlowPrefill: Decoupling Preemption from Prefill Scheduling Granularity to Mitigate Head-of-Line Blocking in LLM Serving
Arxiv
0+阅读 · 2月18日
PAM: Processing Across Memory Hierarchy for Efficient KV-centric LLM Serving System
Arxiv
0+阅读 · 2月12日
Budgeting Discretion: Theory and Evidence on Street-Level Decision-Making
Arxiv
0+阅读 · 2月10日
When RL Meets Adaptive Speculative Training: A Unified Training-Serving System
Arxiv
0+阅读 · 2月6日
Performance Antipatterns: Angel or Devil for Power Consumption?
Arxiv
0+阅读 · 2月12日
Experimenting under Stochastic Congestion
Arxiv
0+阅读 · 2月15日
BOute: Cost-Efficient LLM Serving with Heterogeneous LLMs and GPUs via Multi-Objective Bayesian Optimization
Arxiv
0+阅读 · 2月11日
Cast: Automated Resilience Testing for Production Cloud Service Systems
Arxiv
0+阅读 · 2月1日
Towards Resiliency in Large Language Model Serving with KevlarFlow
Arxiv
0+阅读 · 1月30日
VarParser: Unleashing the Neglected Power of Variables for LLM-based Log Parsing
Arxiv
0+阅读 · 1月30日
vLLM-Omni: Fully Disaggregated Serving for Any-to-Any Multimodal Models
Arxiv
0+阅读 · 2月2日
VoxServe: Streaming-Centric Serving System for Speech Language Models
Arxiv
0+阅读 · 1月30日
AnoMod: A Dataset for Anomaly Detection and Root Cause Analysis in Microservice Systems
Arxiv
0+阅读 · 1月30日
PROTEUS: SLA-Aware Routing via Lagrangian RL for Multi-LLM Serving Systems
Arxiv
0+阅读 · 2月3日
参考链接
微信扫码咨询专知VIP会员
Top