arXiv cs.AI / cs.LG / cs.CL·4d agoSWE-Serve: Benchmarking Agentic Engineering For Production Inference Serving#benchmark#inference-serving#sglangAI research 2 sources
arXiv cs.AI / cs.LG / cs.CL·17d agoPACE: Perceived-Latency-Aware Cascading Service Routing and Filler Control for QoE-Efficient Retrieval-Augmented Dialogue Serving#cascading#inference-serving#latencyAI tools & infra