arXiv cs.AI / cs.LG / cs.CL·17d agoPACE: Perceived-Latency-Aware Cascading Service Routing and Filler Control for QoE-Efficient Retrieval-Augmented Dialogue Serving#cascading#inference-serving#latencyAI tools & infra