LLM classifier circuits raise accuracy at a fixed query cost
On seven tasks spanning safety, health, and reasoning, the method beats routing and cascading baselines.
Stories per day · 30 days
2 stories, newest first · one card per story
Stories tagged #cascading
PACE: Perceived-Latency-Aware Cascading Service Routing and Filler Control for QoE-Efficient Retrieval-Augmented Dialogue Serving
PACE cuts perceived latency in retrieval-augmented dialogue serving via cascading routing and filler control, reaching 0.41s P95 under load.