Sable proves bit-exact Qwen inference on one GPU
On one RTX PRO 6000, Sable proves Qwen2.5-32B in 92.5 seconds for 4,096 tokens, about 6.4 cents per request.
Stories per day · 30 days
3 stories, newest first · one card per story
Stories tagged #verifiable-inference
Seal, Then Sample: Sampled Layerwise Proofs for Verifiable LLM Inference from GPT-2 to 70B
Researchers propose Sampled Layerwise Proofs to audit outsourced LLM inference through Llama-2-70B.
Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation
Maverick protocol delivers private and verifiable LLM inference via matrix-vector multiplication delegation, achieving up to 45x throughput gains over local inference on Qwen3-4B.