Sable proves bit-exact quantized LLM inference on one GPU
Qwen2.5-32B takes 92.5 seconds for 4,096 tokens; proofs are not zero-knowledge.
2 stories, newest first · one card per story
Qwen2.5-32B takes 92.5 seconds for 4,096 tokens; proofs are not zero-knowledge.
The paper explores parallelization trade-offs on multi-GPU environments using RDMA to maximize performance for large circuit sizes in zero-knowledge proofs.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views