To Copy or Not to Copy: Controlling Speculative Decoding via Intrinsic Model Signals
1
SpliTEE: Improving LLM Inference on Trusted Hardware with Differentially Private GPU Outsourcing
VU#369611: ExLlamaV3 contains Denial of Service vulnerability via insufficient bounds checking on kernel dispatch index
2 min1
Unlocking Lossless Speedups in LLMs via Discrete Diffusion
HyQuant: Hybrid-Precision Quantization for LLM Attention
1
A Three-Layer Caching Architecture for Low-Latency LLM Web Search on Commodity CPU Hardware
2