Flide accelerates decision inference with exact state forking
Flide decouples logical tree structure from execution in a flattened token stream using ForkAttention, achieving up to 9.5x speedup over vLLM while preserving exact probabilities.
1 stories, newest first · one card per story
Flide decouples logical tree structure from execution in a flattened token stream using ForkAttention, achieving up to 9.5x speedup over vLLM while preserving exact probabilities.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views