BYOD converts AR models to diffusion LLMs via LoRA
BYOD enables parameter-efficient conversion of Gemma 2 9B, Llama 3.1 8B, Qwen2.5 7B and Ministral 8B in 3.1-4.0 hours using 4.1-5.8% LoRA adapters.
1 stories, newest first · one card per story
BYOD enables parameter-efficient conversion of Gemma 2 9B, Llama 3.1 8B, Qwen2.5 7B and Ministral 8B in 3.1-4.0 hours using 4.1-5.8% LoRA adapters.
Today 153 readers · 156 views · 36 reads · all time 187K views