š Can you turn an existing LLM into a diffusion language model in just a few hours on a single GPU?
We introduce "BYOD: Build Your Own DLM", a lightweight approach to converting autoregressive LLMs into diffusion models using LoRA, without modifying the original model weights.
ā Works with Llama, Gemma, Qwen, and Ministral (and more!) ā Just 3ā4 GPU hours for 7ā9B models ā Open-source training code and Google Colab notebook ā Interactive demos to try all four models!
We're particularly interested in making diffusion language model research more accessible and reproducible.