Diffusion LLMs
Taming Masked Diffusion Language Models with More Consistent Trajectories and Fewer Decoding Steps for Major Gains in Inference Performance and Efficiency
# Advancing Diffusion-Based Large Language Models (LLMs) Diffusion-based LLMs have progressed rapidly. - **February 2025** — *Mercury* (Inception Labs) became the first *commercial-scale* diffusion LLM. - **Renmin University** launched *LLaDA*, the first **open-source 8B parameter diffusion LLM**, followed by *Gemini Diffusion* in May. These innovations signal that **diffusion LLMs could rival autoregressive