We are excited to share a new milestone — we've open-sourced dInfer, a high-performance inference framework for diffusion language models (dLLMs).
🚀10.7X speedup over NVIDIA’s diffusion model framework Fast-dLLM.
🧠1,011 tokens per second in single-batch inference — on the
