papersTODAY 04:00 UTC
Coupled-Noise Distillation Method Targets One-Step Block Generation in Diffusion Language Models
A revised arXiv paper examines why masked diffusion language models can produce incoherent text blocks: they decode every position in a block in parallel from separate marginal distributions. The authors propose a coupled-noise distillation approach intended to let such models generate a whole block in a single step while keeping the tokens mutually consistent. The work is a research preprint and has not been peer-reviewed.