Autoregressive Diffusion Models

Abstract

Autoregressive Diffusion Models unify order-agnostic autoregressive models and absorbing discrete diffusion under one simple discrete-variable framework. The model supports adaptive parallel generation and can be used for practical lossless compression with a modest number of network evaluations.

Publication
International Conference on Learning Representations 2022