25
Nov
[Submitted on 31 Oct 2024 (v1), last revised 22 Nov 2024 (this version, v4)] View a PDF of the paper titled Understanding Generalizability of Diffusion Models Requires Rethinking the Hidden Gaussian Structure, by Xiang Li and 2 other authors View PDF HTML (experimental) Abstract:In this work, we study the generalizability of diffusion models by looking into the hidden properties of the learned score functions, which are essentially a series of deep denoisers trained on various noise levels. We observe that as diffusion models transition from memorization to generalization, their corresponding nonlinear diffusion denoisers exhibit increasing linearity. This discovery leads us…