Switch between a GAN's two competing networks and diffusion's single denoiser. That one difference explains most of how the two behave.
Almost every practical difference between the two follows from this one structural choice.