Slide the image size to see why diffusing raw pixels is slow: each pixel value is reworked 50 times. Latent diffusion uses a small compressed code instead.
Diffusing directly on pixels means running a big network over millions of numbers, dozens of times, for one image. That was the bottleneck.