There’s now an “easy” way to use FP16 ONNX Models in Stable Diffusion: https://github.com/Amblyopius/AMD-Stable-Diffusion-ONNX-FP16 Following on my previous post I did some testing and noticed that just doing UNET was not enough. The Text Encoder model is now in FP16 too. Bringing generation down from 1.5s/it to 1.2s/it on my 6700XT (for 768×768). I have…

I’ve been playing around with every possible way to run Stable Diffusion on my 6700XT. In theory there are many potential solutions, in practice there’s far less. The traditional route is ONNX which works, but with some drawbacks. There’s no well published path towards FP16. Without it, it eats VRAM and exhausts even the 12GB…

I wiped the dust off my 6 year old laptop as it had a fairly forward looking feature back in the day: 8GB of VRAM. The WIFI is quirky and the disk is slow, but that 8GB belongs to a GTX 1070 which is … a CUDA card. I figured people have been running Stable…