One eye on AI

Category: Technical

  • ONNX FP16 is out!

    There’s now an “easy” way to use FP16 ONNX Models in Stable Diffusion: https://github.com/Amblyopius/AMD-Stable-Diffusion-ONNX-FP16 Following on my previous post I did some testing and noticed that just doing UNET was not enough. The Text Encoder model is now in FP16 too. Bringing generation down from 1.5s/it to 1.2s/it on my 6700XT (for 768×768). I have…

  • Where we are: Stable Diffusion on AMD

    I’ve been playing around with every possible way to run Stable Diffusion on my 6700XT. In theory there are many potential solutions, in practice there’s far less. The traditional route is ONNX which works, but with some drawbacks. There’s no well published path towards FP16. Without it, it eats VRAM and exhausts even the 12GB…

  • CUDAnosaur

    I wiped the dust off my 6 year old laptop as it had a fairly forward looking feature back in the day: 8GB of VRAM. The WIFI is quirky and the disk is slow, but that 8GB belongs to a GTX 1070 which is … a CUDA card. I figured people have been running Stable…

  • Stable Diffusion Version 2

    Stability AI has released Stable Diffusion 2.0, what’s it like? The new version comes with a lot of features, unfortunately not all of them very friendly towards people using AMD Radeon (like me). There’s both a model aimed at generating 512×512 and 768×768 but for the latter no ONNX version has been released. I converted…

  • Predictably random

    Ever wondered what seeds are? Looking for predictable yet truly unique outcomes for Stable Diffusion? This post contains a quick behind the scenes tour of randomness. Computers are in most cases entirely predictable. If you have them do something in the same way, you’ll get the same result. Of course, this isn’t always desirable. The…