Stable Diffusion 2 Is Out!
Stable Diffusion 2, the next generation of the revolutionary open source text-to-image generator is not available from Stability AI.
Created on November 24|Last edited on November 24
Comment
To no one's surprise I'm sure, we at Weights & Biases were incredibly excited by the public release of Stable Diffusion back in August.
We might be even more excited by the release of Stable Diffusion 2.
Before we jump into why that is, let's take a look at what it's producing.
Taken from the Stable Diffusion 2 GitHub page because it's awesome.
What's Changed With Stable Diffusion 2?
Stable Diffusion 2 is trained on a new text encoder called OpenCLIP, which is an open-source CLIP implementation, developed by LAION with assistance from Stability AI. We covered it in our article, "Exploring OpenCLIP" earlier this month.
This alone greatly improves the quality of the generated images.
The models were also trained on a subset of the LAION-5B dataset and filtered with LAION's NSFW filter.
One of the upgrades that really jumps out is the new Upscaler Diffusion model that allows Stable Diffusion 2 to create images up to 2048x2048 beautifully!
Here's their example of how awesome it is.
And their depth-to-image diffusion model is exciting, as depth is an area that many of these models come up lacking.
The example they give using an input image to create different outputs is a great illustration, though I have to wonder who came up with the pineapple person.
I suspect this addition alone will allow for much more practical and commercial use.
And a feature we all have to fear and love is the announcement of, "Updated Inpainting Diffusion Model", which, "... makes it super easy to switch out parts of an image intelligently and quickly."
Updated Inpainting Diffusion Model
Which, of course, has a ton of fun and profitable uses, but also some darker ones.
The model runs on a single GPU, as Stability AI is focused on producing models that are available and usable by a large audience.
And if you're interested in hearing more about Stability AI, Weights & Biases' Lukas Biewald interviewed Stability founder Emad Mostaque just a couple of weeks ago.
Enjoy.
Add a comment
Tags: ML News
Iterate on AI agents and models faster. Try Weights & Biases today.