Resolutions must be multiples of 64. 512x512 is the standard size, if you change either, add 64 or subtract 64. For example, 576x640 will work, as will 448x384. So long as both numbers are multiples of 64 and you have enough vram, you should be fine.
A shame this requires a Nvidia GPU, it looks interesting and a couple of my friends can play with it, but my computer uses an AMD. I saw in the comments that there was a way to use it without that GPU but it requires knowledge of python to even install, and I've never used it and don't know where/how to start. I did install the latest version of the software but I don't know how to do anything in it.
Well, regarding making it work on AMD it's rather easy. 1) tell AMD to write a GPU API like CUDA 2) tell AMD to write tensor/neural network like CUDAnn for API they created in point 1). 3) ask someone to rewrite all python libraries to the API created in point 2) and finally 4) prepare a package using this API.
AMD isn't the focus for these kind of programs, and probably won't be for the foreseeable future. its sucky but you might have to commission a python coder or just wait until someone releases a version for AMD if you're not familiar with python. GL
The "Samples per Prompt" input doesn't seem to do anything. It would great if I put 10 in there and it will render 10 of the same image with variations in the seed. I prefer them not being in a grid, though some people seem to prefer that.
I would like the ability to save EACH iteration. So if I have 50 steps, it will generate 50 images show me what it looked like at each step. I've found that sometimes I have a good start to an image at 50, so I bump it up to 200, but then I find that 100 actually turned out better than 200 because 200 wiped out some features that I liked, etc.. just a thought :)
One thing I've noticed from doing renderings is that there should be billions of combinations with the seed, and yet it's not rare for the mistletoe to reuse a seed when set to -1. I noticed this with identical or very close requests, while if it really took a random seed these coincidences should not be possible...
If he does this, then there is a chance that several people with the same ideas will end up with quite similar images because the chosen seed isn't random enough.
Yes it seems there is some deterministic random algorithm, I've noticed this too especially when I set back to -1 (random) then it starts choosing random seeds it already used before.
The random number generator is deterministic, needs to use something like a hash of the current millisecond or otherwise use a derivative of a changing variable as a seed.
1. Can we get a link to your Patreon somewhere on your Itch profile?
2. How long of a delay is there between the paid and free releases? I see 0.3 is released on the Patreon, but I don't think the Itch release has been updated at all yet.
3. Is there a free changelog for the paid versions posted publicly somewhere? Kinda stinky the public version here has some major bugs and I'd like to know if the paid versions have fixed them yet.
4. Is there any way to know what specific model it's using, and what version? The Dezgo site is talking about using a v1.4 now, but this app just shows "default" in the model dropdown box.
EDIT: just as I posted this, the app softlocked while trying to generate a prompt. No errors or anything, either.
Why not? Even something minimal is something and chasing more steps to refine an image as much as possible is something I'd like to do. Mostly for images I like after doing the quick 10 second 50 step renders. I'd even try 10,000 steps since it'd only take like 30 minutes with my GPU.
What has been you best resolution for landscape and portrait?
Also, I know the engine supports more than 500 samples where would I change that in the python files? The file structure for this tool is a massive mess. LOL.
I haven't tried with this tool but you should be able to do that by increasing your Samples per prompt to a high number. I do that with a command line interface with a different branch. As of yet, that function doesn't work with save to grid which is what I'm looking for. Wake up to many 12-image grids. I can wake up to 100+ of images though just by increasing the number of images generated per prompt. Got 101 the other night and then upsacled the 4X in the AM.
i cannot get diffusion to use my EGPU, instead it uses the worse Dgpu in the laptop even when selecting the 2060 manually in windows settings the program runs on the 2050, limiting vram availability. anyone know a workaround?
I had a similar issue and didn't find a solution. It was using my faster GPU with less VRAM where I couldn't achieve 512x512. I installed a different tool and edited a file that allowed me to point it at my slower GPU with more VRAM and now I can get 512X704.
i get an error when extracting "data error: stable diffusion GRisk GUI/torch/lib/torch_cuda_cu.dll" and when i try to run the program it just opens a console window for a half a second and closes.
I'm using a 1650 on a laptop, 256 x 256 image produces completely black result. I don't know what to do! Does anyone know a solution or at least what's causing the problem?
I had a Vram problem at 512 x 512, but I lowered the resolution to 256 x 256. I checked the console - no errors. Apparently, it's written in the project, that the 16 series have problem with the half resolution option. It's the default one and cannot be unticked. Maybe I can find a workaround to find a way to turn it off?
Pytorch is not clearing the vram after each run forcing me to shut down the software to free up the GPU memory between each use. A few other posts sound like maybe they are experiencing similar.
I dont know if there is a GUI version for linux, but you can always download the source code in linux and run it or compile it. Source Code of the project is: here
Best I get on RTX a2000 with 4 GB is 128x256. And the output is pretty meaningless... Pretty colors but nothing like the prompt. Can anyone test an exact prompt and seed etc. At this setting so I can compare? Thanks!
I can do up to 500steps, this compiled version limits the steps to 500, however, recompiling it changing the max limit variable can allow to go beyond. (steps does not require additional VRAM, it will just iterate more the "dream")
I ran it on a 3090Ti at about 5.75it/s but I cannot change the resolution, even for a small change it says I'm out of VRam !! lol !! I would like to change the aspect ratio but it seems to not work correctlyIf you need to write the prompt as time you need a generation, what is the "Samples per prompt" menu ??Thanks for making me knowing this in local usage !! Many thanks !!
Also I would love to know more about V scale and half-precision, what is it exactly ?
Dont know what does V Scale stands for except that its the "guidance scale" whatever that means..., but half-precision is basically used when you got less than 10 GB of VRAM, uses float16 precision instead of the default float32 for the 10+ GB VRAM GPUs
Thanks for the details, the problem is that the box remains checked on "half precision" despite the 24gb of vram of my 3090Ti, I do not understand very well why.
okay this interface ( and the work behind ;) ) is already very good, maybe fix the sample per prompt bug , increment the resolution in multiple of 64 direcly instead of 1, save the output folder path after a reboot of the gui. I don't know if it's a bug but i can't do more than 250 steps and this message apear in the console, happen the same thing with a lower resolution.
Rendering: Cat
0it [00:01, ?it/s]
Traceback (most recent call last):
File "start.py", line 363, in OnRender
File "torch\autograd\grad_mode.py", line 27, in decorate_context
return func(*args, **kwargs)
File "diffusers\pipelines\stable_diffusion\pipeline_stable_diffusion.py", line 152, in __call__
File "diffusers\schedulers\scheduling_pndm.py", line 136, in step
File "diffusers\schedulers\scheduling_pndm.py", line 212, in step_plms
File "diffusers\schedulers\scheduling_pndm.py", line 230, in _get_prev_sample
IndexError: index 1000 is out of bounds for dimension 0 with size 1000
RuntimeError: CUDA out of memory. Tried to allocate 1024.00 MiB (GPU 0; 4.00 GiB total capacity; 2.55 GiB already allocated; 119.30 MiB free; 2.60 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
can anyone help me with this. i have a 1050ti 4gb. and I tried to get a 512x512 image.
512x512 is too much for 4GB of VRAM... I am hitting the limit of 576x576 with 8GB. so, doing this resolution with 4GB its practically impossible. In some cases my screen "goes black" due to lack of VRAM to output something in screen while the process is going...
← Return to tool
Comments
Log in with itch.io to leave a comment.
How can i fix this. :(
RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 8 but got size 7 for tensor number 1 in the list.
Resolutions must be multiples of 64. 512x512 is the standard size, if you change either, add 64 or subtract 64. For example, 576x640 will work, as will 448x384. So long as both numbers are multiples of 64 and you have enough vram, you should be fine.
are the rest of the features like img2img and upscaling going to be paywall locked to patreon?
Help! I always get black images, on any resolution... no errors, and all looks fine, but always generated totally black pngs!!
Great work so far! Will you be adding img2img soon?
It is present already in the patreon version of the GUI. Hopefully it is added to the public release soon.
A shame this requires a Nvidia GPU, it looks interesting and a couple of my friends can play with it, but my computer uses an AMD. I saw in the comments that there was a way to use it without that GPU but it requires knowledge of python to even install, and I've never used it and don't know where/how to start. I did install the latest version of the software but I don't know how to do anything in it.
Any advice/tips would be appreciated.
Well, regarding making it work on AMD it's rather easy. 1) tell AMD to write a GPU API like CUDA 2) tell AMD to write tensor/neural network like CUDAnn for API they created in point 1). 3) ask someone to rewrite all python libraries to the API created in point 2) and finally 4) prepare a package using this API.
AMD isn't the focus for these kind of programs, and probably won't be for the foreseeable future. its sucky but you might have to commission a python coder or just wait until someone releases a version for AMD if you're not familiar with python. GL
Understandable. And I have friends who can play with the app as is, it's just bad luck with my PC I guess.
The "Samples per Prompt" input doesn't seem to do anything. It would great if I put 10 in there and it will render 10 of the same image with variations in the seed. I prefer them not being in a grid, though some people seem to prefer that.
Not implemented on the Itch version yet.
I would like the ability to save EACH iteration. So if I have 50 steps, it will generate 50 images show me what it looked like at each step. I've found that sometimes I have a good start to an image at 50, so I bump it up to 200, but then I find that 100 actually turned out better than 200 because 200 wiped out some features that I liked, etc.. just a thought :)
Great idea. This should be a checkbox, save the iterations in a subfolder.
One thing I've noticed from doing renderings is that there should be billions of combinations with the seed, and yet it's not rare for the mistletoe to reuse a seed when set to -1. I noticed this with identical or very close requests, while if it really took a random seed these coincidences should not be possible...
If he does this, then there is a chance that several people with the same ideas will end up with quite similar images because the chosen seed isn't random enough.
Yes it seems there is some deterministic random algorithm, I've noticed this too especially when I set back to -1 (random) then it starts choosing random seeds it already used before.
The random number generator is deterministic, needs to use something like a hash of the current millisecond or otherwise use a derivative of a changing variable as a seed.
@grisk do you plan to add img2img ?
It's already added on either 0.2 or 0.3, as far as I can tell. GRisk just hasn't put it here on Itch.
Where can I find it then ?
https://www.patreon.com/DAINAPP
Yes this is my #1 request please.
1. Can we get a link to your Patreon somewhere on your Itch profile?
2. How long of a delay is there between the paid and free releases? I see 0.3 is released on the Patreon, but I don't think the Itch release has been updated at all yet.
3. Is there a free changelog for the paid versions posted publicly somewhere? Kinda stinky the public version here has some major bugs and I'd like to know if the paid versions have fixed them yet.
4. Is there any way to know what specific model it's using, and what version? The Dezgo site is talking about using a v1.4 now, but this app just shows "default" in the model dropdown box.
EDIT: just as I posted this, the app softlocked while trying to generate a prompt. No errors or anything, either.
GTX 1650 Super produces a black image with a windows 10 "gaming" driver installed. Does anyone have the same trouble?
Same.
Is there any way to uncap the number of steps? I know there's severe diminishing returns but I still wanna try making images with more than 500 steps.
Why tho ? I've tried the same seed with steps from 25 to 500 and the difference is minimal, not worth the wait.
Why not? Even something minimal is something and chasing more steps to refine an image as much as possible is something I'd like to do. Mostly for images I like after doing the quick 10 second 50 step renders. I'd even try 10,000 steps since it'd only take like 30 minutes with my GPU.
I am trying to install this. It is showing this. How to fix this problem ?
Troubleshoot so far:
If you have less than 8Gb of VRAM use 512x316 or less Y
If you have only blobs, you need to have at least 512xXXX
stable diffusion filenotfounderror winerror 3: Relocate your save folder
If you want a loop of creating images, just spam the console with your input. Since "each new line is a new image"
Upon rendering start, it throws the following error and quits:
"Could not load library cudnn_ops_inter64_8.dll. Error code 126. Please make sure cudnn_ops_inter64_8.dll is in you library path!"
However I checked and this file is located in "./torch/lib".
Any ideas?
Edit: Found the solution. I simply moved the directory one level up.
Love the GUI, but I run into one problem. Not sure it is GUI related because there should be an easy solution.
Running on Windows I have the error with to many prompts. Tried to change the "sample_path" but it don't change anything.
Maybe someone can explain the process noob friendly, short prompts are very restrictive.
I am trying to run this. It is showing this. How to fix this problem ?
Decrease resolution. You only have 2GB of VRAM.
What is the ideal resolution for this ?
Running this locally needs quite a high end GPU. You can always try some really low resolutions if they work, but the results won't be optimal.
I tried 64 × 64 . It is still showing error.
restart every time after having that error, and try gradually increasing from 64x64
The description says 4 GB of VRAM should be enough, but it runs out even on the lowest resolution. Is this normal?
How can I generate more varations from an already generated result ? Like midourney ai.
Use the seed and modify lightly the prompt
Some other models have the img2img feature. This one doesn't.
Hmmm why is it free?
It's open source and it uses your own GPU ressources
The people over at StabbilityAI released the model as an OpenRAIL license. They do charge on their own site for renders but that's for GPU time.
https://stability.ai/blog/stable-diffusion-public-release
My RTX 3070 with 8GB for VRAM can only do 512X512 max.
Grisk create a front end for the model and packaged everything up for us.
I also have RTX 3070 and I can do 576x576
Nice. I'll try that.
What has been you best resolution for landscape and portrait?
Also, I know the engine supports more than 500 samples where would I change that in the python files? The file structure for this tool is a massive mess. LOL.
512x704 for portrait
On my 3080ti with 12GB ram I can do up to 704x704, if anyone's wondering.
This would be amazing with an option to run in a loop until stopped manually.
Leave it over night and get hundreds of variations.
I haven't tried with this tool but you should be able to do that by increasing your Samples per prompt to a high number. I do that with a command line interface with a different branch. As of yet, that function doesn't work with save to grid which is what I'm looking for. Wake up to many 12-image grids. I can wake up to 100+ of images though just by increasing the number of images generated per prompt. Got 101 the other night and then upsacled the 4X in the AM.
That feature doesn't work yet. It is possible to do though if I just copy the same request in multiple lines.
Need to copy paste a bunch of times if I want hundreds of results though.
I use an auto clicker to do so. Just run it once, check the time it takes and then put the time on your autoclicker and voila!
Just copy and paste the prompt a few hundred times into the field. Each line of the input field is a new execution.
A frog made out of a strawberry
A frog made out of a strawberry
A frog made out of a strawberry
A frog made out of a strawberry
A frog made out of a strawberry
Would generate 5 results.
A WOMAN MADE OUT OF STRAWBERRY
i cannot get diffusion to use my EGPU, instead it uses the worse Dgpu in the laptop even when selecting the 2060 manually in windows settings the program runs on the 2050, limiting vram availability. anyone know a workaround?
I had a similar issue and didn't find a solution. It was using my faster GPU with less VRAM where I couldn't achieve 512x512. I installed a different tool and edited a file that allowed me to point it at my slower GPU with more VRAM and now I can get 512X704.
Installed this.
https://github.com/lstein/stable-diffusion/tree/78aba5b770d6e85e44c730da9735118d...
Edit the dream.py file and change the last bottom bit of code to point at the GPU you desire.
if __name__ == "__main__":
os.environ["CUDA_VISIBLE_DEVICES"] = "1"
main()
i get an error when extracting "data error: stable diffusion GRisk GUI/torch/lib/torch_cuda_cu.dll" and when i try to run the program it just opens a console window for a half a second and closes.
I'm using a 1650 on a laptop, 256 x 256 image produces completely black result. I don't know what to do! Does anyone know a solution or at least what's causing the problem?
Show post...
Not enough Vram maybe, reduce the résolution to see what happen
I had a Vram problem at 512 x 512, but I lowered the resolution to 256 x 256. I checked the console - no errors. Apparently, it's written in the project, that the 16 series have problem with the half resolution option. It's the default one and cannot be unticked. Maybe I can find a workaround to find a way to turn it off?
1660 Ti produces black image at 64x64...
Can Successfully run 512x512 with a 2060 SUPER (8GB VRAM)
Yes.
try 704x512 or 512x704
Pytorch is not clearing the vram after each run forcing me to shut down the software to free up the GPU memory between each use. A few other posts sound like maybe they are experiencing similar.
Got the same RAM ussage, but running the second task replaces the used RAM with the new job, so I have no problems re-using it.
So, is there no way to run this on an AMD Card?
I have rx580 8gb vram
No, at least not yet. I really do wish they did support AMD GPUs, but I guess it is not really the focus of the development right now.
Is there a version that runs on Linux
I dont know if there is a GUI version for linux, but you can always download the source code in linux and run it or compile it. Source Code of the project is: here
Is there a way, even doing some coding and under-the-hood work to add custom data sets? As well, where's a tip button? I'd tip if I could find one.
Best I get on RTX a2000 with 4 GB is 128x256. And the output is pretty meaningless... Pretty colors but nothing like the prompt. Can anyone test an exact prompt and seed etc. At this setting so I can compare? Thanks!
I can test prompts, Which prompts would you like to be generated?
how about something simple, like "a dog and a cat" at 128x128? All it gives me is color full blobs. Thanks.
You are right I am getting same results, colors everywhere, I guess at this resolution is unusable. Even at 500 Steps...
With 320x320 you can start getting something understandable with LOTS of trial and error.
This is 128x128
This is 320x320
The 512x512 nail it every time
Show post...
hey are you able to do more than 250steps ? Have you tried this prompt at 500steps ?
I can do up to 500steps, this compiled version limits the steps to 500, however, recompiling it changing the max limit variable can allow to go beyond. (steps does not require additional VRAM, it will just iterate more the "dream")
that is very helpful information, thank you. In other words nothing I do will change this short of getting more vram!
Unfortunately on my measly 4 I can't do any better!
you need to bump it up to 512x512 to get normal results. Anything less will get you wacky results
Thanks!!
I ran it on a 3090Ti at about 5.75it/s but I cannot change the resolution, even for a small change it says I'm out of VRam !! lol !! I would like to change the aspect ratio but it seems to not work correctly If you need to write the prompt as time you need a generation, what is the "Samples per prompt" menu ?? Thanks for making me knowing this in local usage !! Many thanks !!
Also I would love to know more about V scale and half-precision, what is it exactly ?
Dont know what does V Scale stands for except that its the "guidance scale" whatever that means..., but half-precision is basically used when you got less than 10 GB of VRAM, uses float16 precision instead of the default float32 for the 10+ GB VRAM GPUs
Thanks for the details, the problem is that the box remains checked on "half precision" despite the 24gb of vram of my 3090Ti, I do not understand very well why.
For some reason it keeps running out of VRAM... even when I have it on 64x64, it instantly uses up all the memory (4 GB) and throws an error.
Is this happening to anyone else?
You've run out of VRAM (alloc failed) means it has no more room/space to allocate the needed memory because there is no more, and task fails.
I got this error while generating a 64x64 image with 50 steps:
RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling `cublasCreate(handle)
You've run out of VRAM (alloc failed) means it has no more room/space to allocate the needed memory because there is no more, and task fails.
Show post...
okay this interface ( and the work behind ;) ) is already very good, maybe fix the sample per prompt bug , increment the resolution in multiple of 64 direcly instead of 1, save the output folder path after a reboot of the gui. I don't know if it's a bug but i can't do more than 250 steps and this message apear in the console, happen the same thing with a lower resolution.
Rendering: Cat
0it [00:01, ?it/s]
Traceback (most recent call last):
File "start.py", line 363, in OnRender
File "torch\autograd\grad_mode.py", line 27, in decorate_context
return func(*args, **kwargs)
File "diffusers\pipelines\stable_diffusion\pipeline_stable_diffusion.py", line 152, in __call__
File "diffusers\schedulers\scheduling_pndm.py", line 136, in step
File "diffusers\schedulers\scheduling_pndm.py", line 212, in step_plms
File "diffusers\schedulers\scheduling_pndm.py", line 230, in _get_prev_sample
IndexError: index 1000 is out of bounds for dimension 0 with size 1000
I have a mistake. The images I have are only black.
Me too. I get the dreaded black image too
Me too! I don't know why it's happening!
What card? Also is your card overclocked?
I cant create photos its creating black box
1650 and entirely black image. Even resolutions as low as 64x64 generate no data at all
RuntimeError: CUDA out of memory. Tried to allocate 1024.00 MiB (GPU 0; 4.00 GiB total capacity; 2.55 GiB already allocated; 119.30 MiB free; 2.60 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
can anyone help me with this. i have a 1050ti 4gb. and I tried to get a 512x512 image.
Show post...
try reduce the resolution like 64x64 and slowly increment by 64 to know what yout card limit
512x512 is too much for 4GB of VRAM... I am hitting the limit of 576x576 with 8GB. so, doing this resolution with 4GB its practically impossible. In some cases my screen "goes black" due to lack of VRAM to output something in screen while the process is going...