Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

the quality of generated image is low by benchmark on stable diffusion v1.5 #443

Open
aoke79 opened this issue May 16, 2024 · 7 comments
Open
Assignees
Labels
category: text to image Text 2 image pipeline

Comments

@aoke79
Copy link

aoke79 commented May 16, 2024

I've run the benchmark to test stable diffusion v1.5, but the quality of generated image is low. I doubted there are something computing wrong in the process.
I compared it with optimum-intel. and set the same prompt, steps (20), resolution (512x512), and got very different quality image. please have a look at.

xx_1
stable-diffusion-optimum-sdv1_5_p0_iter0_pid15516_output

@andrei-kochin
Copy link
Collaborator

@aoke79 please share the command you've run to get those images in optimum and in the benchmark?

Thank you!

@aoke79
Copy link
Author

aoke79 commented May 20, 2024

python benchmark.py -d GPU --model "C:\AIGC\openvino\models\stable-diffusion-sdv1_5" --prompt_file "prompts/stable-diffusion.jsonl" -n 3
the model was converted from hugging-face runway stable diffusion.

@e-ddykim
Copy link

@aoke79 Please check guidance_scale in https://github.com/openvinotoolkit/openvino.genai/blob/master/llm_bench/python/prompts/stable-diffusion.jsonl. Could you try it with the value of 7.5?

@Edward-Lin
Copy link

I have set up the same parameters for both cases. it should not be the root cause.

@Edward-Lin
Copy link

I've udpated the environments, like below, but the generated image is still wrong, nothing better.
python -m pip install --upgrade pip
pip install --pre -U openvino --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

please refer what I've attached for the details.
ov_pip_list.txt
stable-diffusion.jsonl.txt

@geunhwan
Copy link

geunhwan commented Jul 5, 2024

@Edward-Lin Please check above comment. guidance_scale 7.5

@Edward-Lin
Copy link

@Edward-Lin Please check above comment. guidance_scale 7.5

Have you ever tried? it did not work for me.

@ilya-lavrenov ilya-lavrenov added the category: text to image Text 2 image pipeline label Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: text to image Text 2 image pipeline
Projects
None yet
Development

No branches or pull requests

7 participants