Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feasibility of using code/logic on non-diffusers repository (applying DAAM to image editing models) #59

Open
BennoKrojer opened this issue Mar 21, 2024 · 0 comments

Comments

@BennoKrojer
Copy link

BennoKrojer commented Mar 21, 2024

Hi,

Thanks for this great paper+codebase! A deserved best paper award.

I am thinking of applying the DAAM idea to image editing models (i.e. InstructPix2Pix: https://github.com/timothybrooks/instruct-pix2pix) and was wondering how hard you think it would be to get the same logic running in a non-diffusers code base such as the linked Pix2Pix which is older CompVis code for SD1.5? For example what are the key parts of your code that would need to be reimplemented, and the evaluation part (IOU on COCO-Gen with 0.4 threshold) from the paper?

Let me know what you think!
Best,
Benno

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant