how to do Identity Mixing?

[loboere]

No description provided.

[jshilong]

This code does not implement Identity Mixing. You can implement it by combining two ID results on

FlashFace/flashface/all_finetune/models/reference_unet.py

Line 96 in a3afe3f

x = x + (self.self_attn.self_attn_first(

and

FlashFace/flashface/all_finetune/models/reference_unet.py

Line 108 in a3afe3f

x = x + (self.self_attn.self_attn_first(

[loboere]

I would implement it but I don't understand what part of the code represents the id

[jshilong]

I would implement it but I don't understand what part of the code represents the id

Thank you very much for your interest in our work. To understand the meaning of these tensors, you may need to set a breakpoint and refer to the article. The ID information is encoded in "ctx". If you want to mix the IDs, you should first obtain "ctx_id1" and "ctx_id2". Then, you can calculate "x" using the following formula:

x = x + (self.self_attn.self_attn_first(y, ctx_id1)) * self.share_cache['similarity'] + (1 - self.share_cache['similarity']) * self.self_attn.self_attn_first(y, ctx_id2)

if you encounter any difficulties, please don't hesitate to ask me for help.

[loboere]

I don't understand how to load two IDs, ctx was generated from y and y from x, I don't know what x is, could you give me some code to load two IDs?

[loboere]

Do you plan to publish the code for Identity Mixing?

[jshilong]

Do you plan to publish the code for Identity Mixing?

Absolutely, this would be a modification to the existing code. I will add this function soon.

[loboere]

It's been a while, please add it as soon as possible

[loboere]

any news?

[zimenglan-sysu-512]

+1

[loboere]

please @jshilong add it as soon as possible

[loboere]

any news @jshilong