Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to control expression in the edit_sequence.py? #114

Open
jamja11 opened this issue Feb 23, 2023 · 2 comments
Open

How to control expression in the edit_sequence.py? #114

jamja11 opened this issue Feb 23, 2023 · 2 comments

Comments

@jamja11
Copy link

jamja11 commented Feb 23, 2023

Thanks for share of the great work!
I want to know how to control variance of expression from flame model.
and I want to change smile obj
so I found.. alter_sequence_shape within the edit_sequence.py, the model.betas[300:400] this can change the expression.
I changed parameters.. but I don't know mouth control..
please help and thank you

@TimoBolkart
Copy link
Owner

Indeed, changing betas 300-400 can change the expression but it will mess up the speech-related expressions. For expression control, one would need to disentangle the speech- and emotion-related expression to change only the emotional content while keeping the speech-related content unchanged. Unfortunately, we don't have any solution for this yet.

@jamja11
Copy link
Author

jamja11 commented Feb 23, 2023

Thank you for your response!
now, I don't use speech.. umm I just want to controll expression like webdemo
https://flame.is.tue.mpg.de/interactivemodelviewer.html
image

I try to edit model.betas[300:400] =
[3., 2., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
0., 0., 0., 0.]
image
umm.. nose shape is strange..
I want to know nose variation controll...
Thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants