Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Huge difference between Stage branch 1 accuracy and branch 2 accuracy #8

Open
dreamstorm25 opened this issue Mar 14, 2020 · 3 comments

Comments

@dreamstorm25
Copy link

I am training a model based on your repository but it does pose estimation on 13 keypoints. The code has been modified to adapt to new configuration. During training I noticed that there is a huge difference between the L1_acc and L2_acc of any stage. While L2_acc has gone over 0.99 and is steadily increasing, L1_acc is unstable as it increases and decreases without any pattern. L1_acc is about the PAFs and L2_acc is for confidence maps. Could you help me figure out what the issues can occur while predicting PAFs ?
diff

@dreamstorm25 dreamstorm25 changed the title Huge difference between Stage 1 accuracy and Stage 2 accuracy Huge difference between Stage branch 1 accuracy and branch 2 accuracy Mar 14, 2020
@Bardhitoo
Copy link

Having the same issue - did you solve it?

@dreamstorm25
Copy link
Author

I have noticed that my results are fine(not always spot on but mostly good), so I am guessing accuracy doesn't play that much of a part in PAFs, it's the loss you should be looking at.

@kuanyshbakytuly
Copy link

I am training a model based on your repository but it does pose estimation on 13 keypoints. The code has been modified to adapt to new configuration. During training I noticed that there is a huge difference between the L1_acc and L2_acc of any stage. While L2_acc has gone over 0.99 and is steadily increasing, L1_acc is unstable as it increases and decreases without any pattern. L1_acc is about the PAFs and L2_acc is for confidence maps. Could you help me figure out what the issues can occur while predicting PAFs ? diff

Could you share the code for evaluating accuracy?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants