Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About pytorch encoding and the training speed #16

Open
irfanICMLL opened this issue Jul 16, 2018 · 3 comments
Open

About pytorch encoding and the training speed #16

irfanICMLL opened this issue Jul 16, 2018 · 3 comments

Comments

@irfanICMLL
Copy link

Hi,
Thank you for your great work! I am trying to do some distillation work on the small mobile net. I have some questions:
The code need the package pytorch encoding, but the pytorch encoding requires the pytorch to be 0.5.0. Your code is about pytorch 0.3.0+. I wonder how do you install the package of pytorch encoding?

However, the code can run under pytorch 0.5.0, but the training speed is very slow. I used a single P100 to have a try, and it need nearly 7 minutes to finish one epoch. If we need to train 10000 epochs, it will take nearly 48 days.
Is this because the different pytorch version?

Thanks,
Yifan

@irfanICMLL
Copy link
Author

Hello~ It is me again~ I still want to ask what version of pytorch you use. Because before pytorch 0.4.0, the upsample operator is default to set the align corner=True. And with 0.4 and 0.5, align corner=False. I train from the pretrain model of mobile
cityscapes_mobilenetv2_best_model.pkl , I set the align cornet= False. But I can only get 68% of mean IOU on the validation set.

Can you kindly share the details for this setting ?Or some other settings need to be notice during training?

Thank you very much!

@fip-lab
Copy link

fip-lab commented Oct 20, 2018

Hello~ It is me again~ I still want to ask what version of pytorch you use. Because before pytorch 0.4.0, the upsample operator is default to set the align corner=True. And with 0.4 and 0.5, align corner=False. I train from the pretrain model of mobile
cityscapes_mobilenetv2_best_model.pkl , I set the align cornet= False. But I can only get 68% of mean IOU on the validation set.

Can you kindly share the details for this setting ?Or some other settings need to be notice during training?

Thank you very much!

hi, i try run this code, but not success, can you share version of depend? Thank you very much!

@ozgurovic
Copy link

Hi, I just installed, so I wanted to share. You can use pytorch 0.3 with encoding v0.1.0. It works fine (at least for testing).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants