Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Find out where models are typically stored #39

Closed
plbenveniste opened this issue Jul 6, 2023 · 4 comments
Closed

Find out where models are typically stored #39

plbenveniste opened this issue Jul 6, 2023 · 4 comments
Assignees

Comments

@plbenveniste
Copy link
Collaborator

plbenveniste commented Jul 6, 2023

Eg: check on various nnUnet-based projects, are they hosted on GH? if so on the release artifacts (what is max size), if not where do ppl usually store these models?

Related to #38

@plbenveniste plbenveniste self-assigned this Jul 7, 2023
@plbenveniste
Copy link
Collaborator Author

It seems that the best strategy is to host the model in a google drive or dropbox and add the link to the Github page.
Another solution could be to store the model in the release: but it's meant to make available versions of the code and the model weights don't rely fit in that category.

Do we have an ivadomed or neuropoly google drive section specifically designed for hosting pre-trained models ?

@jcohenadad
Copy link
Member

It seems that the best strategy is to host the model in a google drive or dropbox and add the link to the Github page.

That could be an option indeed.

Another solution could be to store the model in the release: but it's meant to make available versions of the code and the model weights don't rely fit in that category.

I think it is totally appropriate to release models as 'release artifacts', as we did here. However, GH artifacts are size limited (I think it is 100MB but we should double check), so if models are larger, then we should host them somewhere else (eg: gdrive as you mentioned).

@plbenveniste
Copy link
Collaborator Author

I think that for a release, the maximum size is 2GB. (I was able to test uploading a 1GB file to a new release).
Should we prefer a realease rather than a google drive then ?

@jcohenadad
Copy link
Member

Should we prefer a realease rather than a google drive then ?

Yes. Better to have it centralized in the same repos (for permission issues) and Gdrive is not accessible in some countries (eg China)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants