Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use a pre-trained model for evaluating a new test set? #50

Open
Mahmedturk opened this issue Jul 27, 2019 · 4 comments
Open

Use a pre-trained model for evaluating a new test set? #50

Mahmedturk opened this issue Jul 27, 2019 · 4 comments

Comments

@Mahmedturk
Copy link

Mahmedturk commented Jul 27, 2019

Hi,

How can I use one of the pre-trained models from the 'models' folder to evaluate on a new test set? Just to check the generalization capability of the model?
The test set is already in BIO tagging scheme and need not to be splitted and tokenized. Just want to do the predictions and evaluation in terms of F1-score.

Thanks

@Mahmedturk
Copy link
Author

I have tried using a pre-trained model and got the following error.

OSError: Unable to open file (unable to open file: name = 'linnaeus-IOB_0.9593_0.8883_2.h5', errno = 2, error message = 'No such file or directory', flags = 0, o_flags = 0)

@nreimers
Copy link
Member

nreimers commented Aug 6, 2019

It appears that the file does not exist. Have you specified the correct path?

Have you tried the Save_and_Load.py:
https://github.com/UKPLab/emnlp2017-bilstm-cnn-crf/blob/master/Save_and_Load.py

Does it work?

@Mahmedturk
Copy link
Author

Hi,

I have specified the path correctly and the file does exist as i can see it.
There are a number of models that i have trained most of them would throw the above error. While few of them work.

@Mahmedturk
Copy link
Author

I haven't used save and load py. is it used for transfer learning?

I am only trying to use a pre-trained model for annotating free text for which i don't think i have to use saveandload.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants