Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to get the .scores file? #1

Open
JZX555 opened this issue Sep 11, 2020 · 1 comment
Open

How to get the .scores file? #1

JZX555 opened this issue Sep 11, 2020 · 1 comment

Comments

@JZX555
Copy link

JZX555 commented Sep 11, 2020

I'm trying to use Lingeval97 on my NMT system, but it seems need .scores file. I can't find how to get this file in README or the origin paper. How to get the .scores file by NMT system?

@rsennrich
Copy link
Owner

This will depend on your NMT toolkit. Nematus provides the script score.py for this, but not all toolkits provide an interface to obtain sentence-level scores for a parallel corpus. If they don't, you can check how to get the perplexity for a validation set (which most toolkits support) and see if you can adapt this functionality.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants