You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Could you release the answers of the test set?
A few months ago, I tried to contact the authors for evaluation on the test set, but I failed to receive a reply.
I think that manual evaluation imposes lots of burden on the authors.
So, I suggest to release the answers of the test set, so many researchers can easily evaluate their models on the test set, then KQA Pro would be more frequently cited.
Similarly, the NLVR benchmark released its test set after a few years from the publication of its paper.
I would appreciate it if you would consider my suggestion.
The text was updated successfully, but these errors were encountered:
Could you release the answers of the test set?
A few months ago, I tried to contact the authors for evaluation on the test set, but I failed to receive a reply.
I think that manual evaluation imposes lots of burden on the authors.
So, I suggest to release the answers of the test set, so many researchers can easily evaluate their models on the test set, then KQA Pro would be more frequently cited.
Similarly, the NLVR benchmark released its test set after a few years from the publication of its paper.
I would appreciate it if you would consider my suggestion.
The text was updated successfully, but these errors were encountered: