Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About computing overall recall #4

Open
Foehnc opened this issue Oct 19, 2021 · 1 comment
Open

About computing overall recall #4

Foehnc opened this issue Oct 19, 2021 · 1 comment

Comments

@Foehnc
Copy link

Foehnc commented Oct 19, 2021

Thanks for your sharing, I found you mentioned " CaRB’s recall computation uses the notion of multi-match, wherein a gold tuple can match multiple system extractions.", but in your code

recall_numerator = 0 # 
for i, row in enumerate(scores): # 
        max_recall_row = max([row[ext_indx][1] for ext_indx in ext_indices], default=0) # score: [P, R],所以要取[1]
        recall_numerator += max_recall_row

I think this mens one gold tuple can only match one system extraction.

@Foehnc
Copy link
Author

Foehnc commented Oct 19, 2021

Even one system extraction may match multiple gold tuples.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant