Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Considerations for the search summary table #165

Closed
3 tasks
rootsandberries opened this issue Jul 24, 2023 · 4 comments
Closed
3 tasks

Considerations for the search summary table #165

rootsandberries opened this issue Jul 24, 2023 · 4 comments

Comments

@rootsandberries
Copy link
Collaborator

I'm working with our search summary table for a project, and have some thoughts for improvement:

  • Change footnotes 4 and 5 to indicate that these are percentages. So Number of final included citations / Number of distinct records * 100, or Percent of final included citations in total number of distinct records.
  • Change Sensitivity/Recall column heading to Sensitivity (aka Recall)
  • I wonder if the F-score might be useful to add as a last column as a metric to evaluate and compare the usefulness of each source?
@TNRiley
Copy link
Collaborator

TNRiley commented Aug 10, 2023

1 and 2 are easy edits that I can take care of. I haven't worked with F score much, but can look into it in the future. Can you explain how it would be used?

@TNRiley
Copy link
Collaborator

TNRiley commented May 30, 2024

@rootsandberries there had been some changes made to tables a while back. Are these issues still relevant to the current tables?

@rootsandberries
Copy link
Collaborator Author

The tables look great! The only metric that I thought might be a useful addition in the table is 'f-score'. You can see it used here in this paper. It kind of provides a nice single number you can use to compare across sources to get a sense of the best source in terms of balance between sensitivity and precision. Not necessary, but perhaps somewhat easy to implement?

@rootsandberries there had been some changes made to tables a while back. Are these issues still relevant to the current tables?

@TNRiley
Copy link
Collaborator

TNRiley commented Jul 9, 2024

closing for now and adding F-score as a new issue for future

@TNRiley TNRiley closed this as completed Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants