Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

claim label #5

Open
ywjawmw opened this issue Apr 8, 2024 · 1 comment
Open

claim label #5

ywjawmw opened this issue Apr 8, 2024 · 1 comment

Comments

@ywjawmw
Copy link

ywjawmw commented Apr 8, 2024

Hi, I am very interested in your work. I found that the labels in the data set are only segment level but not claim level. Can you make the claim level label public? Thanks!

@shiqichen17
Copy link
Collaborator

Hi,
During the evaluation phase, we divide the segments into claims based on the hypothesis that models would have a better ability to assess factual information when dealing with smaller, easier tasks. We assess the claims individually and accumulate the results to align with the segment-level labels. This allows you to evaluate the method using the segment-level labels, which reflect the overall assessment of claims within each segment.
Please let me know if you have any further questions!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants