Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is the annotation rule same as the FUNSD? #1

Open
tengerye opened this issue Aug 30, 2021 · 5 comments
Open

Is the annotation rule same as the FUNSD? #1

tengerye opened this issue Aug 30, 2021 · 5 comments

Comments

@tengerye
Copy link

Hi, may I ask if the annotation rule is the same as FUNSD? There are a number of strange examples.

@Isydmr
Copy link

Isydmr commented Oct 22, 2021

Thank you for sharing the dataset @ranpox @wolfshow.

I agree with @tengerye.

I'm trying to annotate my custom dataset to train with XFUND.

I made visualizations on the existing datasets (XFUND and FUNDS) to properly understand annotation rules.
In some cases, I encountered confusing labeling. Here are some remarks:

Orange, blue, green, and pink boxes correspond to the header, question, answer, and other respectively.
Linking array displayed on top of boxes.

a) Question or Header?

FUNSD

image

XFUND

image

Headers do not contain linking arrays in XFUND whereas FUNSD contains a lot of header with linking array that points
to questions.


b) Unanswered Questions

FUNSD

image

XFUND

image

XFUND docs labeled such as unanswered questions tagged as Other (see 'Téléphone 2')

c) Labeling Inconsistencies

XFUND - 1

image

XFUND - 2

image

IDENTITE is tagged as question but Identité du candidat is tagged as other in different images from XFUND.

@wolfshow
Copy link
Collaborator

@Isydmr We are working on XFUND v1.1. Please stay tuned.

@Isydmr
Copy link

Isydmr commented Oct 25, 2021

What is the timeline for XFUND v1.1?
We have a tagging project and we were planning to rely on XFUND v1.0 document annotation rules. Should we wait for XFUND v1.1?

@hasansalimkanmaz
Copy link

+1

@Rijgersberg
Copy link

Any idea on the timeline for XFUND v1.1? I'm considering annotating a Dutch dataset in XFUND style.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants