Issue 239

KGQA · Jun 20, 2024 · 0e1e1b4 · 0e1e1b4
1 parent 450fa3c
commit 0e1e1b4
Show file tree

Hide file tree

Showing 4 changed files with 15 additions and 0 deletions.
diff --git a/freebase/ComplexQuestions.md b/freebase/ComplexQuestions.md
@@ -5,6 +5,7 @@
 
 |   Model / System    |   Year    | Average F1 |                                   Reported by                                |
 |:-------------------:|:---------:|:----------:|:----------------------------------------------------------------------------:|
+|      TFS-KBQA       |   2024    |    44.0    | [Shouhui Wang and Biao Qin](https://aclanthology.org/2024.lrec-main.1074.pdf)|
 |  Lan and Jiang [1]  |   2020    |    43.3    |      [Yonghui Jia and Wenliang Chen](https://arxiv.org/pdf/2204.12808.pdf)   |
 |      Reranking      |   2022    |    42.9    |      [Yonghui Jia and Wenliang Chen](https://arxiv.org/pdf/2204.12808.pdf)   |
 |   Luo et al. [2]    |   2020    |    42.8    |      [Yonghui Jia and Wenliang Chen](https://arxiv.org/pdf/2204.12808.pdf)   |

diff --git a/freebase/ComplexWebQuestions.md b/freebase/ComplexWebQuestions.md
@@ -14,6 +14,7 @@
 |     FLAN-T5              | 2023 |   -  |    -       |   46.69     |     EN    |    [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf)              |
 |     BART-large           | 2022 | 68.2 |   -        |   -     |     EN    |    [Hu et al.](https://aclanthology.org/2022.coling-1.145.pdf)              |
 |   FiDeLiS + gpt-4-turbo  | 2024 | 64.32|    71.47   |     -     |    EN    |           [Sui et al.](https://arxiv.org/pdf/2405.13873)                    |
+|         TFS-KBQA         | 2024 | 63.6 |     -      |      -    |   EN    | [Shouhui Wang and Biao Qin](https://aclanthology.org/2024.lrec-main.1074.pdf) |
 |  DECAF (BM25 + FiD-3B)   | 2022 |  -   |    70.4    |    -      |   EN    |              [Yu et al.](https://arxiv.org/pdf/2210.00063.pdf)              |
 |         CBR-KBQA         | 2022 |  -   |    70.4    |    -      |     EN    |              [Yu et al.](https://arxiv.org/pdf/2210.00063.pdf)              |
 | DECAF (BM25 + FiD-large) | 2022 |  -   | 68.1 ± 0.5 |    -      |     EN    |              [Yu et al.](https://arxiv.org/pdf/2210.00063.pdf)              |
@@ -28,6 +29,7 @@
 |    ProgramTransfer-pa    | 2022 | 54.5 |    54.3    |     -     |    EN    |        [Cao et al.](https://aclanthology.org/2022.acl-long.559.pdf)         |
 |          KD-CoT          | 2024 |  -   |    53.92   |     -     |    EN    |           [Sui et al.](https://arxiv.org/pdf/2405.13873)                    |
 |          NSM+h           | 2022 |  -   |    53.9    |     -     |    EN    |              [Yu et al.](https://arxiv.org/pdf/2210.00063.pdf)              |
+|          FC-KBQA         | 2024 | 54.1 |     -      |      -    |   EN    | [Shouhui Wang and Biao Qin](https://aclanthology.org/2024.lrec-main.1074.pdf) |
 |        REAREV            | 2022 |  -   |    52.9    |     -     |    EN    | [Costas Mavromatis and George Karypis](https://arxiv.org/pdf/2210.13650.pdf) |
 |        QNRKGQA+h         | 2022 |  -   |    51.5    |     -     |    EN    | [Ma et al.](https://link.springer.com/chapter/10.1007/978-3-031-10983-6_11) |
 |          SR+NSM          | 2022 |  -   |    50.2    |      -    |   EN    |              [Yu et al.](https://arxiv.org/pdf/2210.00063.pdf)              |
@@ -45,6 +47,7 @@
 |           TERP           | 2022 |  -   |    49.2    |      -    |   EN    | [Qiao et al.](https://aclanthology.org/2022.coling-1.156.pdf)  |
 |        TeacherNet        | 2022 | 44.0 |    48.8    |      -    |   EN    |        [Cao et al.](https://aclanthology.org/2022.acl-long.559.pdf)         |
 |           NSM            | 2022 | 44.0 |    48.8    |     -     |    EN    |              [Du et al.](https://arxiv.org/pdf/2209.03005.pdf)              |
+|         RnG-KBQA         | 2024 | 42.3 |     -      |      -    |   EN    | [Shouhui Wang and Biao Qin](https://aclanthology.org/2024.lrec-main.1074.pdf) |
 |          NSM+h           | 2022 |  -   |    48.8    |     -     |    EN    | [Ma et al.](https://link.springer.com/chapter/10.1007/978-3-031-10983-6_11) |
 |       TransferNet        | 2022 |  -   |    48.6    |     -     |    EN    |              [Du et al.](https://arxiv.org/pdf/2209.03005.pdf)              |
 |          NSM+p           | 2022 |  -   |    48.3    |     -     |    EN    | [Ma et al.](https://link.springer.com/chapter/10.1007/978-3-031-10983-6_11) |

diff --git a/freebase/WebQuestionsSP.md b/freebase/WebQuestionsSP.md
@@ -6,11 +6,14 @@
 |           Model / System            | Year |     F1     |   Hits@1   | Accuracy | Language |                                      Reported by                                      |
 | :---------------------------------: | :--: | :--------: | :--------: | :------: | :------: | :-----------------------------------------------------------------------------------: |
 |               chatGPT               | 2023 |     -      |     -      |  83.70   |    EN    |                  [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf)                   |
+|               TFS-KBQA              | 2024 |   79.9     |    79.8    |    -     |    EN    |      [Shouhui Wang and Biao Qin](https://aclanthology.org/2024.lrec-main.1074.pdf)    |
+|                Pangu                | 2024 |    79.6    |     -      |    -     |    EN    |      [Shouhui Wang and Biao Qin](https://aclanthology.org/2024.lrec-main.1074.pdf)    |
 |                TIARA                | 2022 |    78.9    |    75.2    |    -     |    EN    |            [Shu et. al.](https://aclanthology.org/2022.emnlp-main.555.pdf)            |
 |        DECAF (DPR + FiD-3B)         | 2022 |    78.8    |    82.1    |    -     |    EN    |                   [Yu et al.](https://arxiv.org/pdf/2210.00063.pdf)                   |
 |       FiDeLiS + gpt-4-turbo         | 2024 |   78.32    |    84.39   |    -     |    EN    |              [Sui et al.](https://arxiv.org/pdf/2405.13873)                           |
 |              GPT-3.5v3              | 2023 |     -      |     -      |  79.60   |    EN    |                  [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf)                   |
 |       DECAF (DPR + FiD-large)       | 2022 | 77.1 ± 0.2 | 80.7 ± 0.2 |    -     |    EN    |                   [Yu et al.](https://arxiv.org/pdf/2210.00063.pdf)                   |
+|               FC-KBQA               | 2024 |   76.9     |     -      |    -     |    EN    |      [Shouhui Wang and Biao Qin](https://aclanthology.org/2024.lrec-main.1074.pdf)    |
 |       FiDeLiS + gpt-3.5-turbo       | 2024 |   76.78    |    79.32   |    -     |    EN    |              [Sui et al.](https://arxiv.org/pdf/2405.13873)                           |
 |               UniK-QA               | 2022 |     -      |    79.1    |    -     |    EN    |                   [Yu et al.](https://arxiv.org/pdf/2210.00063.pdf)                   |
 |             Sun et al.              | 2024 |     -      |    77.8    |    -     |    EN    |             [Sun et al.](https://aclanthology.org/2024.lrec-main.496.pdf)             |