Skip to content

Commit

Permalink
add paper "Question Answering over Knowledge Graphs via Machine Readi…
Browse files Browse the repository at this point in the history 
…ng Comprehension" (v2.0)
  • Loading branch information
@DavidBlavid
DavidBlavid committed Sep 30, 2023
1 parent 25ac37a commit 535ba58
Show file tree
Hide file tree
Showing 3 changed files with 33 additions and 30 deletions.
61 changes: 31 additions & 30 deletions dbpedia/LC-QuAD v2.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -3,33 +3,34 @@ name: LC-QuAD v2
datasetUrl: https://figshare.com/projects/LCQuAD_2_0/62270
---

| Model / System | Year | Precision | Recall | F1 | Language | Reported by | Gold Entity |
| :-----------------------: | :--: | :-------: | :----: | :---: | :------: | :----------------------------------------------------------------------------------: | :---------: |
| T5-Small | 2022 | - | - | 92 | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| T5-Base | 2022 | - | - | 91 | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| PGN-BERT-BERT | 2022 | - | - | 86 | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| SGPT_Q,K [1] | 2022 | - | - | 89.04 | EN | [Al Hasan Rony et al.](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9815253) | ✅ |
| PGN-BERT | 2022 | - | - | 77 | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| NSpM [2] | 2022 | - | - | 66.47 | EN | [Al Hasan Rony et al.](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9815253) | ✅ |
| BART | 2022 | - | - | 64 | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| Zou et al. + Bert | 2021 | - | - | 59.30 | EN | [Zou et al.](https://arxiv.org/pdf/2111.06086.pdf) | ✅ |
| CLC | 2021 | - | - | 59 | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| Multi-hop QGG | 2020 | - | - | 53 | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| Zou et al. + Tencent Word | 2021 | - | - | 52.90 | EN | [Zou et al.](https://arxiv.org/pdf/2111.06086.pdf) | ✅ |
| Multi-hop QGG | 2021 | - | - | 52.60 | EN | [Zou et al.](https://arxiv.org/pdf/2111.06086.pdf) | ✅ |
| AQG-net | 2021 | - | - | 44.90 | EN | [Zou et al.](https://arxiv.org/pdf/2111.06086.pdf) | ✅ |
| SGPT_Q [3] | 2022 | - | - | 83.45 | EN | [Al Hasan Rony et al.](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9815253) | ❌ |
| ChatGPT | 2023 | - | - | 42.76 | EN | [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf) | ❌ |
| GPT-3.5v3 | 2023 | - | - | 39.04 | EN | [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf) | ❌ |
| GPT-3.5v2 | 2023 | - | - | 33.77 | EN | [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf) | ❌ |
| GPT-3 | 2023 | - | - | 33.04 | EN | [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf) | ❌ |
| FLAN-T5 | 2023 | - | - | 30.14 | EN | [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf) | ❌ |
| UNIQORN | 2021 | 33.1 | - | - | EN | [Pramanik et al.](https://arxiv.org/abs/2108.08614) | ❌ |
| QAnswer | 2020 | 30.80 | - | - | EN | [Pramanik et al.](https://arxiv.org/abs/2108.08614) | ❌ |
| GraftNet | 2018 | 19.7 | - | - | EN | [Christmann P. et al](https://arxiv.org/pdf/2108.08597.pdf) | ❌ |
| ElNeuQA-ConvS2S [1] | 2021 | 26.90 | 27 | 26.90 | EN | [Diomedi, Hogan](https://arxiv.org/pdf/2107.02865.pdf) | ❌ |
| GRAFT-Net + Clocq [2] | 2022 | 19.70 | - | - | EN | [Christmann P. et al](https://arxiv.org/pdf/2108.08597.pdf) | ❌ |
| Platypus | 2018 | 3.6 | - | - | EN | [Pramanik et al.](https://arxiv.org/abs/2108.08614) | ❌ |
| Pullnet | 2019 | 1.1 | - | - | EN | [Pramanik et al.](https://arxiv.org/abs/2108.08614) | ❌ |
| UNIK-QA | 2020 | 0.5 | - | - | EN | [Pramanik et al.](https://arxiv.org/abs/2108.08614) | ❌ |
| GETT-QA [4] | 2023 | 40.3 | - | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2303.13284.pdf) | ❌ |
| Model / System | Year | Precision | Recall | F1 | Hits@1 | Language | Reported by | Gold Entity |
| :-----------------------: | :--: | :-------: | :----: | :---: | :----: | :------: | :----------------------------------------------------------------------------------: | :---------: |
| T5-Small | 2022 | - | - | 92 | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| T5-Base | 2022 | - | - | 91 | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| PGN-BERT-BERT | 2022 | - | - | 86 | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| SGPT_Q,K [1] | 2022 | - | - | 89.04 | - | EN | [Al Hasan Rony et al.](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9815253) | ✅ |
| PGN-BERT | 2022 | - | - | 77 | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| NSpM [2] | 2022 | - | - | 66.47 | - | EN | [Al Hasan Rony et al.](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9815253) | ✅ |
| BART | 2022 | - | - | 64 | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| Zou et al. + Bert | 2021 | - | - | 59.30 | - | EN | [Zou et al.](https://arxiv.org/pdf/2111.06086.pdf) | ✅ |
| CLC | 2021 | - | - | 59 | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| Multi-hop QGG | 2020 | - | - | 53 | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2204.12793.pdf) | ✅ |
| Zou et al. + Tencent Word | 2021 | - | - | 52.90 | - | EN | [Zou et al.](https://arxiv.org/pdf/2111.06086.pdf) | ✅ |
| Multi-hop QGG | 2021 | - | - | 52.60 | - | EN | [Zou et al.](https://arxiv.org/pdf/2111.06086.pdf) | ✅ |
| AQG-net | 2021 | - | - | 44.90 | - | EN | [Zou et al.](https://arxiv.org/pdf/2111.06086.pdf) | ✅ |
| SGPT_Q [3] | 2022 | - | - | 83.45 | - | EN | [Al Hasan Rony et al.](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9815253) | ❌ |
| W. Han et al. | 2023 | - | - | - | 42.6 | EN | [Han et al.](https://link.springer.com/chapter/10.1007/978-3-031-30672-3_39) | ❌ |
| ChatGPT | 2023 | - | - | 42.76 | - | EN | [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf) | ❌ |
| GPT-3.5v3 | 2023 | - | - | 39.04 | - | EN | [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf) | ❌ |
| GPT-3.5v2 | 2023 | - | - | 33.77 | - | EN | [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf) | ❌ |
| GPT-3 | 2023 | - | - | 33.04 | - | EN | [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf) | ❌ |
| FLAN-T5 | 2023 | - | - | 30.14 | - | EN | [Tan et al.](https://arxiv.org/pdf/2303.07992.pdf) | ❌ |
| UNIQORN | 2021 | 33.1 | - | - | 25.2 | EN | [Pramanik et al.](https://arxiv.org/abs/2108.08614) | ❌ |
| QAnswer | 2020 | 30.80 | - | - | - | EN | [Pramanik et al.](https://arxiv.org/abs/2108.08614) | ❌ |
| GraftNet | 2018 | 19.7 | - | - | - | EN | [Christmann P. et al](https://arxiv.org/pdf/2108.08597.pdf) | ❌ |
| ElNeuQA-ConvS2S [1] | 2021 | 26.90 | 27 | 26.90 | - | EN | [Diomedi, Hogan](https://arxiv.org/pdf/2107.02865.pdf) | ❌ |
| GRAFT-Net + Clocq [2] | 2022 | 19.70 | - | - | - | EN | [Christmann P. et al](https://arxiv.org/pdf/2108.08597.pdf) | ❌ |
| Platypus | 2018 | 3.6 | - | - | - | EN | [Pramanik et al.](https://arxiv.org/abs/2108.08614) | ❌ |
| Pullnet | 2019 | 1.1 | - | - | 11.9 | EN | [Pramanik et al.](https://arxiv.org/abs/2108.08614) | ❌ |
| UNIK-QA | 2020 | 0.5 | - | - | - | EN | [Pramanik et al.](https://arxiv.org/abs/2108.08614) | ❌ |
| GETT-QA [4] | 2023 | 40.3 | - | - | - | EN | [Banerjee et al.](https://arxiv.org/pdf/2303.13284.pdf) | ❌ |
1 change: 1 addition & 0 deletions freebase/WebQuestionsSP.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,7 @@
| KGQA-CL(XLnet) | 2023 | - | - | 61.46 | EN | [Hu et al.](https://arxiv.org/pdf/2303.10368.pdf) |
| KGQA-CL(DistilRoberta) | 2023 | - | - | 61.05 | EN | [Hu et al.](https://arxiv.org/pdf/2303.10368.pdf) |
| KGQA-CL(GPT2) | 2023 | - | - | 60.49 | EN | [Hu et al.](https://arxiv.org/pdf/2303.10368.pdf) |
| W. Han et al. | 2023 | - | 75.2 | - | EN | [Han et al.](https://link.springer.com/chapter/10.1007/978-3-031-30672-3_39) |
| NSM | 2021 | - | 74.30 | - | EN | [He et al.](https://arxiv.org/pdf/2101.03737.pdf) |
| Rigel | 2022 | - | 73.3 | - | EN | [Costas Mavromatis and George Karypis](https://arxiv.org/pdf/2210.13650.pdf) |
| SGM | 2022 | 72.36 | - | - | EN | [Ma L et al.](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9747229) |
Expand Down
Loading

0 comments on commit 535ba58

Please sign in to comment.