Metric: Test (higher is better)
| # | Model↕ | Test▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | Rational Reasoner / IDOL | 80.6 | No | IDOL: Indicator-oriented Logic Pre-training for ... | 2023-06-27 | Code |
| 2 | AMR-LE-Ensemble | 80 | No | - | - | - |
| 3 | MERIt(MERIt-deberta-v2-xxlarge ) | 79.3 | No | MERIt: Meta-Path Guided Contrastive Learning for... | 2022-03-01 | Code |
| 4 | MERIt-deberta-v2-xxlarge deberta.v2.xxlarge.path.override_True.norm_1.1.0.w2.A100.cp200.s42 | 79.3 | No | - | - | - |
| 5 | Knowledge model | 79.2 | No | - | - | - |
| 6 | DeBERTa-v2-xxlarge-AMR-LE-Contraposition | 77.2 | No | - | - | - |
| 7 | LReasoner ensemble | 76.1 | No | Logic-Driven Context Extension and Data Augmenta... | 2021-05-08 | Code |
| 8 | ELECTRA and ALBERT | 71 | No | - | - | - |
| 9 | WWZ | 69.7 | No | - | - | - |
| 10 | xlnet-large-uncased [extended data] | 69.3 | No | - | - | - |
| 11 | albert_4gpus_bs2_DACE | 68.6 | No | - | - | - |
| 12 | Tournament2 | 66.7 | No | - | - | - |
| 13 | MERIt + Structure Decouple (roberta-large) | 65.6 | No | - | - | - |
| 14 | RoBERTa-single | 63.5 | No | Logiformer: A Two-Branch Graph Transformer Netwo... | 2022-05-02 | Code |
| 15 | MERIT w/ reasoning aware | 63.2 | No | - | - | - |
| 16 | ALBERT-XXLarge-V2 | 62.6 | No | - | - | - |
| 17 | VDGN(RoBERTa single model) | 61.7 | No | - | - | - |
| 18 | ro_DA_CE_v100_224 | 61.7 | No | - | - | - |
| 19 | qmcurtis | 60.3 | No | - | - | - |
| 20 | AdaLoGN | 60.2 | No | - | - | - |
| 21 | Zhangjie666 | 60.2 | No | - | - | - |
| 22 | alsace | 59.2 | No | - | - | - |
| 23 | RoBERTa-single | 58.9 | No | Fact-driven Logical Reasoning for Machine Readin... | 2021-05-21 | Code |
| 24 | NAACL 2021 | 58.2 | No | DAGN: Discourse-Aware Graph Network for Logical ... | 2021-03-26 | Code |
| 25 | Roberta Large GCN(dev: 0.63) | 57.7 | No | - | - | - |
| 26 | xlnet_l | 57.7 | No | - | - | - |
| 27 | elBERto | 57.3 | No | - | - | - |
| 28 | 5BitClan | 56.9 | No | - | - | - |
| 29 | SimChea | 56 | No | - | - | - |
| 30 | XLNet-large | 56 | No | ReClor: A Reading Comprehension Dataset Requirin... | 2020-02-11 | Code |
| 31 | RoBERTa-large | 55.6 | No | ReClor: A Reading Comprehension Dataset Requirin... | 2020-02-11 | Code |
| 32 | XLNet-base | 50.4 | No | ReClor: A Reading Comprehension Dataset Requirin... | 2020-02-11 | Code |
| 33 | BERT-large+MNLI | 50.3 | No | - | - | - |
| 34 | BERT-large | 49.8 | No | ReClor: A Reading Comprehension Dataset Requirin... | 2020-02-11 | Code |
| 35 | RoBERTa-base | 48.5 | No | ReClor: A Reading Comprehension Dataset Requirin... | 2020-02-11 | Code |
| 36 | BERT-base | 47.3 | No | ReClor: A Reading Comprehension Dataset Requirin... | 2020-02-11 | Code |
| 37 | Gariscat | 40.5 | No | - | - | - |
| 38 | BachTE | 26 | No | - | - | - |
| 39 | TwistedFate | 25.3 | No | - | - | - |