TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Natural Language Processing/Question Answering/SQuAD2.0

Question Answering on SQuAD2.0

Metric: EM (higher is better)

LeaderboardDataset
Loading chart...

Results

Submit a result
#Model↕EM▼Extra DataPaperDate↕Code
1IE-Net (ensemble)90.939No---
2FPNet (ensemble)90.871No---
3IE-NetV2 (ensemble)90.86No---
4SA-Net on Albert (ensemble)90.724No---
5SA-Net-V2 (ensemble)90.679No---
6FPNet (ensemble)90.6No---
7Retro-Reader (ensemble)90.578NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
8EntitySpanFocusV2 (ensemble)90.521No---
9TransNets + SFVerifier + SFEnsembler (ensemble)90.487No---
10EntitySpanFocus+AT (ensemble)90.454No---
11ATRLP+PV (ensemble)90.442No---
12LANetV2 (ensemble)90.42No---
13ELECTRA+ALBERT+EntitySpanFocus (ensemble)90.42No---
14ALBERT + DAAF + Verifier90.386No---
15electra+nlayers+adv+ds90.284No---
16MixEnsemble (ensemble)90.194No---
17electra+nlayers (ensemble)90.126No---
18Retro-Reader on ALBERT (ensemble)90.115NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
19Retro-Reader on ALBERT (ensemble)90.115NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
20ANet90.081No---
21Answer Dependent Classify (single model)90.059No---
22electra+nlayers+kdav (ensemble)90.002No---
23ALBERT + DAAF + Verifier (ensemble)90.002No---
24LANet (ensemble)89.923No---
25Electra-nlayers (ensemble)89.777No---
26Albert_Verifier_AA_Net (ensemble)89.743No---
27ALBERT (ensemble model)89.731NoALBERT: A Lite BERT for Self-supervised Learning...2019-09-26Code
28Span Extract + Classify (single model)89.562No---
29Retro-Reader on ELECTRA (single model)89.562NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
30ELECTRA+ATRLP+PV (single model)89.551No---
31albert+transform+verify (ensemble)89.528No---
32albert+KD+transfer (ensemble)89.461No---
33ROaD-Electra (single model)89.449No---
34ROaD-Electra89.449No---
35Albert-nlayers (ensemble)89.404No---
36ELECTRA + E-Verifier (ensemble)89.348No---
37ELECTRA + ROBERTA + ALBERT (ensemble)89.325No---
382task (single model)89.325No---
39Deberta89.235No---
40ALBERT + MTDA + SFVerifier (ensemble model)89.235No---
41ALBert-LSTM (ensemble)89.224No---
42ALBERT + SFVerifier (ensemble model)89.133No---
43ELECTRA+RL+EV (single model)89.021No---
44electra & albert (ensemble)88.998No---
45AE-TEST88.998No---
46ELECTRA+EntitySpanFocus (Single model)88.874No---
47SA-Net on Electra (single model)88.851No---
48ALBERT+Entailment DA (ensemble)88.761No---
49ELECTRA (single model)88.716No---
50Tuned ALBERT (ensemble model)88.637No---
51ELECTRA_ATT (single model)88.614No---
52Deberta+prefix88.603No---
53ALBERT (Single model)88.592No---
54XLNet + DAAF + Verifier (ensemble)88.592No---
55ALBERT + IG + NE (single model)88.569No---
56ALBERT + IG (single model)88.524No---
57aanet_v2.0 (single model)88.434No---
58albert+verifier (single model)88.355No---
59albert+KD+transfer (single)88.298No---
60UPM (ensemble)88.231No---
61ALBERT + SFVerifier (single model)88.197No---
62{alber_m_transfor} (single model)88.186No---
63XLNet + SG-Net Verifier (ensemble)88.174NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14Code
64Retro-Reader on ALBERT (single model)88.107NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
65Retro-Reader on ALBERT (single model)88.107NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
66ALBERT (single model)88.107NoALBERT: A Lite BERT for Self-supervised Learning...2019-09-26Code
67ALBERT (single model)88.107NoALBERT: A Lite BERT for Self-supervised Learning...2019-09-26Code
68{MTL} (single model)88.107No---
69MTL (single model)88.107No---
70albert_with_tricks (single)88.073No---
71ALBert (single-model)88.05No---
72XLNet + SG-Net Verifier (ensemble)88.05No---
73DeBERTalarge88NoDeBERTa: Decoding-enhanced BERT with Disentangle...2020-06-05Code
74ALBERT 1.1 Th (single model)87.994No---
75SkERT-Large (single model)87.994No---
76albert+KD+transfer+twopass (single)87.949No---
77XLNet (single model)87.926NoXLNet: Generalized Autoregressive Pretraining fo...2019-06-19Code
78ALBERT+RL (single model)87.87No---
79ALBERT+Entailment DA Verifier (single model)87.847No---
80Tuned ALBERT (single model)87.847No---
81albert_xxlarge (single model)87.802No---
82ALBERT 1.1 (single model)87.7No---
83LUKE (single model)87.429NoLUKE: Deep Contextualized Entity Representations...2020-10-02Code
84LUKE (single model)87.429NoLUKE: Deep Contextualized Entity Representations...2020-10-02Code
85XLNet + SG-Net Verifier++ (single model)87.238NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14Code
86UPM (single model)87.193No---
87BERT + DAE + AoA (ensemble)87.147No---
88XLNet + SG-Net Verifier (single model)87.046No---
89RoBERTa+Verify (ensemble)86.933No---
90RoBERTa (single model)86.82NoRoBERTa: A Robustly Optimized BERT Pretraining A...2019-07-26Code
91RoBERTa (single model)86.82NoRoBERTa: A Robustly Optimized BERT Pretraining A...2019-07-26Code
92BERT + ConvLSTM + MTL + Verifier (ensemble)86.73No---
93BERT + N-Gram Masking + Synthetic Self-Training (ensemble)86.673No---
94RoBERTa+Span (ensemble)86.651No---
95Xlnet+Verifier86.594No---
96Xlnet+Verifier(single model)86.572No---
97Xlnet+Verifier (single model)86.572No---
98RoBERTa+Verify (single model)86.448No---
99XLNET-123 (single model)86.436No---
100XLNET-V2-123+ (single model)86.403No---
101XLNet (single model)86.346No---
102SG-Net (ensemble)86.211NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14-
103SG-Net (ensemble)86.211NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14Code
104BERT++(ensemble)86.166No---
105SemBERT(ensemble)86.166NoSemantics-aware BERT for Language Understanding2019-09-05Code
106SemBERT(ensemble)86.166NoSemantics-aware BERT for Language Understanding2019-09-05Code
107SemBERT (ensemble)86.166NoSemantics-aware BERT for Language Understanding2019-09-05Code
108Enhanced Albert+Verifier (ensemble)86.098No---
109BERT + DAE + AoA (single model)85.884No---
110RoBERTa+Span (single model)85.872No---
111RoBERTa-Large (ensemble model)85.872No---
112BNDVnet (ensemble model)85.85No---
113Unnamed submission by guo85.838No---
114BERTSP(single model)85.838No---
115BERTSP (single model)85.838No---
116Enhanced Albert+Verifier3 (ensemble)85.827No---
117SENSEFORTH + XLNet (single model)85.827No---
118SpanBERT (single model)85.748No---
119SemBERT (ensemble model)85.703No---
120SpanBERT85.7NoSpanBERT: Improving Pre-training by Representing...2019-07-24Code
121BertCNN (single model)85.24No---
122SG-Net (single model)85.229NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14-
123SG-Net (single model)85.229NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14Code
124RoBERTa-Large (single model)85.173No---
125BERT + N-Gram Masking + Synthetic Self-Training (single model)85.15No---
126BERT + MMFT + ADA (ensemble)85.082No---
127BNDVnet (single model)85.003No---
128BERT + ConvLSTM + MTL + Verifier (single model)84.924No---
129Insight-baseline-BERT (single model)84.834No---
130BertSpan (ensemble)84.823No---
131SemBERT (single model)84.8NoSemantics-aware BERT for Language Understanding2019-09-05Code
132SemBERT (single model)84.8NoSemantics-aware BERT for Language Understanding2019-09-05Code
133Hanvon_model(single model)84.721No---
134Hanvon_model (single model)84.721No---
135xlnet84.642No---
136xlnet(single model)84.642No---
137xlnet (single model)84.642No---
138BERT++(single model)84.62No---
139BERT + Synthetic Self-Training (ensemble)84.292No---
140BERT + Multiple-CNN (ensemble)(Kyonggi University84.202No---
141BERT + Multiple-CNN (ensemble)84.202No---
142RoberTa Parallel Adapters Singl84.123No---
143RoberTa Parallel Adapters Single84.123No---
144RoberTa+Parallel+Adapters (single model)84.123No---
145SemNet (single model)83.819No---
146Tuned BERT-1seq Large Cased (single model)83.751No---
147BERT finetune baseline (ensemble)83.536No---
148SynNet (single model)83.525No---
149Lunet + Verifier + BERT (ensemble)83.469No---
150PAML+BERT (ensemble model)83.457No---
151Unnamed submission by Senseforth_AI83.142No---
152SENSEFORTH + BERT83.142No---
153Bert-raw (ensemble)83.119No---
154BERT with Something (ensemble)83.051No---
155BERT + MMFT + ADA (single model)83.04No---
156Lunet + Verifier + BERT (single model)82.995No---
157BERT + Synthetic Self-Training (single model)82.972No---
158mgrc_l (single model)82.961No---
159ATB (single model)82.882No---
160Tuned BERT Large Cased (single model)82.803No---
161BERT-Base + QA Pre-training (single model)82.724No---
162BERT + NeurQuRI (ensemble)82.713No---
163PAML+BERT (single model)82.577No---
164Unnamed submission by cooelf82.431No---
165AoA + DA + BERT (ensemble)82.374No---
166BART + Adapters + Lohfink-Rossi-Leaveout (single-model)82.306No---
167BERT finetune baseline (single model)82.126No---
168Candi-Net+BERT (ensemble)82.126No---
169BERT-Base PMI-Masking Additional Data (single model)82.024No---
170BERT_s (single model)81.979No---
171Unnamed submission by zw1081.731No---
172BERT-large+UBFT (single model)81.573No---
173AoA + DA + BERT (single model)81.178No---
174BERT with Something (single model)81.11No---
175BERT-Base PMI-Masking (single model)80.896No---
176BERT + UnAnsQ (single model)80.749No---
177BERT + AL (single model)80.715No---
178BERT + NeurQuRI (single model)80.591No---
179BERTlarge (ensemble)80.456No---
180Bert80.422No---
181Bert-raw (single)80.411No---
182Candi-Net+BERT (single model)80.388No---
183PMI-Masking Additional Data Random Baseline (single model)80.377No---
184Unnamed submission by zw480.354No---
185{Bert-Span} (single model)80.354No---
186Bert-raw (single model)80.343No---
187PMI-Masking Pure-PMI (single model)80.241No---
188BISAN-CC (single model)80.208No---
189ST_bl80.14No---
190PwP+BERT (single model)80.117No---
191PMI-Masking Random Baseline (single model)80.038No---
192BERT + UDA (single model)80.005No---
193PMI-Masking Additional Data Pure-PMI (single model)79.993No---
194Original BERT Large Cased (single model)79.971No---
195bert (single model)79.971No---
196BERT + Sparse-Transformer79.948No---
197Insight-baseline (single model)79.779No---
198NEXYS_BASE (single model)79.779No---
199BERT uncased (single model)79.745No---
200{bert-finetuning} (single model)79.632No---
201L6Net + BERT (single model)79.181No---
202Fusion Adapters TriviaQA NQ Singl78.933No---
203RoberTa Fusion Adapters Single78.933No---
204RoberTa+Fusion+Adapters (single model)78.933No---
205{Anonymous} (single model)78.876No---
206BERT + WIAN (ensemble)78.65No---
207BERTlarge (single model)78.65No---
208AMBERT (single model)78.594No---
209BISAN (single model)78.481No---
210BERT-Large-Cased (single model)78.357No---
211BERT-Large-Cased78.357No---
212BERT+AC(single model)78.052No---
213BERT+AC (single model)78.052No---
214BERT (single model)77.319No---
215TriviaQA Adapter Single Tune77.262No---
216RoberTa Adapter Single77.262No---
217RoberTa+Adapter (single model)77.262No---
218SLQA+BERT (single model)77.003No---
219AMBERT-H (single model)76.71No---
220AMBERT-S (single model)76.563No---
221synss (single model )76.055No---
222synss (single model)76.055No---
223BERT-Base-L (single model)75.457No---
224mgrc75.344No---
225BERT-Base-V (single model)75.073No---
226MIR-MRC(F-Net) (single model)74.791No---
227MIR-MRC (F-Net)74.791No---
228BERT-Base-DT (single model)74.769No---
229ARSG-BERT (single model)74.746No---
230BERT-Base-V274.656No---
231BERT-Base-DP (single model)74.577No---
232{BERTcw} (single model)74.385No---
233BERT-Base-Add (single model)74.329No---
234nlnet (single model)74.272No---
235batch2 (single model)73.742No---
236MMIPN73.505No---
237BERT-Base-Baseline (single model)73.302No---
238BERT-Base (single model)73.099No---
239ICL_MODEL(ensemble)72.884No---
240ICL_MODEL (ensemble)72.884No---
241YARCS (ensemble)72.67No---
242BERT-base72.072No---
243BERTBase (single model)72.072No---
244Reinforced Mnemonic Reader + Answer Verifier (single model)71.767NoRead + Verify: Machine Reading Comprehension wit...2018-08-17-
245BERT-Base (single)71.699No---
246BERT+Answer Verifier (single model)71.666No---
247SLQA+ (single model)71.462No---
248Unet (ensemble)71.417NoU-Net: Machine Reading Comprehension with Unansw...2018-10-12Code
249SAN (ensemble model)71.316NoStochastic Answer Networks for Machine Reading C...2017-12-10Code
250HYDRA_BERT (single model)71.293No---
251{BERT-base} (single-model)70.763No---
252FusionNet++ (ensemble)70.3NoFusionNet: Fusing via Fully-Aware Attention with...2017-11-16Code
253Multi-Level Attention Fusion(MLAF) (single model)69.476No---
254Multi-Level Attention Fusion (MLAF)69.476No---
255Unet (single model)69.262No---
256DocQA + NeurQuRI (single model)68.766No---
257SAN (single model)68.653NoStochastic Answer Networks for Machine Reading C...2017-12-10Code
258KACTEIL-MRC(GFN-Net) (single model)68.213No---
259KACTEIL-MRC (GFN-Net)68.213No---
260BiDAF++ with pair2vec (single model)68.021No---
261VS^3-NET (single model)67.897No---
262EBB-Net (single model)66.61No---
263KakaoNet2 (single model)65.719No---
264BiDAF++ (single model)65.651No---
265abcNet (single model)65.256No---
266BiDAF + Self Attention + ELMo (single model)63.372NoDeep contextualized word representations2018-02-15Code
267BiDAF + Self Attention + ELMo (single model)63.372NoDeep contextualized word representations2018-02-15-
268BSAE AddText (single model)63.338No---
269eeAttNet (single model)63.327No---
270BiDAF + Self Attention (single model)59.332No---
271BiDAF-No-Answer (single model)59.174No---
272BNA + SoftDrop (single model)58.508No---
273Tree-LSTM + BiDAF + ELMo (single model)57.707No---
274BNA + HardDrop (single model)56.545No---
275Unnamed submission by Simon56.545No---
276Anonymous (single model)49.695No---
277{FOO} (single model)48.883No---
278Bert Large Sentence (Single Model)48.804No---
279XLNet + DAAF + BERTverifier (ensemble)44.945No---
280TSAN40.397No---
28127.217No---
282CHECK SYSTEM (single model)4.83No---
2835cls_squad1_fai0.068No---