TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Natural Language Processing/Question Answering/SQuAD2.0

Question Answering on SQuAD2.0

Metric: F1 (higher is better)

LeaderboardDataset
Loading chart...

Results

Submit a result
#Model↕F1▼Extra DataPaperDate↕Code
1IE-Net (ensemble)93.214No---
2FPNet (ensemble)93.183No---
3IE-NetV2 (ensemble)93.1No---
4SA-Net on Albert (ensemble)93.011No---
5Retro-Reader (ensemble)92.978NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
6SA-Net-V2 (ensemble)92.948No---
7FPNet (ensemble)92.899No---
8TransNets + SFVerifier + SFEnsembler (ensemble)92.894No---
9ATRLP+PV (ensemble)92.877No---
10EntitySpanFocusV2 (ensemble)92.824No---
11LANetV2 (ensemble)92.807No---
12ELECTRA+ALBERT+EntitySpanFocus (ensemble)92.799No---
13ALBERT + DAAF + Verifier92.777No---
14EntitySpanFocus+AT (ensemble)92.748No---
15electra+nlayers+adv+ds92.691No---
16MixEnsemble (ensemble)92.594No---
17Retro-Reader on ALBERT (ensemble)92.58NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
18Retro-Reader on ALBERT (ensemble)92.58NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
19electra+nlayers (ensemble)92.535No---
20Answer Dependent Classify (single model)92.517No---
21electra+nlayers+kdav (ensemble)92.497No---
22ANet92.457No---
23ALBERT + DAAF + Verifier (ensemble)92.425No---
24LANet (ensemble)92.425No---
25ELECTRA+ATRLP+PV (single model)92.366No---
26Electra-nlayers (ensemble)92.312No---
27Span Extract + Classify (single model)92.226No---
28ALBERT (ensemble model)92.215NoALBERT: A Lite BERT for Self-supervised Learning...2019-09-26Code
29Albert_Verifier_AA_Net (ensemble)92.18No---
30albert+KD+transfer (ensemble)92.134No---
31ROaD-Electra (single model)92.118No---
32ROaD-Electra92.118No---
33albert+transform+verify (ensemble)92.059No---
34Retro-Reader on ELECTRA (single model)92.052NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
35ELECTRA + ROBERTA + ALBERT (ensemble)91.994No---
36ELECTRA + E-Verifier (ensemble)91.985No---
37Albert-nlayers (ensemble)91.964No---
382task (single model)91.939No---
39Deberta91.9No---
40ALBert-LSTM (ensemble)91.853No---
41ELECTRA+RL+EV (single model)91.765No---
42ALBERT+Entailment DA (ensemble)91.745No---
43ALBERT + MTDA + SFVerifier (ensemble model)91.739No---
44ALBERT + SFVerifier (ensemble model)91.666No---
45electra & albert (ensemble)91.635No---
46AE-TEST91.635No---
47ELECTRA+EntitySpanFocus (Single model)91.546No---
48SA-Net on Electra (single model)91.486No---
49Retro-Reader on ALBERT (single model)91.419NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
50Retro-Reader on ALBERT (single model)91.419NoRetrospective Reader for Machine Reading Compreh...2020-01-27Code
51ELECTRA (single model)91.365No---
52ELECTRA_ATT (single model)91.303No---
53Deberta+prefix91.299No---
54ALBERT + IG + NE (single model)91.287No---
55ALBERT (Single model)91.286No---
56ALBERT+Entailment DA Verifier (single model)91.265No---
57ALBERT + IG (single model)91.256No---
58Tuned ALBERT (ensemble model)91.23No---
59albert_with_tricks (single)91.179No---
60albert+KD+transfer (single)91.078No---
61ALBert (single-model)91.036No---
62albert+verifier (single model)91.019No---
63ALBERT 1.1 Th (single model)90.944No---
64SkERT-Large (single model)90.944No---
65{alber_m_transfor} (single model)90.939No---
66aanet_v2.0 (single model)90.918No---
67ALBERT (single model)90.902NoALBERT: A Lite BERT for Self-supervised Learning...2019-09-26Code
68ALBERT (single model)90.902NoALBERT: A Lite BERT for Self-supervised Learning...2019-09-26Code
69{MTL} (single model)90.902No---
70MTL (single model)90.902No---
71albert_xxlarge (single model)90.872No---
72XLNet + DAAF + Verifier (ensemble)90.859No---
73ALBERT + SFVerifier (single model)90.83No---
74ALBERT+RL (single model)90.823No---
75albert+KD+transfer+twopass (single)90.818No---
76UPM (ensemble)90.713No---
77XLNet + SG-Net Verifier (ensemble)90.702NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14Code
78DeBERTalarge90.7NoDeBERTa: Decoding-enhanced BERT with Disentangle...2020-06-05Code
79XLNet (single model)90.689NoXLNet: Generalized Autoregressive Pretraining fo...2019-06-19Code
80XLNet + SG-Net Verifier (ensemble)90.645No---
81ALBERT 1.1 (single model)90.588No---
82Tuned ALBERT (single model)90.532No---
83LUKE 483M90.2NoLUKE: Deep Contextualized Entity Representations...2020-10-02Code
84LUKE (single model)90.163NoLUKE: Deep Contextualized Entity Representations...2020-10-02Code
85LUKE (single model)90.163NoLUKE: Deep Contextualized Entity Representations...2020-10-02Code
86Ensemble ALBERT90.123NoEnsemble ALBERT on SQuAD 2.02021-10-19Code
87XLNet + SG-Net Verifier++ (single model)90.071NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14Code
88RoBERTa+Verify (ensemble)90.037No---
89UPM (single model)89.934No---
90XLNet + SG-Net Verifier (single model)89.899No---
91RoBERTa (single model)89.795NoRoBERTa: A Robustly Optimized BERT Pretraining A...2019-07-26Code
92RoBERTa (single model)89.795NoRoBERTa: A Robustly Optimized BERT Pretraining A...2019-07-26Code
93Enhanced Albert+Verifier3 (ensemble)89.778No---
94Enhanced Albert+Verifier (ensemble)89.634No---
95RoBERTa+Span (ensemble)89.595No---
96RoBERTa+Verify (single model)89.586No---
97BERT + DAE + AoA (ensemble)89.474No---
98BERT + ConvLSTM + MTL + Verifier (ensemble)89.286No---
99XLNET-V2-123+ (single model)89.148No---
100BERT + N-Gram Masking + Synthetic Self-Training (ensemble)89.147No---
101XLNet (single model)89.133No---
102XLNET-123 (single model)89.086No---
103Xlnet+Verifier89.082No---
104Xlnet+Verifier(single model)89.063No---
105Xlnet+Verifier (single model)89.063No---
106RoBERTa+Span (single model)88.989No---
107Unnamed submission by guo88.921No---
108BERTSP(single model)88.921No---
109BERTSP (single model)88.921No---
110BERT++(ensemble)88.886No---
111SemBERT(ensemble)88.886NoSemantics-aware BERT for Language Understanding2019-09-05Code
112SemBERT(ensemble)88.886NoSemantics-aware BERT for Language Understanding2019-09-05Code
113SemBERT (ensemble)88.886NoSemantics-aware BERT for Language Understanding2019-09-05Code
114SG-Net (ensemble)88.848NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14-
115SG-Net (ensemble)88.848NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14Code
116RoBERTa-Large (ensemble model)88.793No---
117SpanBERT (single model)88.709No---
118SpanBERT88.7NoSpanBERT: Improving Pre-training by Representing...2019-07-24Code
119SENSEFORTH + XLNet (single model)88.699No---
120BERT + DAE + AoA (single model)88.621No---
121BNDVnet (ensemble model)88.449No---
122RoBERTa-Large (single model)88.425No---
123SemBERT (ensemble model)88.4No---
124BERT + ConvLSTM + MTL + Verifier (single model)88.204No---
125xlnet88No---
126xlnet(single model)88No---
127xlnet (single model)88No---
128SG-Net (single model)87.926NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14-
129SG-Net (single model)87.926NoSG-Net: Syntax-Guided Machine Reading Comprehens...2019-08-14Code
130BertCNN (single model)87.901No---
131SemBERT (single model)87.864NoSemantics-aware BERT for Language Understanding2019-09-05Code
132SemBERT (single model)87.864NoSemantics-aware BERT for Language Understanding2019-09-05Code
133BNDVnet (single model)87.833No---
134BERT + N-Gram Masking + Synthetic Self-Training (single model)87.715No---
135Insight-baseline-BERT (single model)87.644No---
136BERT++(single model)87.625No---
137BERT + MMFT + ADA (ensemble)87.615No---
138BertSpan (ensemble)87.489No---
139Hanvon_model(single model)87.117No---
140Hanvon_model (single model)87.117No---
141RoberTa Parallel Adapters Singl87.013No---
142RoberTa Parallel Adapters Single87.013No---
143RoberTa+Parallel+Adapters (single model)87.013No---
144BERT + Synthetic Self-Training (ensemble)86.967No---
145BERT + Multiple-CNN (ensemble)(Kyonggi University86.767No---
146BERT + Multiple-CNN (ensemble)86.767No---
147SemNet (single model)86.669No---
148Tuned BERT-1seq Large Cased (single model)86.594No---
149SynNet (single model)86.222No---
150PAML+BERT (ensemble model)86.122No---
151BERT finetune baseline (ensemble)86.096No---
152mgrc_l (single model)86.075No---
153Lunet + Verifier + BERT (ensemble)86.043No---
154Lunet + Verifier + BERT (single model)86.035No---
155ATB (single model)86.002No---
156BERT + MMFT + ADA (single model)85.892No---
157Unnamed submission by Senseforth_AI85.873No---
158SENSEFORTH + BERT85.873No---
159Tuned BERT Large Cased (single model)85.863No---
160BERT + Synthetic Self-Training (single model)85.81No---
161BERT with Something (ensemble)85.737No---
162BART + Adapters + Lohfink-Rossi-Leaveout (single-model)85.67No---
163PAML+BERT (single model)85.603No---
164BERT + NeurQuRI (ensemble)85.584No---
165Bert-raw (ensemble)85.51No---
166BERT-Base + QA Pre-training (single model)85.491No---
167AoA + DA + BERT (ensemble)85.31No---
168Unnamed submission by cooelf85.178No---
169Unnamed submission by zw1084.862No---
170BERT-Base PMI-Masking Additional Data (single model)84.854No---
171BERT_s (single model)84.846No---
172BERT finetune baseline (single model)84.82No---
173Candi-Net+BERT (ensemble)84.624No---
174BERT-large+UBFT (single model)84.535No---
175BERT with Something (single model)84.386No---
176AoA + DA + BERT (single model)84.251No---
177BERT + UnAnsQ (single model)83.851No---
178BERT + AL (single model)83.827No---
179BERT-Base PMI-Masking (single model)83.604No---
180BERTlarge (ensemble)83.509No---
181Bert-raw (single)83.457No---
182BERT + NeurQuRI (single model)83.391No---
183Unnamed submission by zw483.329No---
184{Bert-Span} (single model)83.329No---
185Original BERT Large Cased (single model)83.266No---
186PMI-Masking Additional Data Random Baseline (single model)83.262No---
187Bert-raw (single model)83.243No---
188BERT + UDA (single model)83.208No---
189PwP+BERT (single model)83.189No---
190bert (single model)83.184No---
191PMI-Masking Pure-PMI (single model)83.175No---
192BISAN-CC (single model)83.149No---
193Bert83.118No---
194Insight-baseline (single model)83.099No---
195PMI-Masking Additional Data Pure-PMI (single model)83.039No---
196BERT + Sparse-Transformer83.023No---
197BERT uncased (single model)83.02No---
198ST_bl82.962No---
199NEXYS_BASE (single model)82.912No---
200Candi-Net+BERT (single model)82.908No---
201{bert-finetuning} (single model)82.852No---
202PMI-Masking Random Baseline (single model)82.796No---
203{Anonymous} (single model)82.524No---
204L6Net + BERT (single model)82.259No---
205Fusion Adapters TriviaQA NQ Singl81.863No---
206RoberTa Fusion Adapters Single81.863No---
207RoberTa+Fusion+Adapters (single model)81.863No---
208BISAN (single model)81.531No---
209BERT-Large-Cased (single model)81.5No---
210BERT-Large-Cased81.5No---
211BERT + WIAN (ensemble)81.497No---
212BERTlarge (single model)81.474No---
213AMBERT (single model)81.445No---
214BERT+AC(single model)81.174No---
215BERT+AC (single model)81.174No---
216BERT (single model)80.31No---
217TriviaQA Adapter Single Tune80.258No---
218RoberTa Adapter Single80.258No---
219RoberTa+Adapter (single model)80.258No---
220SLQA+BERT (single model)80.209No---
221AMBERT-S (single model)79.776No---
222AMBERT-H (single model)79.659No---
223synss (single model )79.329No---
224synss (single model)79.329No---
225mgrc78.381No---
226gMLP-large78.3NoPay Attention to MLPs2021-05-17Code
227BERT-Base-L (single model)78.232No---
228ARSG-BERT (single model)78.227No---
229MIR-MRC(F-Net) (single model)77.988No---
230MIR-MRC (F-Net)77.988No---
231BERT-Base-V (single model)77.805No---
232BERT-Base-DT (single model)77.706No---
233BERT-Base-DP (single model)77.464No---
234BERT-Base-V277.404No---
235BERT-Base-Add (single model)77.396No---
236{BERTcw} (single model)77.308No---
237nlnet (single model)77.052No---
238batch2 (single model)76.858No---
239MMIPN76.424No---
240BERT-Base-Baseline (single model)76.284No---
241BERT-Base (single model)76.236No---
242ICL_MODEL(ensemble)76.217No---
243ICL_MODEL (ensemble)76.217No---
244BERT-base75.513No---
245BERTBase (single model)75.513No---
246YARCS (ensemble)75.507No---
247BERT+Answer Verifier (single model)75.457No---
248Unet (ensemble)74.869NoU-Net: Machine Reading Comprehension with Unansw...2018-10-12Code
249HYDRA_BERT (single model)74.578No---
250{BERT-base} (single-model)74.449No---
251SLQA+ (single model)74.434No---
252BERT-Base (single)74.43No---
253Reinforced Mnemonic Reader + Answer Verifier (single model)74.295NoRead + Verify: Machine Reading Comprehension wit...2018-08-17-
254SAN (ensemble model)73.704NoStochastic Answer Networks for Machine Reading C...2017-12-10Code
255Multi-Level Attention Fusion(MLAF) (single model)72.857No---
256Multi-Level Attention Fusion (MLAF)72.857No---
257Unet (single model)72.642No---
258FusionNet++ (ensemble)72.484NoFusionNet: Fusing via Fully-Aware Attention with...2017-11-16Code
259DocQA + NeurQuRI (single model)71.662No---
260BiDAF++ with pair2vec (single model)71.583No---
261SAN (single model)71.439NoStochastic Answer Networks for Machine Reading C...2017-12-10Code
262VS^3-NET (single model)70.884No---
263KACTEIL-MRC(GFN-Net) (single model)70.878No---
264KACTEIL-MRC (GFN-Net)70.878No---
265EBB-Net (single model)70.303No---
266KakaoNet2 (single model)69.381No---
267abcNet (single model)69.206No---
268BiDAF++ (single model)68.866No---
269BSAE AddText (single model)67.422No---
270eeAttNet (single model)66.633No---
271BiDAF + Self Attention + ELMo (single model)66.251NoDeep contextualized word representations2018-02-15Code
272BiDAF + Self Attention + ELMo (single model)66.251NoDeep contextualized word representations2018-02-15-
273Tree-LSTM + BiDAF + ELMo (single model)62.341No---
274BiDAF + Self Attention (single model)62.305No---
275BiDAF-No-Answer (single model)62.093No---
276BNA + SoftDrop (single model)62.045No---
277BNA + HardDrop (single model)59.546No---
278Unnamed submission by Simon59.546No---
279Anonymous (single model)49.701No---
280{FOO} (single model)48.883No---
281Bert Large Sentence (Single Model)48.815No---
282XLNet + DAAF + BERTverifier (ensemble)47.994No---
283TSAN43.213No---
28429.597No---
285CHECK SYSTEM (single model)5.92No---
2865cls_squad1_fai3.971No---