Question Answering on SQuAD2.0

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	IE-Net (ensemble)	93.214	No	-	-	-
2	FPNet (ensemble)	93.183	No	-	-	-
3	IE-NetV2 (ensemble)	93.1	No	-	-	-
4	SA-Net on Albert (ensemble)	93.011	No	-	-	-
5	Retro-Reader (ensemble)	92.978	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
6	SA-Net-V2 (ensemble)	92.948	No	-	-	-
7	FPNet (ensemble)	92.899	No	-	-	-
8	TransNets + SFVerifier + SFEnsembler (ensemble)	92.894	No	-	-	-
9	ATRLP+PV (ensemble)	92.877	No	-	-	-
10	EntitySpanFocusV2 (ensemble)	92.824	No	-	-	-
11	LANetV2 (ensemble)	92.807	No	-	-	-
12	ELECTRA+ALBERT+EntitySpanFocus (ensemble)	92.799	No	-	-	-
13	ALBERT + DAAF + Verifier	92.777	No	-	-	-
14	EntitySpanFocus+AT (ensemble)	92.748	No	-	-	-
15	electra+nlayers+adv+ds	92.691	No	-	-	-
16	MixEnsemble (ensemble)	92.594	No	-	-	-
17	Retro-Reader on ALBERT (ensemble)	92.58	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
18	Retro-Reader on ALBERT (ensemble)	92.58	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
19	electra+nlayers (ensemble)	92.535	No	-	-	-
20	Answer Dependent Classify (single model)	92.517	No	-	-	-
21	electra+nlayers+kdav (ensemble)	92.497	No	-	-	-
22	ANet	92.457	No	-	-	-
23	ALBERT + DAAF + Verifier (ensemble)	92.425	No	-	-	-
24	LANet (ensemble)	92.425	No	-	-	-
25	ELECTRA+ATRLP+PV (single model)	92.366	No	-	-	-
26	Electra-nlayers (ensemble)	92.312	No	-	-	-
27	Span Extract + Classify (single model)	92.226	No	-	-	-
28	ALBERT (ensemble model)	92.215	No	ALBERT: A Lite BERT for Self-supervised Learning...	2019-09-26	Code
29	Albert_Verifier_AA_Net (ensemble)	92.18	No	-	-	-
30	albert+KD+transfer (ensemble)	92.134	No	-	-	-
31	ROaD-Electra (single model)	92.118	No	-	-	-
32	ROaD-Electra	92.118	No	-	-	-
33	albert+transform+verify (ensemble)	92.059	No	-	-	-
34	Retro-Reader on ELECTRA (single model)	92.052	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
35	ELECTRA + ROBERTA + ALBERT (ensemble)	91.994	No	-	-	-
36	ELECTRA + E-Verifier (ensemble)	91.985	No	-	-	-
37	Albert-nlayers (ensemble)	91.964	No	-	-	-
38	2task (single model)	91.939	No	-	-	-
39	Deberta	91.9	No	-	-	-
40	ALBert-LSTM (ensemble)	91.853	No	-	-	-
41	ELECTRA+RL+EV (single model)	91.765	No	-	-	-
42	ALBERT+Entailment DA (ensemble)	91.745	No	-	-	-
43	ALBERT + MTDA + SFVerifier (ensemble model)	91.739	No	-	-	-
44	ALBERT + SFVerifier (ensemble model)	91.666	No	-	-	-
45	electra & albert (ensemble)	91.635	No	-	-	-
46	AE-TEST	91.635	No	-	-	-
47	ELECTRA+EntitySpanFocus (Single model)	91.546	No	-	-	-
48	SA-Net on Electra (single model)	91.486	No	-	-	-
49	Retro-Reader on ALBERT (single model)	91.419	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
50	Retro-Reader on ALBERT (single model)	91.419	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
51	ELECTRA (single model)	91.365	No	-	-	-
52	ELECTRA_ATT (single model)	91.303	No	-	-	-
53	Deberta+prefix	91.299	No	-	-	-
54	ALBERT + IG + NE (single model)	91.287	No	-	-	-
55	ALBERT (Single model)	91.286	No	-	-	-
56	ALBERT+Entailment DA Verifier (single model)	91.265	No	-	-	-
57	ALBERT + IG (single model)	91.256	No	-	-	-
58	Tuned ALBERT (ensemble model)	91.23	No	-	-	-
59	albert_with_tricks (single)	91.179	No	-	-	-
60	albert+KD+transfer (single)	91.078	No	-	-	-
61	ALBert (single-model)	91.036	No	-	-	-
62	albert+verifier (single model)	91.019	No	-	-	-
63	ALBERT 1.1 Th (single model)	90.944	No	-	-	-
64	SkERT-Large (single model)	90.944	No	-	-	-
65	{alber_m_transfor} (single model)	90.939	No	-	-	-
66	aanet_v2.0 (single model)	90.918	No	-	-	-
67	ALBERT (single model)	90.902	No	ALBERT: A Lite BERT for Self-supervised Learning...	2019-09-26	Code
68	ALBERT (single model)	90.902	No	ALBERT: A Lite BERT for Self-supervised Learning...	2019-09-26	Code
69	{MTL} (single model)	90.902	No	-	-	-
70	MTL (single model)	90.902	No	-	-	-
71	albert_xxlarge (single model)	90.872	No	-	-	-
72	XLNet + DAAF + Verifier (ensemble)	90.859	No	-	-	-
73	ALBERT + SFVerifier (single model)	90.83	No	-	-	-
74	ALBERT+RL (single model)	90.823	No	-	-	-
75	albert+KD+transfer+twopass (single)	90.818	No	-	-	-
76	UPM (ensemble)	90.713	No	-	-	-
77	XLNet + SG-Net Verifier (ensemble)	90.702	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	Code
78	DeBERTalarge	90.7	No	DeBERTa: Decoding-enhanced BERT with Disentangle...	2020-06-05	Code
79	XLNet (single model)	90.689	No	XLNet: Generalized Autoregressive Pretraining fo...	2019-06-19	Code
80	XLNet + SG-Net Verifier (ensemble)	90.645	No	-	-	-
81	ALBERT 1.1 (single model)	90.588	No	-	-	-
82	Tuned ALBERT (single model)	90.532	No	-	-	-
83	LUKE 483M	90.2	No	LUKE: Deep Contextualized Entity Representations...	2020-10-02	Code
84	LUKE (single model)	90.163	No	LUKE: Deep Contextualized Entity Representations...	2020-10-02	Code
85	LUKE (single model)	90.163	No	LUKE: Deep Contextualized Entity Representations...	2020-10-02	Code
86	Ensemble ALBERT	90.123	No	Ensemble ALBERT on SQuAD 2.0	2021-10-19	Code
87	XLNet + SG-Net Verifier++ (single model)	90.071	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	Code
88	RoBERTa+Verify (ensemble)	90.037	No	-	-	-
89	UPM (single model)	89.934	No	-	-	-
90	XLNet + SG-Net Verifier (single model)	89.899	No	-	-	-
91	RoBERTa (single model)	89.795	No	RoBERTa: A Robustly Optimized BERT Pretraining A...	2019-07-26	Code
92	RoBERTa (single model)	89.795	No	RoBERTa: A Robustly Optimized BERT Pretraining A...	2019-07-26	Code
93	Enhanced Albert+Verifier3 (ensemble)	89.778	No	-	-	-
94	Enhanced Albert+Verifier (ensemble)	89.634	No	-	-	-
95	RoBERTa+Span (ensemble)	89.595	No	-	-	-
96	RoBERTa+Verify (single model)	89.586	No	-	-	-
97	BERT + DAE + AoA (ensemble)	89.474	No	-	-	-
98	BERT + ConvLSTM + MTL + Verifier (ensemble)	89.286	No	-	-	-
99	XLNET-V2-123+ (single model)	89.148	No	-	-	-
100	BERT + N-Gram Masking + Synthetic Self-Training (ensemble)	89.147	No	-	-	-
101	XLNet (single model)	89.133	No	-	-	-
102	XLNET-123 (single model)	89.086	No	-	-	-
103	Xlnet+Verifier	89.082	No	-	-	-
104	Xlnet+Verifier(single model)	89.063	No	-	-	-
105	Xlnet+Verifier (single model)	89.063	No	-	-	-
106	RoBERTa+Span (single model)	88.989	No	-	-	-
107	Unnamed submission by guo	88.921	No	-	-	-
108	BERTSP(single model)	88.921	No	-	-	-
109	BERTSP (single model)	88.921	No	-	-	-
110	BERT++(ensemble)	88.886	No	-	-	-
111	SemBERT(ensemble)	88.886	No	Semantics-aware BERT for Language Understanding	2019-09-05	Code
112	SemBERT(ensemble)	88.886	No	Semantics-aware BERT for Language Understanding	2019-09-05	Code
113	SemBERT (ensemble)	88.886	No	Semantics-aware BERT for Language Understanding	2019-09-05	Code
114	SG-Net (ensemble)	88.848	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	-
115	SG-Net (ensemble)	88.848	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	Code
116	RoBERTa-Large (ensemble model)	88.793	No	-	-	-
117	SpanBERT (single model)	88.709	No	-	-	-
118	SpanBERT	88.7	No	SpanBERT: Improving Pre-training by Representing...	2019-07-24	Code
119	SENSEFORTH + XLNet (single model)	88.699	No	-	-	-
120	BERT + DAE + AoA (single model)	88.621	No	-	-	-
121	BNDVnet (ensemble model)	88.449	No	-	-	-
122	RoBERTa-Large (single model)	88.425	No	-	-	-
123	SemBERT (ensemble model)	88.4	No	-	-	-
124	BERT + ConvLSTM + MTL + Verifier (single model)	88.204	No	-	-	-
125	xlnet	88	No	-	-	-
126	xlnet(single model)	88	No	-	-	-
127	xlnet (single model)	88	No	-	-	-
128	SG-Net (single model)	87.926	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	-
129	SG-Net (single model)	87.926	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	Code
130	BertCNN (single model)	87.901	No	-	-	-
131	SemBERT (single model)	87.864	No	Semantics-aware BERT for Language Understanding	2019-09-05	Code
132	SemBERT (single model)	87.864	No	Semantics-aware BERT for Language Understanding	2019-09-05	Code
133	BNDVnet (single model)	87.833	No	-	-	-
134	BERT + N-Gram Masking + Synthetic Self-Training (single model)	87.715	No	-	-	-
135	Insight-baseline-BERT (single model)	87.644	No	-	-	-
136	BERT++(single model)	87.625	No	-	-	-
137	BERT + MMFT + ADA (ensemble)	87.615	No	-	-	-
138	BertSpan (ensemble)	87.489	No	-	-	-
139	Hanvon_model(single model)	87.117	No	-	-	-
140	Hanvon_model (single model)	87.117	No	-	-	-
141	RoberTa Parallel Adapters Singl	87.013	No	-	-	-
142	RoberTa Parallel Adapters Single	87.013	No	-	-	-
143	RoberTa+Parallel+Adapters (single model)	87.013	No	-	-	-
144	BERT + Synthetic Self-Training (ensemble)	86.967	No	-	-	-
145	BERT + Multiple-CNN (ensemble)(Kyonggi University	86.767	No	-	-	-
146	BERT + Multiple-CNN (ensemble)	86.767	No	-	-	-
147	SemNet (single model)	86.669	No	-	-	-
148	Tuned BERT-1seq Large Cased (single model)	86.594	No	-	-	-
149	SynNet (single model)	86.222	No	-	-	-
150	PAML+BERT (ensemble model)	86.122	No	-	-	-
151	BERT finetune baseline (ensemble)	86.096	No	-	-	-
152	mgrc_l (single model)	86.075	No	-	-	-
153	Lunet + Verifier + BERT (ensemble)	86.043	No	-	-	-
154	Lunet + Verifier + BERT (single model)	86.035	No	-	-	-
155	ATB (single model)	86.002	No	-	-	-
156	BERT + MMFT + ADA (single model)	85.892	No	-	-	-
157	Unnamed submission by Senseforth_AI	85.873	No	-	-	-
158	SENSEFORTH + BERT	85.873	No	-	-	-
159	Tuned BERT Large Cased (single model)	85.863	No	-	-	-
160	BERT + Synthetic Self-Training (single model)	85.81	No	-	-	-
161	BERT with Something (ensemble)	85.737	No	-	-	-
162	BART + Adapters + Lohfink-Rossi-Leaveout (single-model)	85.67	No	-	-	-
163	PAML+BERT (single model)	85.603	No	-	-	-
164	BERT + NeurQuRI (ensemble)	85.584	No	-	-	-
165	Bert-raw (ensemble)	85.51	No	-	-	-
166	BERT-Base + QA Pre-training (single model)	85.491	No	-	-	-
167	AoA + DA + BERT (ensemble)	85.31	No	-	-	-
168	Unnamed submission by cooelf	85.178	No	-	-	-
169	Unnamed submission by zw10	84.862	No	-	-	-
170	BERT-Base PMI-Masking Additional Data (single model)	84.854	No	-	-	-
171	BERT_s (single model)	84.846	No	-	-	-
172	BERT finetune baseline (single model)	84.82	No	-	-	-
173	Candi-Net+BERT (ensemble)	84.624	No	-	-	-
174	BERT-large+UBFT (single model)	84.535	No	-	-	-
175	BERT with Something (single model)	84.386	No	-	-	-
176	AoA + DA + BERT (single model)	84.251	No	-	-	-
177	BERT + UnAnsQ (single model)	83.851	No	-	-	-
178	BERT + AL (single model)	83.827	No	-	-	-
179	BERT-Base PMI-Masking (single model)	83.604	No	-	-	-
180	BERTlarge (ensemble)	83.509	No	-	-	-
181	Bert-raw (single)	83.457	No	-	-	-
182	BERT + NeurQuRI (single model)	83.391	No	-	-	-
183	Unnamed submission by zw4	83.329	No	-	-	-
184	{Bert-Span} (single model)	83.329	No	-	-	-
185	Original BERT Large Cased (single model)	83.266	No	-	-	-
186	PMI-Masking Additional Data Random Baseline (single model)	83.262	No	-	-	-
187	Bert-raw (single model)	83.243	No	-	-	-
188	BERT + UDA (single model)	83.208	No	-	-	-
189	PwP+BERT (single model)	83.189	No	-	-	-
190	bert (single model)	83.184	No	-	-	-
191	PMI-Masking Pure-PMI (single model)	83.175	No	-	-	-
192	BISAN-CC (single model)	83.149	No	-	-	-
193	Bert	83.118	No	-	-	-
194	Insight-baseline (single model)	83.099	No	-	-	-
195	PMI-Masking Additional Data Pure-PMI (single model)	83.039	No	-	-	-
196	BERT + Sparse-Transformer	83.023	No	-	-	-
197	BERT uncased (single model)	83.02	No	-	-	-
198	ST_bl	82.962	No	-	-	-
199	NEXYS_BASE (single model)	82.912	No	-	-	-
200	Candi-Net+BERT (single model)	82.908	No	-	-	-
201	{bert-finetuning} (single model)	82.852	No	-	-	-
202	PMI-Masking Random Baseline (single model)	82.796	No	-	-	-
203	{Anonymous} (single model)	82.524	No	-	-	-
204	L6Net + BERT (single model)	82.259	No	-	-	-
205	Fusion Adapters TriviaQA NQ Singl	81.863	No	-	-	-
206	RoberTa Fusion Adapters Single	81.863	No	-	-	-
207	RoberTa+Fusion+Adapters (single model)	81.863	No	-	-	-
208	BISAN (single model)	81.531	No	-	-	-
209	BERT-Large-Cased (single model)	81.5	No	-	-	-
210	BERT-Large-Cased	81.5	No	-	-	-
211	BERT + WIAN (ensemble)	81.497	No	-	-	-
212	BERTlarge (single model)	81.474	No	-	-	-
213	AMBERT (single model)	81.445	No	-	-	-
214	BERT+AC(single model)	81.174	No	-	-	-
215	BERT+AC (single model)	81.174	No	-	-	-
216	BERT (single model)	80.31	No	-	-	-
217	TriviaQA Adapter Single Tune	80.258	No	-	-	-
218	RoberTa Adapter Single	80.258	No	-	-	-
219	RoberTa+Adapter (single model)	80.258	No	-	-	-
220	SLQA+BERT (single model)	80.209	No	-	-	-
221	AMBERT-S (single model)	79.776	No	-	-	-
222	AMBERT-H (single model)	79.659	No	-	-	-
223	synss (single model )	79.329	No	-	-	-
224	synss (single model)	79.329	No	-	-	-
225	mgrc	78.381	No	-	-	-
226	gMLP-large	78.3	No	Pay Attention to MLPs	2021-05-17	Code
227	BERT-Base-L (single model)	78.232	No	-	-	-
228	ARSG-BERT (single model)	78.227	No	-	-	-
229	MIR-MRC(F-Net) (single model)	77.988	No	-	-	-
230	MIR-MRC (F-Net)	77.988	No	-	-	-
231	BERT-Base-V (single model)	77.805	No	-	-	-
232	BERT-Base-DT (single model)	77.706	No	-	-	-
233	BERT-Base-DP (single model)	77.464	No	-	-	-
234	BERT-Base-V2	77.404	No	-	-	-
235	BERT-Base-Add (single model)	77.396	No	-	-	-
236	{BERTcw} (single model)	77.308	No	-	-	-
237	nlnet (single model)	77.052	No	-	-	-
238	batch2 (single model)	76.858	No	-	-	-
239	MMIPN	76.424	No	-	-	-
240	BERT-Base-Baseline (single model)	76.284	No	-	-	-
241	BERT-Base (single model)	76.236	No	-	-	-
242	ICL_MODEL(ensemble)	76.217	No	-	-	-
243	ICL_MODEL (ensemble)	76.217	No	-	-	-
244	BERT-base	75.513	No	-	-	-
245	BERTBase (single model)	75.513	No	-	-	-
246	YARCS (ensemble)	75.507	No	-	-	-
247	BERT+Answer Verifier (single model)	75.457	No	-	-	-
248	Unet (ensemble)	74.869	No	U-Net: Machine Reading Comprehension with Unansw...	2018-10-12	Code
249	HYDRA_BERT (single model)	74.578	No	-	-	-
250	{BERT-base} (single-model)	74.449	No	-	-	-
251	SLQA+ (single model)	74.434	No	-	-	-
252	BERT-Base (single)	74.43	No	-	-	-
253	Reinforced Mnemonic Reader + Answer Verifier (single model)	74.295	No	Read + Verify: Machine Reading Comprehension wit...	2018-08-17	-
254	SAN (ensemble model)	73.704	No	Stochastic Answer Networks for Machine Reading C...	2017-12-10	Code
255	Multi-Level Attention Fusion(MLAF) (single model)	72.857	No	-	-	-
256	Multi-Level Attention Fusion (MLAF)	72.857	No	-	-	-
257	Unet (single model)	72.642	No	-	-	-
258	FusionNet++ (ensemble)	72.484	No	FusionNet: Fusing via Fully-Aware Attention with...	2017-11-16	Code
259	DocQA + NeurQuRI (single model)	71.662	No	-	-	-
260	BiDAF++ with pair2vec (single model)	71.583	No	-	-	-
261	SAN (single model)	71.439	No	Stochastic Answer Networks for Machine Reading C...	2017-12-10	Code
262	VS^3-NET (single model)	70.884	No	-	-	-
263	KACTEIL-MRC(GFN-Net) (single model)	70.878	No	-	-	-
264	KACTEIL-MRC (GFN-Net)	70.878	No	-	-	-
265	EBB-Net (single model)	70.303	No	-	-	-
266	KakaoNet2 (single model)	69.381	No	-	-	-
267	abcNet (single model)	69.206	No	-	-	-
268	BiDAF++ (single model)	68.866	No	-	-	-
269	BSAE AddText (single model)	67.422	No	-	-	-
270	eeAttNet (single model)	66.633	No	-	-	-
271	BiDAF + Self Attention + ELMo (single model)	66.251	No	Deep contextualized word representations	2018-02-15	Code
272	BiDAF + Self Attention + ELMo (single model)	66.251	No	Deep contextualized word representations	2018-02-15	-
273	Tree-LSTM + BiDAF + ELMo (single model)	62.341	No	-	-	-
274	BiDAF + Self Attention (single model)	62.305	No	-	-	-
275	BiDAF-No-Answer (single model)	62.093	No	-	-	-
276	BNA + SoftDrop (single model)	62.045	No	-	-	-
277	BNA + HardDrop (single model)	59.546	No	-	-	-
278	Unnamed submission by Simon	59.546	No	-	-	-
279	Anonymous (single model)	49.701	No	-	-	-
280	{FOO} (single model)	48.883	No	-	-	-
281	Bert Large Sentence (Single Model)	48.815	No	-	-	-
282	XLNet + DAAF + BERTverifier (ensemble)	47.994	No	-	-	-
283	TSAN	43.213	No	-	-	-
284		29.597	No	-	-	-
285	CHECK SYSTEM (single model)	5.92	No	-	-	-
286	5cls_squad1_fai	3.971	No	-	-	-

#1IE-Net (ensemble)
93.214
F1
No paper
#2FPNet (ensemble)
93.183
F1
No paper
#3IE-NetV2 (ensemble)
93.1
F1
No paper
#4SA-Net on Albert (ensemble)
93.011
F1
No paper
#5Retro-Reader (ensemble)SOTA
92.978
F1· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#6SA-Net-V2 (ensemble)
92.948
F1
No paper
#7FPNet (ensemble)
92.899
F1
No paper
#8TransNets + SFVerifier + SFEnsembler (ensemble)
92.894
F1
No paper
#9ATRLP+PV (ensemble)
92.877
F1
No paper
#10EntitySpanFocusV2 (ensemble)
92.824
F1
No paper
#11LANetV2 (ensemble)
92.807
F1
No paper
#12ELECTRA+ALBERT+EntitySpanFocus (ensemble)
92.799
F1
No paper
#13ALBERT + DAAF + Verifier
92.777
F1
No paper
#14EntitySpanFocus+AT (ensemble)
92.748
F1
No paper
#15electra+nlayers+adv+ds
92.691
F1
No paper
#16MixEnsemble (ensemble)
92.594
F1
No paper
#17Retro-Reader on ALBERT (ensemble)
92.58
F1· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#18Retro-Reader on ALBERT (ensemble)
92.58
F1· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#19electra+nlayers (ensemble)
92.535
F1
No paper
#20Answer Dependent Classify (single model)
92.517
F1
No paper
#21electra+nlayers+kdav (ensemble)
92.497
F1
No paper
#22ANet
92.457
F1
No paper
#23ALBERT + DAAF + Verifier (ensemble)
92.425
F1
No paper
#24LANet (ensemble)
92.425
F1
No paper
#25ELECTRA+ATRLP+PV (single model)
92.366
F1
No paper
#26Electra-nlayers (ensemble)
92.312
F1
No paper
#27Span Extract + Classify (single model)
92.226
F1
No paper
#28ALBERT (ensemble model)SOTA
92.215
F1· 2019-09-26
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Code
#29Albert_Verifier_AA_Net (ensemble)
92.18
F1
No paper
#30albert+KD+transfer (ensemble)
92.134
F1
No paper
#31ROaD-Electra (single model)
92.118
F1
No paper
#32ROaD-Electra
92.118
F1
No paper
#33albert+transform+verify (ensemble)
92.059
F1
No paper
#34Retro-Reader on ELECTRA (single model)
92.052
F1· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#35ELECTRA + ROBERTA + ALBERT (ensemble)
91.994
F1
No paper
#36ELECTRA + E-Verifier (ensemble)
91.985
F1
No paper
#37Albert-nlayers (ensemble)
91.964
F1
No paper
#382task (single model)
91.939
F1
No paper
#39Deberta
91.9
F1
No paper
#40ALBert-LSTM (ensemble)
91.853
F1
No paper
#41ELECTRA+RL+EV (single model)
91.765
F1
No paper
#42ALBERT+Entailment DA (ensemble)
91.745
F1
No paper
#43ALBERT + MTDA + SFVerifier (ensemble model)
91.739
F1
No paper
#44ALBERT + SFVerifier (ensemble model)
91.666
F1
No paper
#45electra & albert (ensemble)
91.635
F1
No paper
#46AE-TEST
91.635
F1
No paper
#47ELECTRA+EntitySpanFocus (Single model)
91.546
F1
No paper
#48SA-Net on Electra (single model)
91.486
F1
No paper
#49Retro-Reader on ALBERT (single model)
91.419
F1· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#50Retro-Reader on ALBERT (single model)
91.419
F1· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#51ELECTRA (single model)
91.365
F1
No paper
#52ELECTRA_ATT (single model)
91.303
F1
No paper
#53Deberta+prefix
91.299
F1
No paper
#54ALBERT + IG + NE (single model)
91.287
F1
No paper
#55ALBERT (Single model)
91.286
F1
No paper
#56ALBERT+Entailment DA Verifier (single model)
91.265
F1
No paper
#57ALBERT + IG (single model)
91.256
F1
No paper
#58Tuned ALBERT (ensemble model)
91.23
F1
No paper
#59albert_with_tricks (single)
91.179
F1
No paper
#60albert+KD+transfer (single)
91.078
F1
No paper
#61ALBert (single-model)
91.036
F1
No paper
#62albert+verifier (single model)
91.019
F1
No paper
#63ALBERT 1.1 Th (single model)
90.944
F1
No paper
#64SkERT-Large (single model)
90.944
F1
No paper
#65{alber_m_transfor} (single model)
90.939
F1
No paper
#66aanet_v2.0 (single model)
90.918
F1
No paper
#67ALBERT (single model)
90.902
F1· 2019-09-26
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Code
#68ALBERT (single model)
90.902
F1· 2019-09-26
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Code
#69{MTL} (single model)
90.902
F1
No paper
#70MTL (single model)
90.902
F1
No paper
#71albert_xxlarge (single model)
90.872
F1
No paper
#72XLNet + DAAF + Verifier (ensemble)
90.859
F1
No paper
#73ALBERT + SFVerifier (single model)
90.83
F1
No paper
#74ALBERT+RL (single model)
90.823
F1
No paper
#75albert+KD+transfer+twopass (single)
90.818
F1
No paper
#76UPM (ensemble)
90.713
F1
No paper
#77XLNet + SG-Net Verifier (ensemble)SOTA
90.702
F1· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension Code
#78DeBERTalarge
90.7
F1· 2020-06-05
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Code
#79XLNet (single model)SOTA
90.689
F1· 2019-06-19
XLNet: Generalized Autoregressive Pretraining for Language Understanding Code
#80XLNet + SG-Net Verifier (ensemble)
90.645
F1
No paper
#81ALBERT 1.1 (single model)
90.588
F1
No paper
#82Tuned ALBERT (single model)
90.532
F1
No paper
#83LUKE 483M
90.2
F1· 2020-10-02
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Code
#84LUKE (single model)
90.163
F1· 2020-10-02
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Code
#85LUKE (single model)
90.163
F1· 2020-10-02
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Code
#86Ensemble ALBERT
90.123
F1· 2021-10-19
Ensemble ALBERT on SQuAD 2.0 Code
#87XLNet + SG-Net Verifier++ (single model)
90.071
F1· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension Code
#88RoBERTa+Verify (ensemble)
90.037
F1
No paper
#89UPM (single model)
89.934
F1
No paper
#90XLNet + SG-Net Verifier (single model)
89.899
F1
No paper
#91RoBERTa (single model)
89.795
F1· 2019-07-26
RoBERTa: A Robustly Optimized BERT Pretraining Approach Code
#92RoBERTa (single model)
89.795
F1· 2019-07-26
RoBERTa: A Robustly Optimized BERT Pretraining Approach Code
#93Enhanced Albert+Verifier3 (ensemble)
89.778
F1
No paper
#94Enhanced Albert+Verifier (ensemble)
89.634
F1
No paper
#95RoBERTa+Span (ensemble)
89.595
F1
No paper
#96RoBERTa+Verify (single model)
89.586
F1
No paper
#97BERT + DAE + AoA (ensemble)
89.474
F1
No paper
#98BERT + ConvLSTM + MTL + Verifier (ensemble)
89.286
F1
No paper
#99XLNET-V2-123+ (single model)
89.148
F1
No paper
#100BERT + N-Gram Masking + Synthetic Self-Training (ensemble)
89.147
F1
No paper
#101XLNet (single model)
89.133
F1
No paper
#102XLNET-123 (single model)
89.086
F1
No paper
#103Xlnet+Verifier
89.082
F1
No paper
#104Xlnet+Verifier(single model)
89.063
F1
No paper
#105Xlnet+Verifier (single model)
89.063
F1
No paper
#106RoBERTa+Span (single model)
88.989
F1
No paper
#107Unnamed submission by guo
88.921
F1
No paper
#108BERTSP(single model)
88.921
F1
No paper
#109BERTSP (single model)
88.921
F1
No paper
#110BERT++(ensemble)
88.886
F1
No paper
#111SemBERT(ensemble)
88.886
F1· 2019-09-05
Semantics-aware BERT for Language Understanding Code
#112SemBERT(ensemble)
88.886
F1· 2019-09-05
Semantics-aware BERT for Language Understanding Code
#113SemBERT (ensemble)
88.886
F1· 2019-09-05
Semantics-aware BERT for Language Understanding Code
#114SG-Net (ensemble)
88.848
F1· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension
#115SG-Net (ensemble)
88.848
F1· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension Code
#116RoBERTa-Large (ensemble model)
88.793
F1
No paper
#117SpanBERT (single model)
88.709
F1
No paper
#118SpanBERT
88.7
F1· 2019-07-24
SpanBERT: Improving Pre-training by Representing and Predicting Spans Code
#119SENSEFORTH + XLNet (single model)
88.699
F1
No paper
#120BERT + DAE + AoA (single model)
88.621
F1
No paper
#121BNDVnet (ensemble model)
88.449
F1
No paper
#122RoBERTa-Large (single model)
88.425
F1
No paper
#123SemBERT (ensemble model)
88.4
F1
No paper
#124BERT + ConvLSTM + MTL + Verifier (single model)
88.204
F1
No paper
#125xlnet
88
F1
No paper
#126xlnet(single model)
88
F1
No paper
#127xlnet (single model)
88
F1
No paper
#128SG-Net (single model)
87.926
F1· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension
#129SG-Net (single model)
87.926
F1· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension Code
#130BertCNN (single model)
87.901
F1
No paper
#131SemBERT (single model)
87.864
F1· 2019-09-05
Semantics-aware BERT for Language Understanding Code
#132SemBERT (single model)
87.864
F1· 2019-09-05
Semantics-aware BERT for Language Understanding Code
#133BNDVnet (single model)
87.833
F1
No paper
#134BERT + N-Gram Masking + Synthetic Self-Training (single model)
87.715
F1
No paper
#135Insight-baseline-BERT (single model)
87.644
F1
No paper
#136BERT++(single model)
87.625
F1
No paper
#137BERT + MMFT + ADA (ensemble)
87.615
F1
No paper
#138BertSpan (ensemble)
87.489
F1
No paper
#139Hanvon_model(single model)
87.117
F1
No paper
#140Hanvon_model (single model)
87.117
F1
No paper
#141RoberTa Parallel Adapters Singl
87.013
F1
No paper
#142RoberTa Parallel Adapters Single
87.013
F1
No paper
#143RoberTa+Parallel+Adapters (single model)
87.013
F1
No paper
#144BERT + Synthetic Self-Training (ensemble)
86.967
F1
No paper
#145BERT + Multiple-CNN (ensemble)(Kyonggi University
86.767
F1
No paper
#146BERT + Multiple-CNN (ensemble)
86.767
F1
No paper
#147SemNet (single model)
86.669
F1
No paper
#148Tuned BERT-1seq Large Cased (single model)
86.594
F1
No paper
#149SynNet (single model)
86.222
F1
No paper
#150PAML+BERT (ensemble model)
86.122
F1
No paper
#151BERT finetune baseline (ensemble)
86.096
F1
No paper
#152mgrc_l (single model)
86.075
F1
No paper
#153Lunet + Verifier + BERT (ensemble)
86.043
F1
No paper
#154Lunet + Verifier + BERT (single model)
86.035
F1
No paper
#155ATB (single model)
86.002
F1
No paper
#156BERT + MMFT + ADA (single model)
85.892
F1
No paper
#157Unnamed submission by Senseforth_AI
85.873
F1
No paper
#158SENSEFORTH + BERT
85.873
F1
No paper
#159Tuned BERT Large Cased (single model)
85.863
F1
No paper
#160BERT + Synthetic Self-Training (single model)
85.81
F1
No paper
#161BERT with Something (ensemble)
85.737
F1
No paper
#162BART + Adapters + Lohfink-Rossi-Leaveout (single-model)
85.67
F1
No paper
#163PAML+BERT (single model)
85.603
F1
No paper
#164BERT + NeurQuRI (ensemble)
85.584
F1
No paper
#165Bert-raw (ensemble)
85.51
F1
No paper
#166BERT-Base + QA Pre-training (single model)
85.491
F1
No paper
#167AoA + DA + BERT (ensemble)
85.31
F1
No paper
#168Unnamed submission by cooelf
85.178
F1
No paper
#169Unnamed submission by zw10
84.862
F1
No paper
#170BERT-Base PMI-Masking Additional Data (single model)
84.854
F1
No paper
#171BERT_s (single model)
84.846
F1
No paper
#172BERT finetune baseline (single model)
84.82
F1
No paper
#173Candi-Net+BERT (ensemble)
84.624
F1
No paper
#174BERT-large+UBFT (single model)
84.535
F1
No paper
#175BERT with Something (single model)
84.386
F1
No paper
#176AoA + DA + BERT (single model)
84.251
F1
No paper
#177BERT + UnAnsQ (single model)
83.851
F1
No paper
#178BERT + AL (single model)
83.827
F1
No paper
#179BERT-Base PMI-Masking (single model)
83.604
F1
No paper
#180BERTlarge (ensemble)
83.509
F1
No paper
#181Bert-raw (single)
83.457
F1
No paper
#182BERT + NeurQuRI (single model)
83.391
F1
No paper
#183Unnamed submission by zw4
83.329
F1
No paper
#184{Bert-Span} (single model)
83.329
F1
No paper
#185Original BERT Large Cased (single model)
83.266
F1
No paper
#186PMI-Masking Additional Data Random Baseline (single model)
83.262
F1
No paper
#187Bert-raw (single model)
83.243
F1
No paper
#188BERT + UDA (single model)
83.208
F1
No paper
#189PwP+BERT (single model)
83.189
F1
No paper
#190bert (single model)
83.184
F1
No paper
#191PMI-Masking Pure-PMI (single model)
83.175
F1
No paper
#192BISAN-CC (single model)
83.149
F1
No paper
#193Bert
83.118
F1
No paper
#194Insight-baseline (single model)
83.099
F1
No paper
#195PMI-Masking Additional Data Pure-PMI (single model)
83.039
F1
No paper
#196BERT + Sparse-Transformer
83.023
F1
No paper
#197BERT uncased (single model)
83.02
F1
No paper
#198ST_bl
82.962
F1
No paper
#199NEXYS_BASE (single model)
82.912
F1
No paper
#200Candi-Net+BERT (single model)
82.908
F1
No paper
#201{bert-finetuning} (single model)
82.852
F1
No paper
#202PMI-Masking Random Baseline (single model)
82.796
F1
No paper
#203{Anonymous} (single model)
82.524
F1
No paper
#204L6Net + BERT (single model)
82.259
F1
No paper
#205Fusion Adapters TriviaQA NQ Singl
81.863
F1
No paper
#206RoberTa Fusion Adapters Single
81.863
F1
No paper
#207RoberTa+Fusion+Adapters (single model)
81.863
F1
No paper
#208BISAN (single model)
81.531
F1
No paper
#209BERT-Large-Cased (single model)
81.5
F1
No paper
#210BERT-Large-Cased
81.5
F1
No paper
#211BERT + WIAN (ensemble)
81.497
F1
No paper
#212BERTlarge (single model)
81.474
F1
No paper
#213AMBERT (single model)
81.445
F1
No paper
#214BERT+AC(single model)
81.174
F1
No paper
#215BERT+AC (single model)
81.174
F1
No paper
#216BERT (single model)
80.31
F1
No paper
#217TriviaQA Adapter Single Tune
80.258
F1
No paper
#218RoberTa Adapter Single
80.258
F1
No paper
#219RoberTa+Adapter (single model)
80.258
F1
No paper
#220SLQA+BERT (single model)
80.209
F1
No paper
#221AMBERT-S (single model)
79.776
F1
No paper
#222AMBERT-H (single model)
79.659
F1
No paper
#223synss (single model )
79.329
F1
No paper
#224synss (single model)
79.329
F1
No paper
#225mgrc
78.381
F1
No paper
#226gMLP-large
78.3
F1· 2021-05-17
Pay Attention to MLPs Code
#227BERT-Base-L (single model)
78.232
F1
No paper
#228ARSG-BERT (single model)
78.227
F1
No paper
#229MIR-MRC(F-Net) (single model)
77.988
F1
No paper
#230MIR-MRC (F-Net)
77.988
F1
No paper
#231BERT-Base-V (single model)
77.805
F1
No paper
#232BERT-Base-DT (single model)
77.706
F1
No paper
#233BERT-Base-DP (single model)
77.464
F1
No paper
#234BERT-Base-V2
77.404
F1
No paper
#235BERT-Base-Add (single model)
77.396
F1
No paper
#236{BERTcw} (single model)
77.308
F1
No paper
#237nlnet (single model)
77.052
F1
No paper
#238batch2 (single model)
76.858
F1
No paper
#239MMIPN
76.424
F1
No paper
#240BERT-Base-Baseline (single model)
76.284
F1
No paper
#241BERT-Base (single model)
76.236
F1
No paper
#242ICL_MODEL(ensemble)
76.217
F1
No paper
#243ICL_MODEL (ensemble)
76.217
F1
No paper
#244BERT-base
75.513
F1
No paper
#245BERTBase (single model)
75.513
F1
No paper
#246YARCS (ensemble)
75.507
F1
No paper
#247BERT+Answer Verifier (single model)
75.457
F1
No paper
#248Unet (ensemble)SOTA
74.869
F1· 2018-10-12
U-Net: Machine Reading Comprehension with Unanswerable Questions Code
#249HYDRA_BERT (single model)
74.578
F1
No paper
#250{BERT-base} (single-model)
74.449
F1
No paper
#251SLQA+ (single model)
74.434
F1
No paper
#252BERT-Base (single)
74.43
F1
No paper
#253Reinforced Mnemonic Reader + Answer Verifier (single model)SOTA
74.295
F1· 2018-08-17
Read + Verify: Machine Reading Comprehension with Unanswerable Questions
#254SAN (ensemble model)SOTA
73.704
F1· 2017-12-10
Stochastic Answer Networks for Machine Reading Comprehension Code
#255Multi-Level Attention Fusion(MLAF) (single model)
72.857
F1
No paper
#256Multi-Level Attention Fusion (MLAF)
72.857
F1
No paper
#257Unet (single model)
72.642
F1
No paper
#258FusionNet++ (ensemble)SOTA
72.484
F1· 2017-11-16
FusionNet: Fusing via Fully-Aware Attention with Application to Machine Comprehension Code
#259DocQA + NeurQuRI (single model)
71.662
F1
No paper
#260BiDAF++ with pair2vec (single model)
71.583
F1
No paper
#261SAN (single model)
71.439
F1· 2017-12-10
Stochastic Answer Networks for Machine Reading Comprehension Code
#262VS^3-NET (single model)
70.884
F1
No paper
#263KACTEIL-MRC(GFN-Net) (single model)
70.878
F1
No paper
#264KACTEIL-MRC (GFN-Net)
70.878
F1
No paper
#265EBB-Net (single model)
70.303
F1
No paper
#266KakaoNet2 (single model)
69.381
F1
No paper
#267abcNet (single model)
69.206
F1
No paper
#268BiDAF++ (single model)
68.866
F1
No paper
#269BSAE AddText (single model)
67.422
F1
No paper
#270eeAttNet (single model)
66.633
F1
No paper
#271BiDAF + Self Attention + ELMo (single model)
66.251
F1· 2018-02-15
Deep contextualized word representations Code
#272BiDAF + Self Attention + ELMo (single model)
66.251
F1· 2018-02-15
Deep contextualized word representations
#273Tree-LSTM + BiDAF + ELMo (single model)
62.341
F1
No paper
#274BiDAF + Self Attention (single model)
62.305
F1
No paper
#275BiDAF-No-Answer (single model)
62.093
F1
No paper
#276BNA + SoftDrop (single model)
62.045
F1
No paper
#277BNA + HardDrop (single model)
59.546
F1
No paper
#278Unnamed submission by Simon
59.546
F1
No paper
#279Anonymous (single model)
49.701
F1
No paper
#280{FOO} (single model)
48.883
F1
No paper
#281Bert Large Sentence (Single Model)
48.815
F1
No paper
#282XLNet + DAAF + BERTverifier (ensemble)
47.994
F1
No paper
#283TSAN
43.213
F1
No paper
#284
29.597
F1
No paper
#285CHECK SYSTEM (single model)
5.92
F1
No paper
#2865cls_squad1_fai
3.971
F1
No paper