Question Answering on SQuAD2.0

Metric: EM (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	EM▼	Extra Data	Paper	Date↕	Code
1	IE-Net (ensemble)	90.939	No	-	-	-
2	FPNet (ensemble)	90.871	No	-	-	-
3	IE-NetV2 (ensemble)	90.86	No	-	-	-
4	SA-Net on Albert (ensemble)	90.724	No	-	-	-
5	SA-Net-V2 (ensemble)	90.679	No	-	-	-
6	FPNet (ensemble)	90.6	No	-	-	-
7	Retro-Reader (ensemble)	90.578	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
8	EntitySpanFocusV2 (ensemble)	90.521	No	-	-	-
9	TransNets + SFVerifier + SFEnsembler (ensemble)	90.487	No	-	-	-
10	EntitySpanFocus+AT (ensemble)	90.454	No	-	-	-
11	ATRLP+PV (ensemble)	90.442	No	-	-	-
12	LANetV2 (ensemble)	90.42	No	-	-	-
13	ELECTRA+ALBERT+EntitySpanFocus (ensemble)	90.42	No	-	-	-
14	ALBERT + DAAF + Verifier	90.386	No	-	-	-
15	electra+nlayers+adv+ds	90.284	No	-	-	-
16	MixEnsemble (ensemble)	90.194	No	-	-	-
17	electra+nlayers (ensemble)	90.126	No	-	-	-
18	Retro-Reader on ALBERT (ensemble)	90.115	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
19	Retro-Reader on ALBERT (ensemble)	90.115	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
20	ANet	90.081	No	-	-	-
21	Answer Dependent Classify (single model)	90.059	No	-	-	-
22	electra+nlayers+kdav (ensemble)	90.002	No	-	-	-
23	ALBERT + DAAF + Verifier (ensemble)	90.002	No	-	-	-
24	LANet (ensemble)	89.923	No	-	-	-
25	Electra-nlayers (ensemble)	89.777	No	-	-	-
26	Albert_Verifier_AA_Net (ensemble)	89.743	No	-	-	-
27	ALBERT (ensemble model)	89.731	No	ALBERT: A Lite BERT for Self-supervised Learning...	2019-09-26	Code
28	Span Extract + Classify (single model)	89.562	No	-	-	-
29	Retro-Reader on ELECTRA (single model)	89.562	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
30	ELECTRA+ATRLP+PV (single model)	89.551	No	-	-	-
31	albert+transform+verify (ensemble)	89.528	No	-	-	-
32	albert+KD+transfer (ensemble)	89.461	No	-	-	-
33	ROaD-Electra (single model)	89.449	No	-	-	-
34	ROaD-Electra	89.449	No	-	-	-
35	Albert-nlayers (ensemble)	89.404	No	-	-	-
36	ELECTRA + E-Verifier (ensemble)	89.348	No	-	-	-
37	ELECTRA + ROBERTA + ALBERT (ensemble)	89.325	No	-	-	-
38	2task (single model)	89.325	No	-	-	-
39	Deberta	89.235	No	-	-	-
40	ALBERT + MTDA + SFVerifier (ensemble model)	89.235	No	-	-	-
41	ALBert-LSTM (ensemble)	89.224	No	-	-	-
42	ALBERT + SFVerifier (ensemble model)	89.133	No	-	-	-
43	ELECTRA+RL+EV (single model)	89.021	No	-	-	-
44	electra & albert (ensemble)	88.998	No	-	-	-
45	AE-TEST	88.998	No	-	-	-
46	ELECTRA+EntitySpanFocus (Single model)	88.874	No	-	-	-
47	SA-Net on Electra (single model)	88.851	No	-	-	-
48	ALBERT+Entailment DA (ensemble)	88.761	No	-	-	-
49	ELECTRA (single model)	88.716	No	-	-	-
50	Tuned ALBERT (ensemble model)	88.637	No	-	-	-
51	ELECTRA_ATT (single model)	88.614	No	-	-	-
52	Deberta+prefix	88.603	No	-	-	-
53	ALBERT (Single model)	88.592	No	-	-	-
54	XLNet + DAAF + Verifier (ensemble)	88.592	No	-	-	-
55	ALBERT + IG + NE (single model)	88.569	No	-	-	-
56	ALBERT + IG (single model)	88.524	No	-	-	-
57	aanet_v2.0 (single model)	88.434	No	-	-	-
58	albert+verifier (single model)	88.355	No	-	-	-
59	albert+KD+transfer (single)	88.298	No	-	-	-
60	UPM (ensemble)	88.231	No	-	-	-
61	ALBERT + SFVerifier (single model)	88.197	No	-	-	-
62	{alber_m_transfor} (single model)	88.186	No	-	-	-
63	XLNet + SG-Net Verifier (ensemble)	88.174	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	Code
64	Retro-Reader on ALBERT (single model)	88.107	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
65	Retro-Reader on ALBERT (single model)	88.107	No	Retrospective Reader for Machine Reading Compreh...	2020-01-27	Code
66	ALBERT (single model)	88.107	No	ALBERT: A Lite BERT for Self-supervised Learning...	2019-09-26	Code
67	ALBERT (single model)	88.107	No	ALBERT: A Lite BERT for Self-supervised Learning...	2019-09-26	Code
68	{MTL} (single model)	88.107	No	-	-	-
69	MTL (single model)	88.107	No	-	-	-
70	albert_with_tricks (single)	88.073	No	-	-	-
71	ALBert (single-model)	88.05	No	-	-	-
72	XLNet + SG-Net Verifier (ensemble)	88.05	No	-	-	-
73	DeBERTalarge	88	No	DeBERTa: Decoding-enhanced BERT with Disentangle...	2020-06-05	Code
74	ALBERT 1.1 Th (single model)	87.994	No	-	-	-
75	SkERT-Large (single model)	87.994	No	-	-	-
76	albert+KD+transfer+twopass (single)	87.949	No	-	-	-
77	XLNet (single model)	87.926	No	XLNet: Generalized Autoregressive Pretraining fo...	2019-06-19	Code
78	ALBERT+RL (single model)	87.87	No	-	-	-
79	ALBERT+Entailment DA Verifier (single model)	87.847	No	-	-	-
80	Tuned ALBERT (single model)	87.847	No	-	-	-
81	albert_xxlarge (single model)	87.802	No	-	-	-
82	ALBERT 1.1 (single model)	87.7	No	-	-	-
83	LUKE (single model)	87.429	No	LUKE: Deep Contextualized Entity Representations...	2020-10-02	Code
84	LUKE (single model)	87.429	No	LUKE: Deep Contextualized Entity Representations...	2020-10-02	Code
85	XLNet + SG-Net Verifier++ (single model)	87.238	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	Code
86	UPM (single model)	87.193	No	-	-	-
87	BERT + DAE + AoA (ensemble)	87.147	No	-	-	-
88	XLNet + SG-Net Verifier (single model)	87.046	No	-	-	-
89	RoBERTa+Verify (ensemble)	86.933	No	-	-	-
90	RoBERTa (single model)	86.82	No	RoBERTa: A Robustly Optimized BERT Pretraining A...	2019-07-26	Code
91	RoBERTa (single model)	86.82	No	RoBERTa: A Robustly Optimized BERT Pretraining A...	2019-07-26	Code
92	BERT + ConvLSTM + MTL + Verifier (ensemble)	86.73	No	-	-	-
93	BERT + N-Gram Masking + Synthetic Self-Training (ensemble)	86.673	No	-	-	-
94	RoBERTa+Span (ensemble)	86.651	No	-	-	-
95	Xlnet+Verifier	86.594	No	-	-	-
96	Xlnet+Verifier(single model)	86.572	No	-	-	-
97	Xlnet+Verifier (single model)	86.572	No	-	-	-
98	RoBERTa+Verify (single model)	86.448	No	-	-	-
99	XLNET-123 (single model)	86.436	No	-	-	-
100	XLNET-V2-123+ (single model)	86.403	No	-	-	-
101	XLNet (single model)	86.346	No	-	-	-
102	SG-Net (ensemble)	86.211	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	-
103	SG-Net (ensemble)	86.211	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	Code
104	BERT++(ensemble)	86.166	No	-	-	-
105	SemBERT(ensemble)	86.166	No	Semantics-aware BERT for Language Understanding	2019-09-05	Code
106	SemBERT(ensemble)	86.166	No	Semantics-aware BERT for Language Understanding	2019-09-05	Code
107	SemBERT (ensemble)	86.166	No	Semantics-aware BERT for Language Understanding	2019-09-05	Code
108	Enhanced Albert+Verifier (ensemble)	86.098	No	-	-	-
109	BERT + DAE + AoA (single model)	85.884	No	-	-	-
110	RoBERTa+Span (single model)	85.872	No	-	-	-
111	RoBERTa-Large (ensemble model)	85.872	No	-	-	-
112	BNDVnet (ensemble model)	85.85	No	-	-	-
113	Unnamed submission by guo	85.838	No	-	-	-
114	BERTSP(single model)	85.838	No	-	-	-
115	BERTSP (single model)	85.838	No	-	-	-
116	Enhanced Albert+Verifier3 (ensemble)	85.827	No	-	-	-
117	SENSEFORTH + XLNet (single model)	85.827	No	-	-	-
118	SpanBERT (single model)	85.748	No	-	-	-
119	SemBERT (ensemble model)	85.703	No	-	-	-
120	SpanBERT	85.7	No	SpanBERT: Improving Pre-training by Representing...	2019-07-24	Code
121	BertCNN (single model)	85.24	No	-	-	-
122	SG-Net (single model)	85.229	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	-
123	SG-Net (single model)	85.229	No	SG-Net: Syntax-Guided Machine Reading Comprehens...	2019-08-14	Code
124	RoBERTa-Large (single model)	85.173	No	-	-	-
125	BERT + N-Gram Masking + Synthetic Self-Training (single model)	85.15	No	-	-	-
126	BERT + MMFT + ADA (ensemble)	85.082	No	-	-	-
127	BNDVnet (single model)	85.003	No	-	-	-
128	BERT + ConvLSTM + MTL + Verifier (single model)	84.924	No	-	-	-
129	Insight-baseline-BERT (single model)	84.834	No	-	-	-
130	BertSpan (ensemble)	84.823	No	-	-	-
131	SemBERT (single model)	84.8	No	Semantics-aware BERT for Language Understanding	2019-09-05	Code
132	SemBERT (single model)	84.8	No	Semantics-aware BERT for Language Understanding	2019-09-05	Code
133	Hanvon_model(single model)	84.721	No	-	-	-
134	Hanvon_model (single model)	84.721	No	-	-	-
135	xlnet	84.642	No	-	-	-
136	xlnet(single model)	84.642	No	-	-	-
137	xlnet (single model)	84.642	No	-	-	-
138	BERT++(single model)	84.62	No	-	-	-
139	BERT + Synthetic Self-Training (ensemble)	84.292	No	-	-	-
140	BERT + Multiple-CNN (ensemble)(Kyonggi University	84.202	No	-	-	-
141	BERT + Multiple-CNN (ensemble)	84.202	No	-	-	-
142	RoberTa Parallel Adapters Singl	84.123	No	-	-	-
143	RoberTa Parallel Adapters Single	84.123	No	-	-	-
144	RoberTa+Parallel+Adapters (single model)	84.123	No	-	-	-
145	SemNet (single model)	83.819	No	-	-	-
146	Tuned BERT-1seq Large Cased (single model)	83.751	No	-	-	-
147	BERT finetune baseline (ensemble)	83.536	No	-	-	-
148	SynNet (single model)	83.525	No	-	-	-
149	Lunet + Verifier + BERT (ensemble)	83.469	No	-	-	-
150	PAML+BERT (ensemble model)	83.457	No	-	-	-
151	Unnamed submission by Senseforth_AI	83.142	No	-	-	-
152	SENSEFORTH + BERT	83.142	No	-	-	-
153	Bert-raw (ensemble)	83.119	No	-	-	-
154	BERT with Something (ensemble)	83.051	No	-	-	-
155	BERT + MMFT + ADA (single model)	83.04	No	-	-	-
156	Lunet + Verifier + BERT (single model)	82.995	No	-	-	-
157	BERT + Synthetic Self-Training (single model)	82.972	No	-	-	-
158	mgrc_l (single model)	82.961	No	-	-	-
159	ATB (single model)	82.882	No	-	-	-
160	Tuned BERT Large Cased (single model)	82.803	No	-	-	-
161	BERT-Base + QA Pre-training (single model)	82.724	No	-	-	-
162	BERT + NeurQuRI (ensemble)	82.713	No	-	-	-
163	PAML+BERT (single model)	82.577	No	-	-	-
164	Unnamed submission by cooelf	82.431	No	-	-	-
165	AoA + DA + BERT (ensemble)	82.374	No	-	-	-
166	BART + Adapters + Lohfink-Rossi-Leaveout (single-model)	82.306	No	-	-	-
167	BERT finetune baseline (single model)	82.126	No	-	-	-
168	Candi-Net+BERT (ensemble)	82.126	No	-	-	-
169	BERT-Base PMI-Masking Additional Data (single model)	82.024	No	-	-	-
170	BERT_s (single model)	81.979	No	-	-	-
171	Unnamed submission by zw10	81.731	No	-	-	-
172	BERT-large+UBFT (single model)	81.573	No	-	-	-
173	AoA + DA + BERT (single model)	81.178	No	-	-	-
174	BERT with Something (single model)	81.11	No	-	-	-
175	BERT-Base PMI-Masking (single model)	80.896	No	-	-	-
176	BERT + UnAnsQ (single model)	80.749	No	-	-	-
177	BERT + AL (single model)	80.715	No	-	-	-
178	BERT + NeurQuRI (single model)	80.591	No	-	-	-
179	BERTlarge (ensemble)	80.456	No	-	-	-
180	Bert	80.422	No	-	-	-
181	Bert-raw (single)	80.411	No	-	-	-
182	Candi-Net+BERT (single model)	80.388	No	-	-	-
183	PMI-Masking Additional Data Random Baseline (single model)	80.377	No	-	-	-
184	Unnamed submission by zw4	80.354	No	-	-	-
185	{Bert-Span} (single model)	80.354	No	-	-	-
186	Bert-raw (single model)	80.343	No	-	-	-
187	PMI-Masking Pure-PMI (single model)	80.241	No	-	-	-
188	BISAN-CC (single model)	80.208	No	-	-	-
189	ST_bl	80.14	No	-	-	-
190	PwP+BERT (single model)	80.117	No	-	-	-
191	PMI-Masking Random Baseline (single model)	80.038	No	-	-	-
192	BERT + UDA (single model)	80.005	No	-	-	-
193	PMI-Masking Additional Data Pure-PMI (single model)	79.993	No	-	-	-
194	Original BERT Large Cased (single model)	79.971	No	-	-	-
195	bert (single model)	79.971	No	-	-	-
196	BERT + Sparse-Transformer	79.948	No	-	-	-
197	Insight-baseline (single model)	79.779	No	-	-	-
198	NEXYS_BASE (single model)	79.779	No	-	-	-
199	BERT uncased (single model)	79.745	No	-	-	-
200	{bert-finetuning} (single model)	79.632	No	-	-	-
201	L6Net + BERT (single model)	79.181	No	-	-	-
202	Fusion Adapters TriviaQA NQ Singl	78.933	No	-	-	-
203	RoberTa Fusion Adapters Single	78.933	No	-	-	-
204	RoberTa+Fusion+Adapters (single model)	78.933	No	-	-	-
205	{Anonymous} (single model)	78.876	No	-	-	-
206	BERT + WIAN (ensemble)	78.65	No	-	-	-
207	BERTlarge (single model)	78.65	No	-	-	-
208	AMBERT (single model)	78.594	No	-	-	-
209	BISAN (single model)	78.481	No	-	-	-
210	BERT-Large-Cased (single model)	78.357	No	-	-	-
211	BERT-Large-Cased	78.357	No	-	-	-
212	BERT+AC(single model)	78.052	No	-	-	-
213	BERT+AC (single model)	78.052	No	-	-	-
214	BERT (single model)	77.319	No	-	-	-
215	TriviaQA Adapter Single Tune	77.262	No	-	-	-
216	RoberTa Adapter Single	77.262	No	-	-	-
217	RoberTa+Adapter (single model)	77.262	No	-	-	-
218	SLQA+BERT (single model)	77.003	No	-	-	-
219	AMBERT-H (single model)	76.71	No	-	-	-
220	AMBERT-S (single model)	76.563	No	-	-	-
221	synss (single model )	76.055	No	-	-	-
222	synss (single model)	76.055	No	-	-	-
223	BERT-Base-L (single model)	75.457	No	-	-	-
224	mgrc	75.344	No	-	-	-
225	BERT-Base-V (single model)	75.073	No	-	-	-
226	MIR-MRC(F-Net) (single model)	74.791	No	-	-	-
227	MIR-MRC (F-Net)	74.791	No	-	-	-
228	BERT-Base-DT (single model)	74.769	No	-	-	-
229	ARSG-BERT (single model)	74.746	No	-	-	-
230	BERT-Base-V2	74.656	No	-	-	-
231	BERT-Base-DP (single model)	74.577	No	-	-	-
232	{BERTcw} (single model)	74.385	No	-	-	-
233	BERT-Base-Add (single model)	74.329	No	-	-	-
234	nlnet (single model)	74.272	No	-	-	-
235	batch2 (single model)	73.742	No	-	-	-
236	MMIPN	73.505	No	-	-	-
237	BERT-Base-Baseline (single model)	73.302	No	-	-	-
238	BERT-Base (single model)	73.099	No	-	-	-
239	ICL_MODEL(ensemble)	72.884	No	-	-	-
240	ICL_MODEL (ensemble)	72.884	No	-	-	-
241	YARCS (ensemble)	72.67	No	-	-	-
242	BERT-base	72.072	No	-	-	-
243	BERTBase (single model)	72.072	No	-	-	-
244	Reinforced Mnemonic Reader + Answer Verifier (single model)	71.767	No	Read + Verify: Machine Reading Comprehension wit...	2018-08-17	-
245	BERT-Base (single)	71.699	No	-	-	-
246	BERT+Answer Verifier (single model)	71.666	No	-	-	-
247	SLQA+ (single model)	71.462	No	-	-	-
248	Unet (ensemble)	71.417	No	U-Net: Machine Reading Comprehension with Unansw...	2018-10-12	Code
249	SAN (ensemble model)	71.316	No	Stochastic Answer Networks for Machine Reading C...	2017-12-10	Code
250	HYDRA_BERT (single model)	71.293	No	-	-	-
251	{BERT-base} (single-model)	70.763	No	-	-	-
252	FusionNet++ (ensemble)	70.3	No	FusionNet: Fusing via Fully-Aware Attention with...	2017-11-16	Code
253	Multi-Level Attention Fusion(MLAF) (single model)	69.476	No	-	-	-
254	Multi-Level Attention Fusion (MLAF)	69.476	No	-	-	-
255	Unet (single model)	69.262	No	-	-	-
256	DocQA + NeurQuRI (single model)	68.766	No	-	-	-
257	SAN (single model)	68.653	No	Stochastic Answer Networks for Machine Reading C...	2017-12-10	Code
258	KACTEIL-MRC(GFN-Net) (single model)	68.213	No	-	-	-
259	KACTEIL-MRC (GFN-Net)	68.213	No	-	-	-
260	BiDAF++ with pair2vec (single model)	68.021	No	-	-	-
261	VS^3-NET (single model)	67.897	No	-	-	-
262	EBB-Net (single model)	66.61	No	-	-	-
263	KakaoNet2 (single model)	65.719	No	-	-	-
264	BiDAF++ (single model)	65.651	No	-	-	-
265	abcNet (single model)	65.256	No	-	-	-
266	BiDAF + Self Attention + ELMo (single model)	63.372	No	Deep contextualized word representations	2018-02-15	Code
267	BiDAF + Self Attention + ELMo (single model)	63.372	No	Deep contextualized word representations	2018-02-15	-
268	BSAE AddText (single model)	63.338	No	-	-	-
269	eeAttNet (single model)	63.327	No	-	-	-
270	BiDAF + Self Attention (single model)	59.332	No	-	-	-
271	BiDAF-No-Answer (single model)	59.174	No	-	-	-
272	BNA + SoftDrop (single model)	58.508	No	-	-	-
273	Tree-LSTM + BiDAF + ELMo (single model)	57.707	No	-	-	-
274	BNA + HardDrop (single model)	56.545	No	-	-	-
275	Unnamed submission by Simon	56.545	No	-	-	-
276	Anonymous (single model)	49.695	No	-	-	-
277	{FOO} (single model)	48.883	No	-	-	-
278	Bert Large Sentence (Single Model)	48.804	No	-	-	-
279	XLNet + DAAF + BERTverifier (ensemble)	44.945	No	-	-	-
280	TSAN	40.397	No	-	-	-
281		27.217	No	-	-	-
282	CHECK SYSTEM (single model)	4.83	No	-	-	-
283	5cls_squad1_fai	0.068	No	-	-	-

#1IE-Net (ensemble)
90.939
EM
No paper
#2FPNet (ensemble)
90.871
EM
No paper
#3IE-NetV2 (ensemble)
90.86
EM
No paper
#4SA-Net on Albert (ensemble)
90.724
EM
No paper
#5SA-Net-V2 (ensemble)
90.679
EM
No paper
#6FPNet (ensemble)
90.6
EM
No paper
#7Retro-Reader (ensemble)SOTA
90.578
EM· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#8EntitySpanFocusV2 (ensemble)
90.521
EM
No paper
#9TransNets + SFVerifier + SFEnsembler (ensemble)
90.487
EM
No paper
#10EntitySpanFocus+AT (ensemble)
90.454
EM
No paper
#11ATRLP+PV (ensemble)
90.442
EM
No paper
#12LANetV2 (ensemble)
90.42
EM
No paper
#13ELECTRA+ALBERT+EntitySpanFocus (ensemble)
90.42
EM
No paper
#14ALBERT + DAAF + Verifier
90.386
EM
No paper
#15electra+nlayers+adv+ds
90.284
EM
No paper
#16MixEnsemble (ensemble)
90.194
EM
No paper
#17electra+nlayers (ensemble)
90.126
EM
No paper
#18Retro-Reader on ALBERT (ensemble)
90.115
EM· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#19Retro-Reader on ALBERT (ensemble)
90.115
EM· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#20ANet
90.081
EM
No paper
#21Answer Dependent Classify (single model)
90.059
EM
No paper
#22electra+nlayers+kdav (ensemble)
90.002
EM
No paper
#23ALBERT + DAAF + Verifier (ensemble)
90.002
EM
No paper
#24LANet (ensemble)
89.923
EM
No paper
#25Electra-nlayers (ensemble)
89.777
EM
No paper
#26Albert_Verifier_AA_Net (ensemble)
89.743
EM
No paper
#27ALBERT (ensemble model)SOTA
89.731
EM· 2019-09-26
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Code
#28Span Extract + Classify (single model)
89.562
EM
No paper
#29Retro-Reader on ELECTRA (single model)
89.562
EM· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#30ELECTRA+ATRLP+PV (single model)
89.551
EM
No paper
#31albert+transform+verify (ensemble)
89.528
EM
No paper
#32albert+KD+transfer (ensemble)
89.461
EM
No paper
#33ROaD-Electra (single model)
89.449
EM
No paper
#34ROaD-Electra
89.449
EM
No paper
#35Albert-nlayers (ensemble)
89.404
EM
No paper
#36ELECTRA + E-Verifier (ensemble)
89.348
EM
No paper
#37ELECTRA + ROBERTA + ALBERT (ensemble)
89.325
EM
No paper
#382task (single model)
89.325
EM
No paper
#39Deberta
89.235
EM
No paper
#40ALBERT + MTDA + SFVerifier (ensemble model)
89.235
EM
No paper
#41ALBert-LSTM (ensemble)
89.224
EM
No paper
#42ALBERT + SFVerifier (ensemble model)
89.133
EM
No paper
#43ELECTRA+RL+EV (single model)
89.021
EM
No paper
#44electra & albert (ensemble)
88.998
EM
No paper
#45AE-TEST
88.998
EM
No paper
#46ELECTRA+EntitySpanFocus (Single model)
88.874
EM
No paper
#47SA-Net on Electra (single model)
88.851
EM
No paper
#48ALBERT+Entailment DA (ensemble)
88.761
EM
No paper
#49ELECTRA (single model)
88.716
EM
No paper
#50Tuned ALBERT (ensemble model)
88.637
EM
No paper
#51ELECTRA_ATT (single model)
88.614
EM
No paper
#52Deberta+prefix
88.603
EM
No paper
#53ALBERT (Single model)
88.592
EM
No paper
#54XLNet + DAAF + Verifier (ensemble)
88.592
EM
No paper
#55ALBERT + IG + NE (single model)
88.569
EM
No paper
#56ALBERT + IG (single model)
88.524
EM
No paper
#57aanet_v2.0 (single model)
88.434
EM
No paper
#58albert+verifier (single model)
88.355
EM
No paper
#59albert+KD+transfer (single)
88.298
EM
No paper
#60UPM (ensemble)
88.231
EM
No paper
#61ALBERT + SFVerifier (single model)
88.197
EM
No paper
#62{alber_m_transfor} (single model)
88.186
EM
No paper
#63XLNet + SG-Net Verifier (ensemble)SOTA
88.174
EM· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension Code
#64Retro-Reader on ALBERT (single model)
88.107
EM· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#65Retro-Reader on ALBERT (single model)
88.107
EM· 2020-01-27
Retrospective Reader for Machine Reading Comprehension Code
#66ALBERT (single model)
88.107
EM· 2019-09-26
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Code
#67ALBERT (single model)
88.107
EM· 2019-09-26
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Code
#68{MTL} (single model)
88.107
EM
No paper
#69MTL (single model)
88.107
EM
No paper
#70albert_with_tricks (single)
88.073
EM
No paper
#71ALBert (single-model)
88.05
EM
No paper
#72XLNet + SG-Net Verifier (ensemble)
88.05
EM
No paper
#73DeBERTalarge
88
EM· 2020-06-05
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Code
#74ALBERT 1.1 Th (single model)
87.994
EM
No paper
#75SkERT-Large (single model)
87.994
EM
No paper
#76albert+KD+transfer+twopass (single)
87.949
EM
No paper
#77XLNet (single model)SOTA
87.926
EM· 2019-06-19
XLNet: Generalized Autoregressive Pretraining for Language Understanding Code
#78ALBERT+RL (single model)
87.87
EM
No paper
#79ALBERT+Entailment DA Verifier (single model)
87.847
EM
No paper
#80Tuned ALBERT (single model)
87.847
EM
No paper
#81albert_xxlarge (single model)
87.802
EM
No paper
#82ALBERT 1.1 (single model)
87.7
EM
No paper
#83LUKE (single model)
87.429
EM· 2020-10-02
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Code
#84LUKE (single model)
87.429
EM· 2020-10-02
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Code
#85XLNet + SG-Net Verifier++ (single model)
87.238
EM· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension Code
#86UPM (single model)
87.193
EM
No paper
#87BERT + DAE + AoA (ensemble)
87.147
EM
No paper
#88XLNet + SG-Net Verifier (single model)
87.046
EM
No paper
#89RoBERTa+Verify (ensemble)
86.933
EM
No paper
#90RoBERTa (single model)
86.82
EM· 2019-07-26
RoBERTa: A Robustly Optimized BERT Pretraining Approach Code
#91RoBERTa (single model)
86.82
EM· 2019-07-26
RoBERTa: A Robustly Optimized BERT Pretraining Approach Code
#92BERT + ConvLSTM + MTL + Verifier (ensemble)
86.73
EM
No paper
#93BERT + N-Gram Masking + Synthetic Self-Training (ensemble)
86.673
EM
No paper
#94RoBERTa+Span (ensemble)
86.651
EM
No paper
#95Xlnet+Verifier
86.594
EM
No paper
#96Xlnet+Verifier(single model)
86.572
EM
No paper
#97Xlnet+Verifier (single model)
86.572
EM
No paper
#98RoBERTa+Verify (single model)
86.448
EM
No paper
#99XLNET-123 (single model)
86.436
EM
No paper
#100XLNET-V2-123+ (single model)
86.403
EM
No paper
#101XLNet (single model)
86.346
EM
No paper
#102SG-Net (ensemble)
86.211
EM· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension
#103SG-Net (ensemble)
86.211
EM· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension Code
#104BERT++(ensemble)
86.166
EM
No paper
#105SemBERT(ensemble)
86.166
EM· 2019-09-05
Semantics-aware BERT for Language Understanding Code
#106SemBERT(ensemble)
86.166
EM· 2019-09-05
Semantics-aware BERT for Language Understanding Code
#107SemBERT (ensemble)
86.166
EM· 2019-09-05
Semantics-aware BERT for Language Understanding Code
#108Enhanced Albert+Verifier (ensemble)
86.098
EM
No paper
#109BERT + DAE + AoA (single model)
85.884
EM
No paper
#110RoBERTa+Span (single model)
85.872
EM
No paper
#111RoBERTa-Large (ensemble model)
85.872
EM
No paper
#112BNDVnet (ensemble model)
85.85
EM
No paper
#113Unnamed submission by guo
85.838
EM
No paper
#114BERTSP(single model)
85.838
EM
No paper
#115BERTSP (single model)
85.838
EM
No paper
#116Enhanced Albert+Verifier3 (ensemble)
85.827
EM
No paper
#117SENSEFORTH + XLNet (single model)
85.827
EM
No paper
#118SpanBERT (single model)
85.748
EM
No paper
#119SemBERT (ensemble model)
85.703
EM
No paper
#120SpanBERT
85.7
EM· 2019-07-24
SpanBERT: Improving Pre-training by Representing and Predicting Spans Code
#121BertCNN (single model)
85.24
EM
No paper
#122SG-Net (single model)
85.229
EM· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension
#123SG-Net (single model)
85.229
EM· 2019-08-14
SG-Net: Syntax-Guided Machine Reading Comprehension Code
#124RoBERTa-Large (single model)
85.173
EM
No paper
#125BERT + N-Gram Masking + Synthetic Self-Training (single model)
85.15
EM
No paper
#126BERT + MMFT + ADA (ensemble)
85.082
EM
No paper
#127BNDVnet (single model)
85.003
EM
No paper
#128BERT + ConvLSTM + MTL + Verifier (single model)
84.924
EM
No paper
#129Insight-baseline-BERT (single model)
84.834
EM
No paper
#130BertSpan (ensemble)
84.823
EM
No paper
#131SemBERT (single model)
84.8
EM· 2019-09-05
Semantics-aware BERT for Language Understanding Code
#132SemBERT (single model)
84.8
EM· 2019-09-05
Semantics-aware BERT for Language Understanding Code
#133Hanvon_model(single model)
84.721
EM
No paper
#134Hanvon_model (single model)
84.721
EM
No paper
#135xlnet
84.642
EM
No paper
#136xlnet(single model)
84.642
EM
No paper
#137xlnet (single model)
84.642
EM
No paper
#138BERT++(single model)
84.62
EM
No paper
#139BERT + Synthetic Self-Training (ensemble)
84.292
EM
No paper
#140BERT + Multiple-CNN (ensemble)(Kyonggi University
84.202
EM
No paper
#141BERT + Multiple-CNN (ensemble)
84.202
EM
No paper
#142RoberTa Parallel Adapters Singl
84.123
EM
No paper
#143RoberTa Parallel Adapters Single
84.123
EM
No paper
#144RoberTa+Parallel+Adapters (single model)
84.123
EM
No paper
#145SemNet (single model)
83.819
EM
No paper
#146Tuned BERT-1seq Large Cased (single model)
83.751
EM
No paper
#147BERT finetune baseline (ensemble)
83.536
EM
No paper
#148SynNet (single model)
83.525
EM
No paper
#149Lunet + Verifier + BERT (ensemble)
83.469
EM
No paper
#150PAML+BERT (ensemble model)
83.457
EM
No paper
#151Unnamed submission by Senseforth_AI
83.142
EM
No paper
#152SENSEFORTH + BERT
83.142
EM
No paper
#153Bert-raw (ensemble)
83.119
EM
No paper
#154BERT with Something (ensemble)
83.051
EM
No paper
#155BERT + MMFT + ADA (single model)
83.04
EM
No paper
#156Lunet + Verifier + BERT (single model)
82.995
EM
No paper
#157BERT + Synthetic Self-Training (single model)
82.972
EM
No paper
#158mgrc_l (single model)
82.961
EM
No paper
#159ATB (single model)
82.882
EM
No paper
#160Tuned BERT Large Cased (single model)
82.803
EM
No paper
#161BERT-Base + QA Pre-training (single model)
82.724
EM
No paper
#162BERT + NeurQuRI (ensemble)
82.713
EM
No paper
#163PAML+BERT (single model)
82.577
EM
No paper
#164Unnamed submission by cooelf
82.431
EM
No paper
#165AoA + DA + BERT (ensemble)
82.374
EM
No paper
#166BART + Adapters + Lohfink-Rossi-Leaveout (single-model)
82.306
EM
No paper
#167BERT finetune baseline (single model)
82.126
EM
No paper
#168Candi-Net+BERT (ensemble)
82.126
EM
No paper
#169BERT-Base PMI-Masking Additional Data (single model)
82.024
EM
No paper
#170BERT_s (single model)
81.979
EM
No paper
#171Unnamed submission by zw10
81.731
EM
No paper
#172BERT-large+UBFT (single model)
81.573
EM
No paper
#173AoA + DA + BERT (single model)
81.178
EM
No paper
#174BERT with Something (single model)
81.11
EM
No paper
#175BERT-Base PMI-Masking (single model)
80.896
EM
No paper
#176BERT + UnAnsQ (single model)
80.749
EM
No paper
#177BERT + AL (single model)
80.715
EM
No paper
#178BERT + NeurQuRI (single model)
80.591
EM
No paper
#179BERTlarge (ensemble)
80.456
EM
No paper
#180Bert
80.422
EM
No paper
#181Bert-raw (single)
80.411
EM
No paper
#182Candi-Net+BERT (single model)
80.388
EM
No paper
#183PMI-Masking Additional Data Random Baseline (single model)
80.377
EM
No paper
#184Unnamed submission by zw4
80.354
EM
No paper
#185{Bert-Span} (single model)
80.354
EM
No paper
#186Bert-raw (single model)
80.343
EM
No paper
#187PMI-Masking Pure-PMI (single model)
80.241
EM
No paper
#188BISAN-CC (single model)
80.208
EM
No paper
#189ST_bl
80.14
EM
No paper
#190PwP+BERT (single model)
80.117
EM
No paper
#191PMI-Masking Random Baseline (single model)
80.038
EM
No paper
#192BERT + UDA (single model)
80.005
EM
No paper
#193PMI-Masking Additional Data Pure-PMI (single model)
79.993
EM
No paper
#194Original BERT Large Cased (single model)
79.971
EM
No paper
#195bert (single model)
79.971
EM
No paper
#196BERT + Sparse-Transformer
79.948
EM
No paper
#197Insight-baseline (single model)
79.779
EM
No paper
#198NEXYS_BASE (single model)
79.779
EM
No paper
#199BERT uncased (single model)
79.745
EM
No paper
#200{bert-finetuning} (single model)
79.632
EM
No paper
#201L6Net + BERT (single model)
79.181
EM
No paper
#202Fusion Adapters TriviaQA NQ Singl
78.933
EM
No paper
#203RoberTa Fusion Adapters Single
78.933
EM
No paper
#204RoberTa+Fusion+Adapters (single model)
78.933
EM
No paper
#205{Anonymous} (single model)
78.876
EM
No paper
#206BERT + WIAN (ensemble)
78.65
EM
No paper
#207BERTlarge (single model)
78.65
EM
No paper
#208AMBERT (single model)
78.594
EM
No paper
#209BISAN (single model)
78.481
EM
No paper
#210BERT-Large-Cased (single model)
78.357
EM
No paper
#211BERT-Large-Cased
78.357
EM
No paper
#212BERT+AC(single model)
78.052
EM
No paper
#213BERT+AC (single model)
78.052
EM
No paper
#214BERT (single model)
77.319
EM
No paper
#215TriviaQA Adapter Single Tune
77.262
EM
No paper
#216RoberTa Adapter Single
77.262
EM
No paper
#217RoberTa+Adapter (single model)
77.262
EM
No paper
#218SLQA+BERT (single model)
77.003
EM
No paper
#219AMBERT-H (single model)
76.71
EM
No paper
#220AMBERT-S (single model)
76.563
EM
No paper
#221synss (single model )
76.055
EM
No paper
#222synss (single model)
76.055
EM
No paper
#223BERT-Base-L (single model)
75.457
EM
No paper
#224mgrc
75.344
EM
No paper
#225BERT-Base-V (single model)
75.073
EM
No paper
#226MIR-MRC(F-Net) (single model)
74.791
EM
No paper
#227MIR-MRC (F-Net)
74.791
EM
No paper
#228BERT-Base-DT (single model)
74.769
EM
No paper
#229ARSG-BERT (single model)
74.746
EM
No paper
#230BERT-Base-V2
74.656
EM
No paper
#231BERT-Base-DP (single model)
74.577
EM
No paper
#232{BERTcw} (single model)
74.385
EM
No paper
#233BERT-Base-Add (single model)
74.329
EM
No paper
#234nlnet (single model)
74.272
EM
No paper
#235batch2 (single model)
73.742
EM
No paper
#236MMIPN
73.505
EM
No paper
#237BERT-Base-Baseline (single model)
73.302
EM
No paper
#238BERT-Base (single model)
73.099
EM
No paper
#239ICL_MODEL(ensemble)
72.884
EM
No paper
#240ICL_MODEL (ensemble)
72.884
EM
No paper
#241YARCS (ensemble)
72.67
EM
No paper
#242BERT-base
72.072
EM
No paper
#243BERTBase (single model)
72.072
EM
No paper
#244Reinforced Mnemonic Reader + Answer Verifier (single model)SOTA
71.767
EM· 2018-08-17
Read + Verify: Machine Reading Comprehension with Unanswerable Questions
#245BERT-Base (single)
71.699
EM
No paper
#246BERT+Answer Verifier (single model)
71.666
EM
No paper
#247SLQA+ (single model)
71.462
EM
No paper
#248Unet (ensemble)
71.417
EM· 2018-10-12
U-Net: Machine Reading Comprehension with Unanswerable Questions Code
#249SAN (ensemble model)SOTA
71.316
EM· 2017-12-10
Stochastic Answer Networks for Machine Reading Comprehension Code
#250HYDRA_BERT (single model)
71.293
EM
No paper
#251{BERT-base} (single-model)
70.763
EM
No paper
#252FusionNet++ (ensemble)SOTA
70.3
EM· 2017-11-16
FusionNet: Fusing via Fully-Aware Attention with Application to Machine Comprehension Code
#253Multi-Level Attention Fusion(MLAF) (single model)
69.476
EM
No paper
#254Multi-Level Attention Fusion (MLAF)
69.476
EM
No paper
#255Unet (single model)
69.262
EM
No paper
#256DocQA + NeurQuRI (single model)
68.766
EM
No paper
#257SAN (single model)
68.653
EM· 2017-12-10
Stochastic Answer Networks for Machine Reading Comprehension Code
#258KACTEIL-MRC(GFN-Net) (single model)
68.213
EM
No paper
#259KACTEIL-MRC (GFN-Net)
68.213
EM
No paper
#260BiDAF++ with pair2vec (single model)
68.021
EM
No paper
#261VS^3-NET (single model)
67.897
EM
No paper
#262EBB-Net (single model)
66.61
EM
No paper
#263KakaoNet2 (single model)
65.719
EM
No paper
#264BiDAF++ (single model)
65.651
EM
No paper
#265abcNet (single model)
65.256
EM
No paper
#266BiDAF + Self Attention + ELMo (single model)
63.372
EM· 2018-02-15
Deep contextualized word representations Code
#267BiDAF + Self Attention + ELMo (single model)
63.372
EM· 2018-02-15
Deep contextualized word representations
#268BSAE AddText (single model)
63.338
EM
No paper
#269eeAttNet (single model)
63.327
EM
No paper
#270BiDAF + Self Attention (single model)
59.332
EM
No paper
#271BiDAF-No-Answer (single model)
59.174
EM
No paper
#272BNA + SoftDrop (single model)
58.508
EM
No paper
#273Tree-LSTM + BiDAF + ELMo (single model)
57.707
EM
No paper
#274BNA + HardDrop (single model)
56.545
EM
No paper
#275Unnamed submission by Simon
56.545
EM
No paper
#276Anonymous (single model)
49.695
EM
No paper
#277{FOO} (single model)
48.883
EM
No paper
#278Bert Large Sentence (Single Model)
48.804
EM
No paper
#279XLNet + DAAF + BERTverifier (ensemble)
44.945
EM
No paper
#280TSAN
40.397
EM
No paper
#281
27.217
EM
No paper
#282CHECK SYSTEM (single model)
4.83
EM
No paper
#2835cls_squad1_fai
0.068
EM
No paper