Cross-Lingual Transfer on XTREME

Metric: Question Answering (lower is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Question Answering▲	Extra Data	Paper	Date↕	Code
1	Anonymous5	52.5	No	-	-	-
2	mBERT	53.8	No	-	-	Code
3	Creative	59.7	No	-	-	-
4	Anonymous6	65.5	No	-	-	-
5	X-STILTs	67.2	No	English Intermediate-Task Training Improves Zero...	2020-05-26	-
6	FILTER	68.5	No	FILTER: An Enhanced Fusion Method for Cross-ling...	2020-09-10	Code
7	RemBERT	68.6	No	-	-	-
8	Anonymous3	71.7	No	-	-	-
9	Polyglot	71.9	No	-	-	-
10	HiCTL	71.9	No	-	-	-
11	ERNIE-M	72.3	No	ERNIE-M: Enhanced Multilingual Representation by...	2020-12-31	Code
12	Unicoder+ZCode	72.5	No	-	-	-
13	Unicoder + ZCode	72.5	No	-	-	-
14	T-ULRv2 + StableTune	72.9	No	InfoXLM: An Information-Theoretic Framework for ...	2020-07-15	Code
15	VECO	73.4	No	-	-	-
16	VECO + HICTL	73.4	No	-	-	-
17	mT5	73.6	No	mT5: A massively multilingual pre-trained text-t...	2020-10-22	Code
18	Turing ULR v5 (XLM-E)	74.3	No	-	-	-
19	CoFe	75	No	-	-	-
20	InfoXLM-XFT	75.2	No	-	-	-
21	Ensemble-Distil-XFT (ED-XFT)	75.2	No	-	-	-
22	MShenNonG	76.3	No	-	-	-
23	MShenNonG+TDT	76.3	No	-	-	-
24	Turing ULR v5	76.3	No	XLM-E: Cross-lingual Language Model Pre-training...	2021-06-30	Code
25	Turing ULR v6	77.1	No	XLM-E: Cross-lingual Language Model Pre-training...	2021-06-30	Code

#1Anonymous5
52.5
Question Answering
No paper
#2mBERT
53.8
Question Answering
No paperCode
#3Creative
59.7
Question Answering
No paper
#4Anonymous6
65.5
Question Answering
No paper
#5X-STILTsSOTA
67.2
Question Answering· 2020-05-26
English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Too
#6FILTER
68.5
Question Answering· 2020-09-10
FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding Code
#7RemBERT
68.6
Question Answering
No paper
#8Anonymous3
71.7
Question Answering
No paper
#9Polyglot
71.9
Question Answering
No paper
#10HiCTL
71.9
Question Answering
No paper
#11ERNIE-M
72.3
Question Answering· 2020-12-31
ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora Code
#12Unicoder+ZCode
72.5
Question Answering
No paper
#13Unicoder + ZCode
72.5
Question Answering
No paper
#14T-ULRv2 + StableTune
72.9
Question Answering· 2020-07-15
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training Code
#15VECO
73.4
Question Answering
No paper
#16VECO + HICTL
73.4
Question Answering
No paper
#17mT5
73.6
Question Answering· 2020-10-22
mT5: A massively multilingual pre-trained text-to-text transformer Code
#18Turing ULR v5 (XLM-E)
74.3
Question Answering
No paper
#19CoFe
75
Question Answering
No paper
#20InfoXLM-XFT
75.2
Question Answering
No paper
#21Ensemble-Distil-XFT (ED-XFT)
75.2
Question Answering
No paper
#22MShenNonG
76.3
Question Answering
No paper
#23MShenNonG+TDT
76.3
Question Answering
No paper
#24Turing ULR v5
76.3
Question Answering· 2021-06-30
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA Code
#25Turing ULR v6
77.1
Question Answering· 2021-06-30
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA Code