Cross-Lingual Transfer on XTREME

Metric: Sentence-pair Classification (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Sentence-pair Classification▼	Extra Data	Paper	Date↕	Code
1	Turing ULR v6	91	No	XLM-E: Cross-lingual Language Model Pre-training...	2021-06-30	Code
2	MShenNonG	90.4	No	-	-	-
3	MShenNonG+TDT	90.4	No	-	-	-
4	Turing ULR v5	90.3	No	XLM-E: Cross-lingual Language Model Pre-training...	2021-06-30	Code
5	CoFe	90.1	No	-	-	-
6	Turing ULR v5 (XLM-E)	90	No	-	-	-
7	mT5	89.8	No	mT5: A massively multilingual pre-trained text-t...	2020-10-22	Code
8	InfoXLM-XFT	89.3	No	-	-	-
9	Ensemble-Distil-XFT (ED-XFT)	89.2	No	-	-	-
10	VECO	89	No	-	-	-
11	VECO + HICTL	89	No	-	-	-
12	HiCTL	89	No	-	-	-
13	T-ULRv2 + StableTune	88.8	No	InfoXLM: An Information-Theoretic Framework for ...	2020-07-15	Code
14	Unicoder+ZCode	88.4	No	-	-	-
15	Unicoder + ZCode	88.4	No	-	-	-
16	Polyglot	88.3	No	-	-	-
17	Anonymous3	88.2	No	-	-	-
18	ERNIE-M	87.9	No	ERNIE-M: Enhanced Multilingual Representation by...	2020-12-31	Code
19	FILTER	87.5	No	FILTER: An Enhanced Fusion Method for Cross-ling...	2020-09-10	Code
20	Creative	86.3	No	-	-	-
21	RemBERT	84.1	No	-	-	-
22	X-STILTs	83.9	No	English Intermediate-Task Training Improves Zero...	2020-05-26	-
23	Anonymous5	75.3	No	-	-	-
24	mBERT	73.7	No	-	-	Code
25	Anonymous6	44.2	No	-	-	-

#1Turing ULR v6SOTA
91
Sentence-pair Classification· 2021-06-30
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA Code
#2MShenNonG
90.4
Sentence-pair Classification
No paper
#3MShenNonG+TDT
90.4
Sentence-pair Classification
No paper
#4Turing ULR v5
90.3
Sentence-pair Classification· 2021-06-30
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA Code
#5CoFe
90.1
Sentence-pair Classification
No paper
#6Turing ULR v5 (XLM-E)
90
Sentence-pair Classification
No paper
#7mT5SOTA
89.8
Sentence-pair Classification· 2020-10-22
mT5: A massively multilingual pre-trained text-to-text transformer Code
#8InfoXLM-XFT
89.3
Sentence-pair Classification
No paper
#9Ensemble-Distil-XFT (ED-XFT)
89.2
Sentence-pair Classification
No paper
#10VECO
89
Sentence-pair Classification
No paper
#11VECO + HICTL
89
Sentence-pair Classification
No paper
#12HiCTL
89
Sentence-pair Classification
No paper
#13T-ULRv2 + StableTuneSOTA
88.8
Sentence-pair Classification· 2020-07-15
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training Code
#14Unicoder+ZCode
88.4
Sentence-pair Classification
No paper
#15Unicoder + ZCode
88.4
Sentence-pair Classification
No paper
#16Polyglot
88.3
Sentence-pair Classification
No paper
#17Anonymous3
88.2
Sentence-pair Classification
No paper
#18ERNIE-M
87.9
Sentence-pair Classification· 2020-12-31
ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora Code
#19FILTER
87.5
Sentence-pair Classification· 2020-09-10
FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding Code
#20Creative
86.3
Sentence-pair Classification
No paper
#21RemBERT
84.1
Sentence-pair Classification
No paper
#22X-STILTsSOTA
83.9
Sentence-pair Classification· 2020-05-26
English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Too
#23Anonymous5
75.3
Sentence-pair Classification
No paper
#24mBERT
73.7
Sentence-pair Classification
No paperCode
#25Anonymous6
44.2
Sentence-pair Classification
No paper