Text Classification on MTEB

Metric: Accuracy (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Accuracy▼	Extra Data	Paper	Date↕	Code
1	ST5-XXL	73.42	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
2	ST5-XL	72.84	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
3	ST5-Large	72.31	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
4	Ada Similarity	70.44	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
5	SGPT-5.8B-nli	70.14	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
6	ST5-Base	69.81	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
7	SGPT-5.8B-msmarco	68.13	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
8	MPNet-multilingual	67.91	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
9	GTR-XXL	67.41	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
10	SimCSE-BERT-sup	67.32	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
11	GTR-Large	67.14	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
12	SGPT-2.7B-msmarco	67.13	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
13	GTR-XL	67.11	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
14	Contriever	66.68	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
15	SGPT-1.3B-msmarco	66.52	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
16	SGPT-BLOOM-7.1B-msmarco	66.19	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
17	GTR-Base	65.25	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
18	MPNet	65.07	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
19	coCondenser-msmarco	64.71	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
20	MiniLM-L12-multilingual	64.3	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
21	MiniLM-L12	63.21	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
22	MiniLM-L6	63.06	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
23	LaBSE	62.71	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
24	SimCSE-BERT-unsup	62.5	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
25	BERT	61.66	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
26	SGPT-125M-nli	61.46	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
27	SGPT-125M-msmarco	60.72	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
28	Komninos	57.65	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
29	Glove	57.29	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
30	LASER2	53.65	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
31	SPECTER	52.37	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code

#1ST5-XXLSOTA
73.42
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#2ST5-XL
72.84
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#3ST5-Large
72.31
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#4Ada Similarity
70.44
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#5SGPT-5.8B-nli
70.14
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#6ST5-Base
69.81
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#7SGPT-5.8B-msmarco
68.13
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#8MPNet-multilingual
67.91
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#9GTR-XXL
67.41
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#10SimCSE-BERT-sup
67.32
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#11GTR-Large
67.14
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#12SGPT-2.7B-msmarco
67.13
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#13GTR-XL
67.11
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#14Contriever
66.68
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#15SGPT-1.3B-msmarco
66.52
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#16SGPT-BLOOM-7.1B-msmarco
66.19
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#17GTR-Base
65.25
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#18MPNet
65.07
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#19coCondenser-msmarco
64.71
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#20MiniLM-L12-multilingual
64.3
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#21MiniLM-L12
63.21
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#22MiniLM-L6
63.06
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#23LaBSE
62.71
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#24SimCSE-BERT-unsup
62.5
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#25BERT
61.66
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#26SGPT-125M-nli
61.46
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#27SGPT-125M-msmarco
60.72
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#28Komninos
57.65
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#29Glove
57.29
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#30LASER2
53.65
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#31SPECTER
52.37
Accuracy· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code