Semantic Textual Similarity on MTEB

Metric: Spearman Correlation (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Spearman Correlation▼	Extra Data	Paper	Date↕	Code
1	AnglE-UAE	84.54	No	AnglE-optimized Text Embeddings	2023-09-22	Code
2	ST5-XXL	82.63	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
3	ST5-Large	81.83	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
4	ST5-XL	81.66	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
5	ST5-Base	81.14	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
6	MPNet-multilingual	80.73	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
7	SGPT-5.8B-nli	80.53	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
8	MPNet	80.28	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
9	MiniLM-L12	79.8	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
10	SimCSE-BERT-sup	79.12	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
11	MiniLM-L6	78.92	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
12	Ada Similarity	78.6	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
13	GTR-XXL	78.38	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
14	GTR-Large	78.19	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
15	SGPT-5.8B-msmarco	78.1	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
16	GTR-XL	77.8	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
17	SGPT-BLOOM-7.1B-msmarco	77.74	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
18	GTR-Base	77.07	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
19	SGPT-2.7B-msmarco	76.83	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
20	coCondenser-msmarco	76.47	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
21	SGPT-1.3B-msmarco	75.74	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
22	SGPT-125M-nli	74.71	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
23	SimCSE-BERT-unsup	74.33	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
24	SGPT-125M-msmarco	73.41	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
25	LaBSE	70.8	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
26	Komninos	62.47	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
27	Glove	61.85	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
28	SPECTER	61.02	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
29	LASER2	55.32	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
30	BERT	54.36	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code

#1AnglE-UAESOTA
84.54
Spearman Correlation· 2023-09-22
AnglE-optimized Text Embeddings Code
#2ST5-XXLSOTA
82.63
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#3ST5-Large
81.83
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#4ST5-XL
81.66
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#5ST5-Base
81.14
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#6MPNet-multilingual
80.73
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#7SGPT-5.8B-nli
80.53
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#8MPNet
80.28
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#9MiniLM-L12
79.8
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#10SimCSE-BERT-sup
79.12
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#11MiniLM-L6
78.92
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#12Ada Similarity
78.6
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#13GTR-XXL
78.38
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#14GTR-Large
78.19
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#15SGPT-5.8B-msmarco
78.1
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#16GTR-XL
77.8
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#17SGPT-BLOOM-7.1B-msmarco
77.74
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#18GTR-Base
77.07
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#19SGPT-2.7B-msmarco
76.83
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#20coCondenser-msmarco
76.47
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#21SGPT-1.3B-msmarco
75.74
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#22SGPT-125M-nli
74.71
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#23SimCSE-BERT-unsup
74.33
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#24SGPT-125M-msmarco
73.41
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#25LaBSE
70.8
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#26Komninos
62.47
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#27Glove
61.85
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#28SPECTER
61.02
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#29LASER2
55.32
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#30BERT
54.36
Spearman Correlation· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code