Retrieval on MTEB

Metric: nDCG@10 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	nDCG@10▼	Augmentations	Paper	Date↕	Code
1	SGPT-5.8B-msmarco	50.25	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
2	GTR-XXL	48.48	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
3	SGPT-BLOOM-7.1B-msmarco	48.21	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
4	GTR-XL	47.96	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
5	GTR-Large	47.42	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
6	SGPT-2.7B-msmarco	46.54	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
7	GTR-Base	44.67	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
8	SGPT-1.3B-msmarco	44.49	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
9	MPNet	43.81	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
10	MiniLM-L12	42.69	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
11	ST5-XXL	42.24	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
12	MiniLM-L6	41.95	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
13	Contriever	41.88	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
14	ST5-XL	38.47	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
15	SGPT-125M-msmarco	37.04	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
16	ST5-Large	36.71	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
17	MPNet-multilingual	35.34	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
18	ST5-Base	33.63	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
19	coCondenser-msmarco	32.96	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
20	MiniLM-L12-multilingual	32.45	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
21	SGPT-5.8B-nli	32.34	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
22	SimCSE-BERT-sup	21.82	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
23	Glove	21.62	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
24	Komninos	21.22	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
25	SGPT-125M-nli	20.9	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
26	SimCSE-BERT-unsup	20.29	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
27	LaBSE	18.99	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
28	SPECTER	15.88	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
29	BERT	10.59	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
30	LASER2	7.93	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code

#1SGPT-5.8B-msmarcoSOTA
50.25
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#2GTR-XXL
48.48
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#3SGPT-BLOOM-7.1B-msmarco
48.21
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#4GTR-XL
47.96
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#5GTR-Large
47.42
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#6SGPT-2.7B-msmarco
46.54
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#7GTR-Base
44.67
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#8SGPT-1.3B-msmarco
44.49
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#9MPNet
43.81
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#10MiniLM-L12
42.69
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#11ST5-XXL
42.24
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#12MiniLM-L6
41.95
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#13Contriever
41.88
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#14ST5-XL
38.47
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#15SGPT-125M-msmarco
37.04
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#16ST5-Large
36.71
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#17MPNet-multilingual
35.34
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#18ST5-Base
33.63
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#19coCondenser-msmarco
32.96
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#20MiniLM-L12-multilingual
32.45
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#21SGPT-5.8B-nli
32.34
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#22SimCSE-BERT-sup
21.82
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#23Glove
21.62
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#24Komninos
21.22
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#25SGPT-125M-nli
20.9
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#26SimCSE-BERT-unsup
20.29
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#27LaBSE
18.99
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#28SPECTER
15.88
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#29BERT
10.59
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code
#30LASER2
7.93
nDCG@10· 2022-10-13
MTEB: Massive Text Embedding Benchmark Code