Text Summarization on MTEB

Metric: Spearman Correlation (higher is better)

LeaderboardDataset

Loading chart...

Results

#	Model↕	Spearman Correlation▼	Extra Data	Paper	Date↕	Code
1	MPNet-multilingual	31.57	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
2	ST5-Base	31.39	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
3	SimCSE-BERT-unsup	31.15	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
4	MiniLM-L6	30.81	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
5	MiniLM-L12-multilingual	30.67	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
6	GTR-XXL	30.64	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
7	Komninos	30.49	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
8	Contriever	30.36	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
9	SGPT-125M-nli	30.26	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
10	GTR-XL	30.21	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
11	ST5-XXL	30.08	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
12	ST5-XL	29.91	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
13	BERT	29.82	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
14	GTR-Base	29.67	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
15	ST5-Large	29.64	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
16	coCondenser-msmarco	29.5	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
17	Glove	28.87	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
18	MiniLM-L12	27.9	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
19	SPECTER	27.66	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
20	MPNet	27.49	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
21	Ada Similarity	26.94	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
22	LASER2	26.8	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
23	SGPT-1.3B-msmarco	25.44	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
24	SGPT-BLOOM-7.1B-msmarco	24.99	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
25	SGPT-5.8B-msmarco	24.75	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code
26	SimCSE-BERT-sup	23.31	No	MTEB: Massive Text Embedding Benchmark	2022-10-13	Code