Semantic Textual Similarity on STS15

Metric: Spearman Correlation (higher is better)

LeaderboardDataset

Loading chart...

Results

#	Model↕	Spearman Correlation▼	Extra Data	Paper	Date↕	Code
1	PromptEOL+CSE+LLaMA-30B	0.9004	No	Scaling Sentence Embeddings with Large Language ...	2023-07-31	Code
2	AnglE-LLaMA-13B	0.8956	No	AnglE-optimized Text Embeddings	2023-09-22	Code
3	PromptEOL+CSE+OPT-13B	0.8952	No	Scaling Sentence Embeddings with Large Language ...	2023-07-31	Code
4	PromptEOL+CSE+OPT-2.7B	0.8951	No	Scaling Sentence Embeddings with Large Language ...	2023-07-31	Code
5	AnglE-LLaMA-7B-v2	0.8943	No	AnglE-optimized Text Embeddings	2023-09-22	Code
6	Trans-Encoder-RoBERTa-large-cross (unsup.)	0.8863	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
7	Trans-Encoder-BERT-large-bi (unsup.)	0.8816	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
8	PromCSE-RoBERTa-large (0.355B)	0.8808	No	Improved Universal Sentence Embeddings with Prom...	2022-03-14	Code
9	SimCSE-RoBERTalarge	0.8666	No	SimCSE: Simple Contrastive Learning of Sentence ...	2021-04-18	Code
10	Trans-Encoder-RoBERTa-base-cross (unsup.)	0.8577	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
11	Trans-Encoder-BERT-base-bi (unsup.)	0.8508	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
12	Trans-Encoder-BERT-base-cross (unsup.)	0.8444	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
13	DiffCSE-BERT-base	0.839	No	DiffCSE: Difference-based Contrastive Learning f...	2022-04-21	Code
14	DiffCSE-RoBERTa-base	0.8281	No	DiffCSE: Difference-based Contrastive Learning f...	2022-04-21	Code
15	SRoBERTa-NLI-large	0.8185	No	Sentence-BERT: Sentence Embeddings using Siamese...	2019-08-27	Code
16	Mirror-BERT-base (unsup.)	0.814	No	Fast, Effective, and Self-Supervised: Transformi...	2021-04-16	Code
17	Dino (STSb/)	0.8049	No	Generating Datasets with Pretrained Language Mod...	2021-04-15	Code
18	Mirror-RoBERTa-base (unsup.)	0.798	No	Fast, Effective, and Self-Supervised: Transformi...	2021-04-16	Code
19	IS-BERT-NLI	0.7523	No	An Unsupervised Sentence Embedding Method by Mut...	2020-09-25	Code
20	BERTlarge-flow (target)	0.7492	No	On the Sentence Embeddings from Pre-trained Lang...	2020-11-02	Code