Semantic Textual Similarity on STS15

Metric: Spearman Correlation (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Spearman Correlation▼	Extra Data	Paper	Date↕	Code
1	PromptEOL+CSE+LLaMA-30B	0.9004	No	Scaling Sentence Embeddings with Large Language ...	2023-07-31	Code
2	AnglE-LLaMA-13B	0.8956	No	AnglE-optimized Text Embeddings	2023-09-22	Code
3	PromptEOL+CSE+OPT-13B	0.8952	No	Scaling Sentence Embeddings with Large Language ...	2023-07-31	Code
4	PromptEOL+CSE+OPT-2.7B	0.8951	No	Scaling Sentence Embeddings with Large Language ...	2023-07-31	Code
5	AnglE-LLaMA-7B-v2	0.8943	No	AnglE-optimized Text Embeddings	2023-09-22	Code
6	Trans-Encoder-RoBERTa-large-cross (unsup.)	0.8863	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
7	Trans-Encoder-BERT-large-bi (unsup.)	0.8816	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
8	PromCSE-RoBERTa-large (0.355B)	0.8808	No	Improved Universal Sentence Embeddings with Prom...	2022-03-14	Code
9	SimCSE-RoBERTalarge	0.8666	No	SimCSE: Simple Contrastive Learning of Sentence ...	2021-04-18	Code
10	Trans-Encoder-RoBERTa-base-cross (unsup.)	0.8577	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
11	Trans-Encoder-BERT-base-bi (unsup.)	0.8508	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
12	Trans-Encoder-BERT-base-cross (unsup.)	0.8444	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
13	DiffCSE-BERT-base	0.839	No	DiffCSE: Difference-based Contrastive Learning f...	2022-04-21	Code
14	DiffCSE-RoBERTa-base	0.8281	No	DiffCSE: Difference-based Contrastive Learning f...	2022-04-21	Code
15	SRoBERTa-NLI-large	0.8185	No	Sentence-BERT: Sentence Embeddings using Siamese...	2019-08-27	Code
16	Mirror-BERT-base (unsup.)	0.814	No	Fast, Effective, and Self-Supervised: Transformi...	2021-04-16	Code
17	Dino (STSb/)	0.8049	No	Generating Datasets with Pretrained Language Mod...	2021-04-15	Code
18	Mirror-RoBERTa-base (unsup.)	0.798	No	Fast, Effective, and Self-Supervised: Transformi...	2021-04-16	Code
19	IS-BERT-NLI	0.7523	No	An Unsupervised Sentence Embedding Method by Mut...	2020-09-25	Code
20	BERTlarge-flow (target)	0.7492	No	On the Sentence Embeddings from Pre-trained Lang...	2020-11-02	Code

#1PromptEOL+CSE+LLaMA-30BSOTA
0.9004
Spearman Correlation· 2023-07-31
Scaling Sentence Embeddings with Large Language Models Code
#2AnglE-LLaMA-13B
0.8956
Spearman Correlation· 2023-09-22
AnglE-optimized Text Embeddings Code
#3PromptEOL+CSE+OPT-13B
0.8952
Spearman Correlation· 2023-07-31
Scaling Sentence Embeddings with Large Language Models Code
#4PromptEOL+CSE+OPT-2.7B
0.8951
Spearman Correlation· 2023-07-31
Scaling Sentence Embeddings with Large Language Models Code
#5AnglE-LLaMA-7B-v2
0.8943
Spearman Correlation· 2023-09-22
AnglE-optimized Text Embeddings Code
#6Trans-Encoder-RoBERTa-large-cross (unsup.)SOTA
0.8863
Spearman Correlation· 2021-09-27
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Code
#7Trans-Encoder-BERT-large-bi (unsup.)
0.8816
Spearman Correlation· 2021-09-27
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Code
#8PromCSE-RoBERTa-large (0.355B)
0.8808
Spearman Correlation· 2022-03-14
Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning Code
#9SimCSE-RoBERTalargeSOTA
0.8666
Spearman Correlation· 2021-04-18
SimCSE: Simple Contrastive Learning of Sentence Embeddings Code
#10Trans-Encoder-RoBERTa-base-cross (unsup.)
0.8577
Spearman Correlation· 2021-09-27
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Code
#11Trans-Encoder-BERT-base-bi (unsup.)
0.8508
Spearman Correlation· 2021-09-27
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Code
#12Trans-Encoder-BERT-base-cross (unsup.)
0.8444
Spearman Correlation· 2021-09-27
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Code
#13DiffCSE-BERT-base
0.839
Spearman Correlation· 2022-04-21
DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings Code
#14DiffCSE-RoBERTa-base
0.8281
Spearman Correlation· 2022-04-21
DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings Code
#15SRoBERTa-NLI-largeSOTA
0.8185
Spearman Correlation· 2019-08-27
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Code
#16Mirror-BERT-base (unsup.)
0.814
Spearman Correlation· 2021-04-16
Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders Code
#17Dino (STSb/)
0.8049
Spearman Correlation· 2021-04-15
Generating Datasets with Pretrained Language Models Code
#18Mirror-RoBERTa-base (unsup.)
0.798
Spearman Correlation· 2021-04-16
Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders Code
#19IS-BERT-NLI
0.7523
Spearman Correlation· 2020-09-25
An Unsupervised Sentence Embedding Method by Mutual Information Maximization Code
#20BERTlarge-flow (target)
0.7492
Spearman Correlation· 2020-11-02
On the Sentence Embeddings from Pre-trained Language Models Code