Semantic Textual Similarity on STS13

Metric: Spearman Correlation (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	Spearman Correlation▼	Extra Data	Paper	Date↕	Code
1	AnglE-LLaMA-7B	0.9058	No	AnglE-optimized Text Embeddings	2023-09-22	Code
2	AnglE-LLaMA-7B-v2	0.9056	No	AnglE-optimized Text Embeddings	2023-09-22	Code
3	PromptEOL+CSE+LLaMA-30B	0.9025	No	Scaling Sentence Embeddings with Large Language ...	2023-07-31	Code
4	PromptEOL+CSE+OPT-13B	0.9024	No	Scaling Sentence Embeddings with Large Language ...	2023-07-31	Code
5	PromptEOL+CSE+OPT-2.7B	0.8964	No	Scaling Sentence Embeddings with Large Language ...	2023-07-31	Code
6	PromCSE-RoBERTa-large (0.355B)	0.8897	No	Improved Universal Sentence Embeddings with Prom...	2022-03-14	Code
7	Trans-Encoder-BERT-large-bi (unsup.)	0.8851	Yes	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
8	Trans-Encoder-BERT-large-cross (unsup.)	0.8831	Yes	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
9	Trans-Encoder-RoBERTa-large-cross (unsup.)	0.8831	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
10	SimCSE-RoBERTa-large	0.8727	No	SimCSE: Simple Contrastive Learning of Sentence ...	2021-04-18	Code
11	Trans-Encoder-BERT-base-cross (unsup.)	0.8559	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
12	Trans-Encoder-BERT-base-bi (unsup.)	0.851	No	Trans-Encoder: Unsupervised sentence-pair modell...	2021-09-27	Code
13	DiffCSE-BERT-base	0.8443	No	DiffCSE: Difference-based Contrastive Learning f...	2022-04-21	Code
14	DiffCSE-RoBERTa-base	0.8343	No	DiffCSE: Difference-based Contrastive Learning f...	2022-04-21	Code
15	SimCSE-BERT-base	0.8241	No	SimCSE: Simple Contrastive Learning of Sentence ...	2021-04-18	Code
16	Mirror-RoBERTa-base (unsup.)	0.819	No	Fast, Effective, and Self-Supervised: Transformi...	2021-04-16	Code
17	SimCSE-RoBERTa-base	0.8136	No	SimCSE: Simple Contrastive Learning of Sentence ...	2021-04-18	Code
18	Dino (STSb/̄🦕)	0.8126	No	Generating Datasets with Pretrained Language Mod...	2021-04-15	Code
19	Mirror-BERT-base (unsup.)	0.796	No	Fast, Effective, and Self-Supervised: Transformi...	2021-04-16	Code
20	SBERT-NLI-large	0.7846	No	Sentence-BERT: Sentence Embeddings using Siamese...	2019-08-27	Code
21	BERTlarge-flow (target)	0.7339	No	On the Sentence Embeddings from Pre-trained Lang...	2020-11-02	Code
22	IS-BERT-NLI	0.6924	No	An Unsupervised Sentence Embedding Method by Mut...	2020-09-25	Code

#1AnglE-LLaMA-7BSOTA
0.9058
Spearman Correlation· 2023-09-22
AnglE-optimized Text Embeddings Code
#2AnglE-LLaMA-7B-v2
0.9056
Spearman Correlation· 2023-09-22
AnglE-optimized Text Embeddings Code
#3PromptEOL+CSE+LLaMA-30BSOTA
0.9025
Spearman Correlation· 2023-07-31
Scaling Sentence Embeddings with Large Language Models Code
#4PromptEOL+CSE+OPT-13B
0.9024
Spearman Correlation· 2023-07-31
Scaling Sentence Embeddings with Large Language Models Code
#5PromptEOL+CSE+OPT-2.7B
0.8964
Spearman Correlation· 2023-07-31
Scaling Sentence Embeddings with Large Language Models Code
#6PromCSE-RoBERTa-large (0.355B)SOTA
0.8897
Spearman Correlation· 2022-03-14
Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning Code
#7Trans-Encoder-BERT-large-bi (unsup.)SOTA
0.8851
Spearman Correlation· Extra Data· 2021-09-27
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Code
#8Trans-Encoder-BERT-large-cross (unsup.)
0.8831
Spearman Correlation· Extra Data· 2021-09-27
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Code
#9Trans-Encoder-RoBERTa-large-cross (unsup.)
0.8831
Spearman Correlation· 2021-09-27
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Code
#10SimCSE-RoBERTa-largeSOTA
0.8727
Spearman Correlation· 2021-04-18
SimCSE: Simple Contrastive Learning of Sentence Embeddings Code
#11Trans-Encoder-BERT-base-cross (unsup.)
0.8559
Spearman Correlation· 2021-09-27
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Code
#12Trans-Encoder-BERT-base-bi (unsup.)
0.851
Spearman Correlation· 2021-09-27
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Code
#13DiffCSE-BERT-base
0.8443
Spearman Correlation· 2022-04-21
DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings Code
#14DiffCSE-RoBERTa-base
0.8343
Spearman Correlation· 2022-04-21
DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings Code
#15SimCSE-BERT-base
0.8241
Spearman Correlation· 2021-04-18
SimCSE: Simple Contrastive Learning of Sentence Embeddings Code
#16Mirror-RoBERTa-base (unsup.)SOTA
0.819
Spearman Correlation· 2021-04-16
Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders Code
#17SimCSE-RoBERTa-base
0.8136
Spearman Correlation· 2021-04-18
SimCSE: Simple Contrastive Learning of Sentence Embeddings Code
#18Dino (STSb/̄🦕)SOTA
0.8126
Spearman Correlation· 2021-04-15
Generating Datasets with Pretrained Language Models Code
#19Mirror-BERT-base (unsup.)
0.796
Spearman Correlation· 2021-04-16
Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders Code
#20SBERT-NLI-largeSOTA
0.7846
Spearman Correlation· 2019-08-27
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Code
#21BERTlarge-flow (target)
0.7339
Spearman Correlation· 2020-11-02
On the Sentence Embeddings from Pre-trained Language Models Code
#22IS-BERT-NLI
0.6924
Spearman Correlation· 2020-09-25
An Unsupervised Sentence Embedding Method by Mutual Information Maximization Code