SGPT-1.3B-msmarco

Reported on 6 benchmarks across 6 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing3 results

Semantic Textual SimilarityonMTEB
Spearman Correlation· 2022-10-13
75.74
best: 84.54 (AnglE-UAE)
MTEB: Massive Text Embedding Benchmark arXiv:2210.07316
Text ClusteringonMTEB
V-Measure· 2022-10-13
39.92
best: 43.71 (ST5-XXL)
MTEB: Massive Text Embedding Benchmark arXiv:2210.07316
Text ClassificationonMTEB
Accuracy· 2022-10-13
66.52
best: 73.42 (ST5-XXL)
MTEB: Massive Text Embedding Benchmark arXiv:2210.07316

Methodology2 results

RetrievalonMTEB
nDCG@10· 2022-10-13
44.49
best: 50.25 (SGPT-5.8B-msmarco)
MTEB: Massive Text Embedding Benchmark arXiv:2210.07316
ClassificationonMTEB
Accuracy· 2022-10-13
66.52
best: 73.42 (ST5-XXL)
MTEB: Massive Text Embedding Benchmark arXiv:2210.07316

Knowledge Base1 result

Text SummarizationonMTEB
Spearman Correlation· 2022-10-13
25.44
best: 31.57 (MPNet-multilingual)
MTEB: Massive Text Embedding Benchmark arXiv:2210.07316