TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Natural Language Processing/Semantic Textual Similarity

Semantic Textual Similarity

40 benchmarks2381 papers

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Benchmarks

Semantic Textual Similarity on STS Benchmark

Spearman CorrelationPearson CorrelationDev Pearson CorrelationDev Spearman CorrelationAccuracy

Semantic Textual Similarity on MTEB

Spearman Correlation

Semantic Textual Similarity on SICK

Spearman Correlation

Semantic Textual Similarity on STS13

Spearman Correlation

Semantic Textual Similarity on STS14

Spearman Correlation

Semantic Textual Similarity on Quora Question Pairs

AccuracyF1Dev AccuracyDirect Intrinsic DimensionStructure Aware Intrinsic DimensionAccuarcyDev F1

Semantic Textual Similarity on STS12

Spearman Correlation

Semantic Textual Similarity on STS15

Spearman Correlation

Semantic Textual Similarity on STS16

Spearman Correlation

Semantic Textual Similarity on MRPC

F1Accuracy

Semantic Textual Similarity on MSRP

AccuracyF1

Semantic Textual Similarity on MRPC Dev

Accuracy

Semantic Textual Similarity on SentEval

SICK-RSICK-EMRPCSTS

Semantic Textual Similarity on 2017_test set

10 fold Cross validation

Semantic Textual Similarity on AP

MCC

Semantic Textual Similarity on IMDb

Accuracy

Semantic Textual Similarity on PIT

AP

Semantic Textual Similarity on Quora Question Pairs Dev

Val AccuracyVal F1 Score

Semantic Textual Similarity on SICK-R

Spearman Correlation

Semantic Textual Similarity on TURL

AP

Semantic Textual Similarity on Yelp

Accuracy

Semantic Textual Similarity on CxC

avg ± std

Semantic Textual Similarity on Translated SNLI Dataset in Marathi

1:1 Accuracy

Semantic Textual Similarity on WikiHop

Accuracy