Semantic Textual Similarity on Quora Question Pairs

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	ALICE	90.7	No	SMART: Robust and Efficient Fine-Tuning for Pre-...	2019-11-08	Code
2	RoBERTa-large 355M + Entailment as Few-shot Learner	89.2	No	Entailment as Few-Shot Learner	2021-04-29	Code
3	Charformer-Tall	88.5	No	Charformer: Fast Character Transformers via Grad...	2021-06-23	Code
4	RealFormer	88.28	No	RealFormer: Transformer Likes Residual Attention	2020-12-21	Code
5	FNet-Large	85	No	FNet: Mixing Tokens with Fourier Transforms	2021-05-09	Code
6	StructBERTRoBERTa ensemble	74.4	No	StructBERT: Incorporating Language Structures in...	2019-08-13	-
7	XLNet-Large (ensemble)	74.2	No	XLNet: Generalized Autoregressive Pretraining fo...	2019-06-19	Code
8	ASA + RoBERTa	73.7	No	Adversarial Self-Attention for Language Understa...	2022-06-25	Code
9	Snorkel MeTaL(ensemble)	73.1	No	Training Complex Models with Multi-Task Weak Sup...	2018-10-05	Code
10	MT-DNN	72.4	No	Multi-Task Deep Neural Networks for Natural Lang...	2019-01-31	Code
11	ASA + BERT-base	72.3	No	Adversarial Self-Attention for Language Understa...	2022-06-25	Code
12	BERT-LARGE	72.1	No	BERT: Pre-training of Deep Bidirectional Transfo...	2018-10-11	Code
13	SpanBERT	71.9	No	SpanBERT: Improving Pre-training by Representing...	2019-07-24	Code
14	TinyBERT	71.3	No	TinyBERT: Distilling BERT for Natural Language U...	2019-09-23	Code
15	ERNIE	71.2	No	ERNIE: Enhanced Language Representation with Inf...	2019-05-17	Code