Semantic Textual Similarity on Quora Question Pairs

Metric: F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	F1▼	Extra Data	Paper	Date↕	Code
1	ALICE	90.7	No	SMART: Robust and Efficient Fine-Tuning for Pre-...	2019-11-08	Code
2	RoBERTa-large 355M + Entailment as Few-shot Learner	89.2	No	Entailment as Few-Shot Learner	2021-04-29	Code
3	Charformer-Tall	88.5	No	Charformer: Fast Character Transformers via Grad...	2021-06-23	Code
4	RealFormer	88.28	No	RealFormer: Transformer Likes Residual Attention	2020-12-21	Code
5	FNet-Large	85	No	FNet: Mixing Tokens with Fourier Transforms	2021-05-09	Code
6	StructBERTRoBERTa ensemble	74.4	No	StructBERT: Incorporating Language Structures in...	2019-08-13	-
7	XLNet-Large (ensemble)	74.2	No	XLNet: Generalized Autoregressive Pretraining fo...	2019-06-19	Code
8	ASA + RoBERTa	73.7	No	Adversarial Self-Attention for Language Understa...	2022-06-25	Code
9	Snorkel MeTaL(ensemble)	73.1	No	Training Complex Models with Multi-Task Weak Sup...	2018-10-05	Code
10	MT-DNN	72.4	No	Multi-Task Deep Neural Networks for Natural Lang...	2019-01-31	Code
11	ASA + BERT-base	72.3	No	Adversarial Self-Attention for Language Understa...	2022-06-25	Code
12	BERT-LARGE	72.1	No	BERT: Pre-training of Deep Bidirectional Transfo...	2018-10-11	Code
13	SpanBERT	71.9	No	SpanBERT: Improving Pre-training by Representing...	2019-07-24	Code
14	TinyBERT	71.3	No	TinyBERT: Distilling BERT for Natural Language U...	2019-09-23	Code
15	ERNIE	71.2	No	ERNIE: Enhanced Language Representation with Inf...	2019-05-17	Code

#1ALICESOTA
90.7
F1· 2019-11-08
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization Code
#2RoBERTa-large 355M + Entailment as Few-shot Learner
89.2
F1· 2021-04-29
Entailment as Few-Shot Learner Code
#3Charformer-Tall
88.5
F1· 2021-06-23
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization Code
#4RealFormer
88.28
F1· 2020-12-21
RealFormer: Transformer Likes Residual Attention Code
#5FNet-Large
85
F1· 2021-05-09
FNet: Mixing Tokens with Fourier Transforms Code
#6StructBERTRoBERTa ensembleSOTA
74.4
F1· 2019-08-13
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding
#7XLNet-Large (ensemble)SOTA
74.2
F1· 2019-06-19
XLNet: Generalized Autoregressive Pretraining for Language Understanding Code
#8ASA + RoBERTa
73.7
F1· 2022-06-25
Adversarial Self-Attention for Language Understanding Code
#9Snorkel MeTaL(ensemble)SOTA
73.1
F1· 2018-10-05
Training Complex Models with Multi-Task Weak Supervision Code
#10MT-DNN
72.4
F1· 2019-01-31
Multi-Task Deep Neural Networks for Natural Language Understanding Code
#11ASA + BERT-base
72.3
F1· 2022-06-25
Adversarial Self-Attention for Language Understanding Code
#12BERT-LARGE
72.1
F1· 2018-10-11
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Code
#13SpanBERT
71.9
F1· 2019-07-24
SpanBERT: Improving Pre-training by Representing and Predicting Spans Code
#14TinyBERT
71.3
F1· 2019-09-23
TinyBERT: Distilling BERT for Natural Language Understanding Code
#15ERNIE
71.2
F1· 2019-05-17
ERNIE: Enhanced Language Representation with Informative Entities Code