Question Answering on TrecQA

Metric: MRR (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	MRR▼	Extra Data	Paper	Date↕	Code
1	RLAS-BIABC	0.998	No	RLAS-BIABC: A Reinforcement Learning-Based Answe...	2023-01-07	-
2	RLAS-BIABC	0.998	No	RLAS-BIABC: A Reinforcement Learning-Based Answe...	2023-01-07	-
3	TANDA DeBERTa-V3-Large + ALL	0.984	Yes	Structural Self-Supervised Objectives for Transf...	2023-09-15	Code
4	TANDA-RoBERTa (ASNQ, TREC-QA)	0.974	Yes	TANDA: Transfer and Adapt Pre-Trained Transforme...	2019-11-11	Code
5	RoBERTa-Base Joint + MSPP	0.952	No	Paragraph-based Transformer Pre-training for Mul...	2022-05-02	Code
6	RoBERTa-Base + PSD	0.951	No	Pre-training Transformer Models with Sentence-Le...	2022-05-20	-
7	DeBERTa-V3-Large + SSP	0.946	No	Pre-training Transformer Models with Sentence-Le...	2022-05-20	-
8	Contextual DeBERTa-V3-Large + SSP	0.945	Yes	Context-Aware Transformer Pre-Training for Answe...	2023-05-24	-
9	Comp-Clip + LM + LC	0.928	No	A Compare-Aggregate Model with Latent Clustering...	2019-05-30	-
10	HyperQA	0.825	No	Hyperbolic Representation Learning for Fast and ...	2017-07-25	Code
11	PWIN	0.8219	No	-	-	-
12	aNMM	0.811	No	aNMM: Ranking Short Answer Texts with Attention-...	2018-01-05	Code
13	CNN	0.785	No	Deep Learning for Answer Sentence Selection	2014-12-04	Code
14	NLP-Capsule	0.7416	No	Towards Scalable and Reliable Capsule Networks f...	2019-06-06	Code

#1RLAS-BIABCSOTA
0.998
MRR· 2023-01-07
RLAS-BIABC: A Reinforcement Learning-Based Answer Selection Using the BERT Model Boosted by an Improved ABC Algorithm
#2RLAS-BIABC
0.998
MRR· 2023-01-07
RLAS-BIABC: A Reinforcement Learning-Based Answer Selection Using the BERT Model Boosted by an Improved ABC Algorithm
#3TANDA DeBERTa-V3-Large + ALL
0.984
MRR· Extra Data· 2023-09-15
Structural Self-Supervised Objectives for Transformers Code
#4TANDA-RoBERTa (ASNQ, TREC-QA)SOTA
0.974
MRR· Extra Data· 2019-11-11
TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection Code
#5RoBERTa-Base Joint + MSPP
0.952
MRR· 2022-05-02
Paragraph-based Transformer Pre-training for Multi-Sentence Inference Code
#6RoBERTa-Base + PSD
0.951
MRR· 2022-05-20
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection
#7DeBERTa-V3-Large + SSP
0.946
MRR· 2022-05-20
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection
#8Contextual DeBERTa-V3-Large + SSP
0.945
MRR· Extra Data· 2023-05-24
Context-Aware Transformer Pre-Training for Answer Sentence Selection
#9Comp-Clip + LM + LCSOTA
0.928
MRR· 2019-05-30
A Compare-Aggregate Model with Latent Clustering for Answer Selection
#10HyperQASOTA
0.825
MRR· 2017-07-25
Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering Code
#11PWIN
0.8219
MRR
No paper
#12aNMM
0.811
MRR· 2018-01-05
aNMM: Ranking Short Answer Texts with Attention-Based Neural Matching Model Code
#13CNNSOTA
0.785
MRR· 2014-12-04
Deep Learning for Answer Sentence Selection Code
#14NLP-Capsule
0.7416
MRR· 2019-06-06
Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications Code