Question Answering on TrecQA

Metric: MAP (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	MAP▼	Extra Data	Paper	Date↕	Code
1	TANDA DeBERTa-V3-Large + ALL	0.954	Yes	Structural Self-Supervised Objectives for Transf...	2023-09-15	Code
2	TANDA-RoBERTa (ASNQ, TREC-QA)	0.943	Yes	TANDA: Transfer and Adapt Pre-Trained Transforme...	2019-11-11	Code
3	DeBERTa-V3-Large + SSP	0.923	No	Pre-training Transformer Models with Sentence-Le...	2022-05-20	-
4	Contextual DeBERTa-V3-Large + SSP	0.919	Yes	Context-Aware Transformer Pre-Training for Answe...	2023-05-24	-
5	RLAS-BIABC	0.913	No	RLAS-BIABC: A Reinforcement Learning-Based Answe...	2023-01-07	-
6	RLAS-BIABC	0.913	No	RLAS-BIABC: A Reinforcement Learning-Based Answe...	2023-01-07	-
7	RoBERTa-Base Joint + MSPP	0.911	No	Paragraph-based Transformer Pre-training for Mul...	2022-05-02	Code
8	RoBERTa-Base + PSD	0.903	No	Pre-training Transformer Models with Sentence-Le...	2022-05-20	-
9	Comp-Clip + LM + LC	0.868	No	A Compare-Aggregate Model with Latent Clustering...	2019-05-30	-
10	NLP-Capsule	0.7773	No	Towards Scalable and Reliable Capsule Networks f...	2019-06-06	Code
11	HyperQA	0.77	No	Hyperbolic Representation Learning for Fast and ...	2017-07-25	Code
12	PWIN	0.7588	No	-	-	-
13	aNMM	0.75	No	aNMM: Ranking Short Answer Texts with Attention-...	2018-01-05	Code
14	CNN	0.711	No	Deep Learning for Answer Sentence Selection	2014-12-04	Code

#1TANDA DeBERTa-V3-Large + ALLSOTA
0.954
MAP· Extra Data· 2023-09-15
Structural Self-Supervised Objectives for Transformers Code
#2TANDA-RoBERTa (ASNQ, TREC-QA)SOTA
0.943
MAP· Extra Data· 2019-11-11
TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection Code
#3DeBERTa-V3-Large + SSP
0.923
MAP· 2022-05-20
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection
#4Contextual DeBERTa-V3-Large + SSP
0.919
MAP· Extra Data· 2023-05-24
Context-Aware Transformer Pre-Training for Answer Sentence Selection
#5RLAS-BIABC
0.913
MAP· 2023-01-07
RLAS-BIABC: A Reinforcement Learning-Based Answer Selection Using the BERT Model Boosted by an Improved ABC Algorithm
#6RLAS-BIABC
0.913
MAP· 2023-01-07
RLAS-BIABC: A Reinforcement Learning-Based Answer Selection Using the BERT Model Boosted by an Improved ABC Algorithm
#7RoBERTa-Base Joint + MSPP
0.911
MAP· 2022-05-02
Paragraph-based Transformer Pre-training for Multi-Sentence Inference Code
#8RoBERTa-Base + PSD
0.903
MAP· 2022-05-20
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection
#9Comp-Clip + LM + LCSOTA
0.868
MAP· 2019-05-30
A Compare-Aggregate Model with Latent Clustering for Answer Selection
#10NLP-Capsule
0.7773
MAP· 2019-06-06
Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications Code
#11HyperQASOTA
0.77
MAP· 2017-07-25
Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering Code
#12PWIN
0.7588
MAP
No paper
#13aNMM
0.75
MAP· 2018-01-05
aNMM: Ranking Short Answer Texts with Attention-Based Neural Matching Model Code
#14CNNSOTA
0.711
MAP· 2014-12-04
Deep Learning for Answer Sentence Selection Code