Ad-Hoc Information Retrieval on TREC Robust04

Metric: nDCG@20 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	nDCG@20▼	Extra Data	Paper	Date↕	Code
1	monoT5-3B (zero-shot)	0.6091	No	Document Ranking with a Pretrained Sequence-to-S...	2020-03-14	Code
2	PARADE(ELECTRA)	0.5399	No	PARADE: Passage Representation Aggregation for D...	2020-08-20	Code
3	CEDR-KNRM	0.5381	No	CEDR: Contextualized Embeddings for Document Ran...	2019-04-15	Code
4	PARADE(BERT)	0.5252	No	PARADE: Passage Representation Aggregation for D...	2020-08-20	Code
5	BERT-MaxP	0.469	No	Deeper Text Understanding for IR with Contextual...	2019-05-22	Code
6	BERT-SumP	0.467	No	Deeper Text Understanding for IR with Contextual...	2019-05-22	Code
7	POSIT-DRMM-MV	0.464	No	Deep Relevance Ranking Using Enhanced Document-Q...	2018-09-05	Code
8	Vanilla BERT	0.4541	No	CEDR: Contextualized Embeddings for Document Ran...	2019-04-15	Code
9	NPRF-DRMM	0.4502	No	NPRF: A Neural Pseudo Relevance Feedback Framewo...	2018-10-30	Code
10	PACRR	0.445	No	Deep Relevance Ranking Using Enhanced Document-Q...	2018-09-05	Code
11	BERT-FirstP	0.444	No	Deeper Text Understanding for IR with Contextual...	2019-05-22	Code
12	SNRM-PRF	0.4391	No	-	-	Code
13	NPRF-KNRM	0.4327	No	NPRF: A Neural Pseudo Relevance Feedback Framewo...	2018-10-30	Code
14	SNRM	0.431	No	-	-	Code
15	DRMM	0.431	No	A Deep Relevance Matching Model for Ad-hoc Retri...	2017-11-23	Code
16	KNRM	0.3989	No	NPRF: A Neural Pseudo Relevance Feedback Framewo...	2018-10-30	Code

#1monoT5-3B (zero-shot)SOTA
0.6091
nDCG@20· 2020-03-14
Document Ranking with a Pretrained Sequence-to-Sequence Model Code
#2PARADE(ELECTRA)
0.5399
nDCG@20· 2020-08-20
PARADE: Passage Representation Aggregation for Document Reranking Code
#3CEDR-KNRMSOTA
0.5381
nDCG@20· 2019-04-15
CEDR: Contextualized Embeddings for Document Ranking Code
#4PARADE(BERT)
0.5252
nDCG@20· 2020-08-20
PARADE: Passage Representation Aggregation for Document Reranking Code
#5BERT-MaxP
0.469
nDCG@20· 2019-05-22
Deeper Text Understanding for IR with Contextual Neural Language Modeling Code
#6BERT-SumP
0.467
nDCG@20· 2019-05-22
Deeper Text Understanding for IR with Contextual Neural Language Modeling Code
#7POSIT-DRMM-MVSOTA
0.464
nDCG@20· 2018-09-05
Deep Relevance Ranking Using Enhanced Document-Query Interactions Code
#8Vanilla BERT
0.4541
nDCG@20· 2019-04-15
CEDR: Contextualized Embeddings for Document Ranking Code
#9NPRF-DRMM
0.4502
nDCG@20· 2018-10-30
NPRF: A Neural Pseudo Relevance Feedback Framework for Ad-hoc Information Retrieval Code
#10PACRR
0.445
nDCG@20· 2018-09-05
Deep Relevance Ranking Using Enhanced Document-Query Interactions Code
#11BERT-FirstP
0.444
nDCG@20· 2019-05-22
Deeper Text Understanding for IR with Contextual Neural Language Modeling Code
#12SNRM-PRF
0.4391
nDCG@20
No paperCode
#13NPRF-KNRM
0.4327
nDCG@20· 2018-10-30
NPRF: A Neural Pseudo Relevance Feedback Framework for Ad-hoc Information Retrieval Code
#14SNRM
0.431
nDCG@20
No paperCode
#15DRMMSOTA
0.431
nDCG@20· 2017-11-23
A Deep Relevance Matching Model for Ad-hoc Retrieval Code
#16KNRM
0.3989
nDCG@20· 2018-10-30
NPRF: A Neural Pseudo Relevance Feedback Framework for Ad-hoc Information Retrieval Code