EMDR2

Reported on 5 benchmarks across 2 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing5 results

Question AnsweringonNatural Questions (short)
Exact Match· 2021-06-09
52.5
SOTA
End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering arXiv:2106.05346
Open-Domain Question AnsweringonNatural Questions (short)
Exact Match· 2021-06-09
52.5
SOTA
End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering arXiv:2106.05346
Question AnsweringonTriviaQA
EM· 2021-06-09
71.4
best: 87.5 (Claude 2 (few-shot, k=5))
End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering arXiv:2106.05346
Question AnsweringonWebQuestions
Exact Match· 2021-06-09
48.7
best: 57.7 (UniK-QA)
End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering arXiv:2106.05346
Open-Domain Question AnsweringonWebQuestions
Exact Match· 2021-06-09
48.7
best: 57.7 (UniK-QA)
End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering arXiv:2106.05346