TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/BM25+CE

BM25+CE

Reported on 10 benchmarks across 4 tasks · 1 paper · 10 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

  • Question AnsweringonHotpotQA (BEIR)
    nDCG@10· 2021-04-17
    0.707
    best: 0.759 (monoT5-3B)
    SOTA
    BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsarXiv:2104.08663
  • Question AnsweringonNQ (BEIR)
    nDCG@10· 2021-04-17
    0.533
    best: 0.67 (Blended RAG)
    SOTA
    BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsarXiv:2104.08663
  • Question AnsweringonFiQA-2018 (BEIR)
    nDCG@10· 2021-04-17
    0.347
    best: 0.513 (monoT5-3B)
    SOTA
    BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsarXiv:2104.08663
  • Information RetrievalonMSMARCO (BEIR)
    nDCG@10· 2021-04-17
    0.413
    SOTA
    BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsarXiv:2104.08663

Medical3 results

  • Biomedical Information RetrievalonNFCorpus (BEIR)
    nDCG@10· 2021-04-17
    0.35
    best: 0.383 (monoT5-3B)
    SOTA
    BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsarXiv:2104.08663
  • Biomedical Information RetrievalonBioASQ (BEIR)
    nDCG@10· 2021-04-17
    0.523
    best: 0.579 (monoT5-3B)
    SOTA
    BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsarXiv:2104.08663
  • Biomedical Information RetrievalonTREC-COVID (BEIR)
    nDCG@10· 2021-04-17
    0.757
    best: 0.873 (SGPT-BE-5.8B)
    SOTA
    BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsarXiv:2104.08663

Miscellaneous3 results

  • Fact CheckingonCLIMATE-FEVER (BEIR)
    nDCG@10· 2021-04-17
    0.253
    best: 0.305 (SGPT-BE-5.8B)
    SOTA
    BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsarXiv:2104.08663
  • Fact CheckingonFEVER (BEIR)
    nDCG@10· 2021-04-17
    0.819
    best: 0.849 (monoT5-3B)
    SOTA
    BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsarXiv:2104.08663
  • Fact CheckingonSciFact (BEIR)
    nDCG@10· 2021-04-17
    0.688
    best: 0.777 (monoT5-3B)
    SOTA
    BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval ModelsarXiv:2104.08663