TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/SGPT-CE-6.1B

SGPT-CE-6.1B

Reported on 10 benchmarks across 4 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

  • Question AnsweringonFiQA-2018 (BEIR)
    nDCG@10· 2022-02-17
    0.401
    best: 0.513 (monoT5-3B)
    SOTA
    SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904
  • Question AnsweringonHotpotQA (BEIR)
    nDCG@10· 2022-02-17
    0.699
    best: 0.759 (monoT5-3B)
    SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904
  • Question AnsweringonNQ (BEIR)
    nDCG@10· 2022-02-17
    0.401
    best: 0.67 (Blended RAG)
    SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904
  • Information RetrievalonMSMARCO (BEIR)
    nDCG@10· 2022-02-17
    0.29
    best: 0.413 (BM25+CE)
    SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904

Medical3 results

  • Biomedical Information RetrievalonBioASQ (BEIR)
    nDCG@10· 2022-02-17
    0.547
    best: 0.579 (monoT5-3B)
    SOTA
    SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904
  • Biomedical Information RetrievalonNFCorpus (BEIR)
    nDCG@10· 2022-02-17
    0.347
    best: 0.383 (monoT5-3B)
    SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904
  • Biomedical Information RetrievalonTREC-COVID (BEIR)
    nDCG@10· 2022-02-17
    0.791
    best: 0.873 (SGPT-BE-5.8B)
    SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904

Miscellaneous3 results

  • Fact CheckingonCLIMATE-FEVER (BEIR)
    nDCG@10· 2022-02-17
    0.161
    best: 0.305 (SGPT-BE-5.8B)
    SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904
  • Fact CheckingonFEVER (BEIR)
    nDCG@10· 2022-02-17
    0.725
    best: 0.849 (monoT5-3B)
    SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904
  • Fact CheckingonSciFact (BEIR)
    nDCG@10· 2022-02-17
    0.682
    best: 0.777 (monoT5-3B)
    SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904