TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/BioMedGPT-10B

BioMedGPT-10B

Reported on 15 benchmarks across 1 task · 1 paper · 12 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing15 results

  • Question AnsweringonUniProtQA
    BLEU-2· 2023-08-18
    0.571
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonUniProtQA
    BLEU-4· 2023-08-18
    0.535
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonUniProtQA
    MEATOR· 2023-08-18
    0.754
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonUniProtQA
    ROUGE-1· 2023-08-18
    0.743
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonUniProtQA
    ROUGE-2· 2023-08-18
    0.759
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonUniProtQA
    ROUGE-L· 2023-08-18
    0.622
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonPubChemQA
    BLEU-2· 2023-08-18
    0.234
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonPubChemQA
    BLEU-4· 2023-08-18
    0.141
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonPubChemQA
    MEATOR· 2023-08-18
    0.308
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonPubChemQA
    ROUGE-1· 2023-08-18
    0.386
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonPubChemQA
    ROUGE-2· 2023-08-18
    0.206
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonPubChemQA
    ROUGE-L· 2023-08-18
    0.332
    SOTA
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonPubMedQA
    Accuracy· 2023-08-18
    76.1
    best: 81.6 (Meditron-70B (CoT + SC))
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonMedQA
    Accuracy· 2023-08-18
    50.4
    best: 91.1 (Med-Gemini)
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442
  • Question AnsweringonMedMCQA
    Test Set (Acc-%)· 2023-08-18
    0.514
    best: 0.723 (Med-PaLM 2 (ER))
    BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicinearXiv:2308.09442