TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/PubMedBERT uncased

PubMedBERT uncased

Reported on 14 benchmarks across 9 tasks · 1 paper · 12 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing10 results

  • Relation ExtractiononGAD
    Micro F1· 2020-07-31
    82.34
    best: 84.9 (BioLinkBERT (large))
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779
  • Relation ExtractiononDDI
    Micro F1· 2020-07-31
    82.36
    best: 83.35 (BioLinkBERT (large))
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779
  • Relation ExtractiononChemProt
    Micro F1· 2020-07-31
    77.24
    best: 79.98 (BioLinkBERT (large))
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779
  • Question AnsweringonBioASQ
    Accuracy· 2020-07-31
    87.56
    best: 94.8 (BioLinkBERT (large))
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779
  • Named Entity Recognition (NER)onBC2GM
    F1· 2020-07-31
    84.52
    best: 88.75 (Spark NLP)
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779
  • Named Entity Recognition (NER)onJNLPBA
    F1· 2020-07-31
    79.1
    best: 82 (KeBioLM)
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779
  • Text ClassificationonHOC
    Micro F1· 2020-07-31
    82.32
    best: 85.12 (BioGPT)
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779
  • Document ClassificationonHOC
    Micro F1· 2020-07-31
    82.32
    best: 85.12 (BioGPT)
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779
  • Question AnsweringonPubMedQA
    Accuracy· 2020-07-31
    55.84
    best: 81.6 (Meditron-70B (CoT + SC))
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779
  • Named Entity Recognition (NER)onNCBI-disease
    F1· 2020-07-31
    87.82
    best: 89.71 (BioBERT)
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779

Medical3 results

  • Information ExtractiononEBM-NLP
    F1· uses extra data· 2020-07-31
    73.38
    best: 76.01 (VarMAE)
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779
  • Participant Intervention Comparison Outcome ExtractiononEBM-NLP
    F1· uses extra data· 2020-07-31
    73.38
    best: 76.01 (VarMAE)
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779
  • Biomedical Information RetrievalonEBM PICO
    Macro F1 word level· 2020-07-31
    73.38
    best: 74.19 (BioLinkBERT (large))
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779

Methodology1 result

  • ClassificationonHOC
    Micro F1· 2020-07-31
    82.32
    best: 85.12 (BioGPT)
    SOTA
    Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779