TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/SciBERT (SciVocab)

SciBERT (SciVocab)

Reported on 15 benchmarks across 8 tasks · 1 paper · 12 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing9 results

  • Relation ExtractiononSciERC
    F1· uses extra data· 2019-03-26
    74.64
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676
  • Relation ExtractiononJNLPBA
    F1· 2019-03-26
    76.09
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676
  • Named Entity Recognition (NER)onSciERC
    F1· uses extra data· 2019-03-26
    67.57
    best: 72.4 (SciDeBERTa v2)
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676
  • Named Entity Recognition (NER)onBC5CDR
    F1· uses extra data· 2019-03-26
    88.94
    best: 91.9 (BINDER)
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676
  • Text ClassificationonPaper Field
    F1· uses extra data· 2019-03-26
    65.71
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676
  • Text ClassificationonScienceCite
    F1· uses extra data· 2019-03-26
    84.99
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676
  • Dependency ParsingonGENIA - UAS
    F1· uses extra data· 2019-03-26
    92.46
    best: 92.84 (BiLSTM-CRF)
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676
  • Dependency ParsingonGENIA - LAS
    F1· uses extra data· 2019-03-26
    91.41
    best: 91.92 (BiLSTM-CRF)
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676
  • Named Entity Recognition (NER)onNCBI-disease
    F1· uses extra data· 2019-03-26
    86.45
    best: 89.71 (BioBERT)
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676

Medical2 results

  • Information ExtractiononEBM-NLP
    F1· uses extra data· 2019-03-26
    71.18
    best: 76.01 (VarMAE)
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676
  • Participant Intervention Comparison Outcome ExtractiononEBM-NLP
    F1· uses extra data· 2019-03-26
    71.18
    best: 76.01 (VarMAE)
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676

Other2 results

  • Sentence ClassificationonPaper Field
    F1· uses extra data· 2019-03-26
    65.71
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676
  • Sentence ClassificationonScienceCite
    F1· uses extra data· 2019-03-26
    84.99
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676

Methodology2 results

  • ClassificationonPaper Field
    F1· uses extra data· 2019-03-26
    65.71
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676
  • ClassificationonScienceCite
    F1· uses extra data· 2019-03-26
    84.99
    SOTA
    SciBERT: A Pretrained Language Model for Scientific TextarXiv:1903.10676