Metric: F1 (higher is better)
| # | Model↕ | F1▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | VarMAE | 76.01 | No | VarMAE: Pre-training of Variational Masked Autoe... | 2022-11-01 | - |
| 2 | PubMedBERT uncased | 73.38 | Yes | Domain-Specific Language Model Pretraining for B... | 2020-07-31 | Code |
| 3 | SciBERT (SciVocab) | 71.18 | Yes | SciBERT: A Pretrained Language Model for Scienti... | 2019-03-26 | Code |
| 4 | SciBERT (Base Vocab) | 70.82 | Yes | SciBERT: A Pretrained Language Model for Scienti... | 2019-03-26 | Code |
| 5 | bi-LSTM | 66.3 | No | A Corpus with Multi-Level Annotations of Patient... | 2018-06-11 | Code |