TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Transfer Learning in Biomedical Natural Language Processin...

Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets

Yifan Peng, Shankai Yan, Zhiyong Lu

2019-06-13WS 2019 8Medical Named Entity RecognitionRelation ExtractionBenchmarkingNatural Language InferenceTransfer LearningSemantic SimilarityDocument ClassificationMedical Relation ExtractionDrug–drug Interaction ExtractionNamed Entity Recognition (NER)
PaperPDFCodeCodeCode(official)Code(official)

Results

TaskDatasetMetricValueModel
Relation ExtractionChemProtF174.4NCBI_BERT(large) (P)
Natural Language InferenceMedNLIAccuracy84NCBI_BERT(base) (P+M)
Language ModellingMedSTSPearson Correlation0.848NCBI_BERT(base) (P+M)
Language ModellingBIOSSESPearson Correlation0.9159999999999999NCBI_BERT(base) (P+M)
Medical Relation ExtractionDDI extraction 2013 corpusF179.9NCBI_BERT(large) (P)
Named Entity Recognition (NER)BC5CDR-chemicalF193.5NCBI_BERT(base) (P)
Named Entity Recognition (NER)BC5CDR-diseaseF186.6NCBI_BERT(base) (P)
Named Entity Recognition (NER)ShARe/CLEF eHealth corpusF10.792NCBI_BERT(base) (P+M)
Text ClassificationHOCF187.3NCBI_BERT(large) (P)
Sentence Pair ModelingMedSTSPearson Correlation0.848NCBI_BERT(base) (P+M)
Sentence Pair ModelingBIOSSESPearson Correlation0.9159999999999999NCBI_BERT(base) (P+M)
Document ClassificationHOCF187.3NCBI_BERT(large) (P)
ClassificationHOCF187.3NCBI_BERT(large) (P)
Semantic SimilarityMedSTSPearson Correlation0.848NCBI_BERT(base) (P+M)
Semantic SimilarityBIOSSESPearson Correlation0.9159999999999999NCBI_BERT(base) (P+M)

Related Papers

Visual Place Recognition for Large-Scale UAV Applications2025-07-20RaMen: Multi-Strategy Multi-Modal Learning for Bundle Construction2025-07-18Training Transformers with Enforced Lipschitz Constants2025-07-17Disentangling coincident cell events using deep transfer learning and compressive sensing2025-07-17MUPAX: Multidimensional Problem Agnostic eXplainable AI2025-07-17SemCSE: Semantic Contrastive Sentence Embeddings Using LLM-Generated Summaries For Scientific Abstracts2025-07-17DVFL-Net: A Lightweight Distilled Video Focal Modulation Network for Spatio-Temporal Action Recognition2025-07-16Best Practices for Large-Scale, Pixel-Wise Crop Mapping and Transfer Learning Workflows2025-07-16