TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/WNUT-2020 Task 1 Overview: Extracting Entities and Relatio...

WNUT-2020 Task 1 Overview: Extracting Entities and Relations from Wet Lab Protocols

Jeniya Tabassum, Sydney Lee, Wei Xu, Alan Ritter

2020-10-27EMNLP (WNUT) 2020 11Relation Extractionnamed-entity-recognitionNamed Entity RecognitionNERNamed Entity Recognition (NER)
PaperPDFCode(official)

Abstract

This paper presents the results of the wet lab information extraction task at WNUT 2020. This task consisted of two sub tasks: (1) a Named Entity Recognition (NER) task with 13 participants and (2) a Relation Extraction (RE) task with 2 participants. We outline the task, data annotation process, corpus statistics, and provide a high-level overview of the participating systems for each sub task.

Results

TaskDatasetMetricValueModel
Relation ExtractionWNUT 2020F172.5Baseline
Relation ExtractionWNUT 2020Precision80.1Baseline
Relation ExtractionWNUT 2020Recall66.21Baseline
Named Entity Recognition (NER)WNUT 2020F165.73Baseline
Named Entity Recognition (NER)WNUT 2020Precision70.06Baseline
Named Entity Recognition (NER)WNUT 2020Recall61.91Baseline

Related Papers

DocIE@XLLM25: In-Context Learning for Information Extraction using Fully Synthetic Demonstrations2025-07-08Flippi: End To End GenAI Assistant for E-Commerce2025-07-08Selecting and Merging: Towards Adaptable and Scalable Named Entity Recognition with Large Language Models2025-06-28Multiple Streams of Relation Extraction: Enriching and Recalling in Transformers2025-06-25Chaining Event Spans for Temporal Relation Grounding2025-06-17Improving Named Entity Transcription with Contextual LLM-based Revision2025-06-12Summarization for Generative Relation Extraction in the Microbiome Domain2025-06-10Conservative Bias in Large Language Models: Measuring Relation Predictions2025-06-09