Jue Wang, Wei Lu
Named entity recognition and relation extraction are two important fundamental problems. Joint learning algorithms have been proposed to solve both tasks simultaneously, and many of them cast the joint task as a table-filling problem. However, they typically focused on learning a single encoder (usually learning representation in the form of a table) to capture information required for both tasks within the same space. We argue that it can be beneficial to design two distinct encoders to capture such two different types of information in the learning process. In this work, we propose the novel {\em table-sequence encoders} where two different encoders -- a table encoder and a sequence encoder are designed to help each other in the representation learning process. Our experiments confirm the advantages of having {\em two} encoders over {\em one} encoder. On several standard datasets, our model shows significant improvements over existing approaches.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Relation Extraction | ACE 2005 | NER Micro F1 | 89.5 | Table-Sequence |
| Relation Extraction | ACE 2005 | RE Micro F1 | 67.6 | Table-Sequence |
| Relation Extraction | ACE 2005 | RE+ Micro F1 | 64.3 | Table-Sequence |
| Relation Extraction | ACE 2004 | NER Micro F1 | 88.6 | Table-Sequence |
| Relation Extraction | ACE 2004 | RE Micro F1 | 63.3 | Table-Sequence |
| Relation Extraction | ACE 2004 | RE+ Micro F1 | 59.6 | Table-Sequence |
| Relation Extraction | Adverse Drug Events (ADE) Corpus | NER Macro F1 | 89.7 | Table-Sequence |
| Relation Extraction | Adverse Drug Events (ADE) Corpus | RE Macro F1 | 80.1 | Table-Sequence |
| Relation Extraction | Adverse Drug Events (ADE) Corpus | RE+ Macro F1 | 80.1 | Table-Sequence |
| Relation Extraction | CoNLL04 | NER Macro F1 | 86.9 | Table-Sequence |
| Relation Extraction | CoNLL04 | NER Micro F1 | 90.1 | Table-Sequence |
| Relation Extraction | CoNLL04 | RE+ Macro F1 | 75.4 | Table-Sequence |
| Relation Extraction | CoNLL04 | RE+ Micro F1 | 73.6 | Table-Sequence |
| Relation Extraction | FewRel | Avg. F1 | 6.37 | TableSequence |
| Relation Extraction | Wiki-ZSL | Avg. F1 | 6.4 | TableSequence |