Tom Ayoola, Shubhi Tyagi, Joseph Fisher, Christos Christodoulopoulos, Andrea Pierleoni
We introduce ReFinED, an efficient end-to-end entity linking model which uses fine-grained entity types and entity descriptions to perform linking. The model performs mention detection, fine-grained entity typing, and entity disambiguation for all mentions within a document in a single forward pass, making it more than 60 times faster than competitive existing approaches. ReFinED also surpasses state-of-the-art performance on standard entity linking datasets by an average of 3.7 F1. The model is capable of generalising to large-scale knowledge bases such as Wikidata (which has 15 times more entities than Wikipedia) and of zero-shot entity linking. The combination of speed, accuracy and scale makes ReFinED an effective and cost-efficient system for extracting entities from web-scale datasets, for which the model has been successfully deployed. Our code and pre-trained models are available at https://github.com/alexa/ReFinED
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Entity Linking | MSNBC | Micro-F1 | 71.8 | ReFinED |
| Entity Linking | MSNBC | Micro-F1 strong | 71.8 | ReFinED |
| Entity Linking | OKE-2016 | Micro-F1 | 59.5 | ReFinED |
| Entity Linking | OKE-2016 | Micro-F1 strong | 59.1 | ReFinED |
| Entity Linking | KORE50 | Micro-F1 | 65.9 | ReFinED |
| Entity Linking | KORE50 | Micro-F1 strong | 64.7 | ReFinED |
| Entity Linking | AIDA-CoNLL | Micro-F1 strong | 84 | ReFinED |
| Entity Linking | Derczynski | Micro-F1 | 50.7 | ReFinED |
| Entity Linking | Derczynski | Micro-F1 strong | 50.7 | ReFinED |
| Entity Linking | N3-Reuters-128 | Micro-F1 | 58.1 | ReFinED |
| Entity Linking | N3-Reuters-128 | Micro-F1 strong | 58.1 | ReFinED |
| Entity Linking | OKE-2015 | Micro-F1 | 65 | ReFinED |
| Entity Linking | OKE-2015 | Micro-F1 strong | 64.4 | ReFinED |
| Entity Linking | WebQSP-WD | F1 | 89.1 | ReFinED |
| Entity Typing | AIDA-CoNLL | Micro-F1 | 84 | ReFinED |
| Entity Disambiguation | MSNBC | Micro-F1 | 94.4 | ReFinED |
| Entity Disambiguation | WNED-WIKI | Micro-F1 | 88.7 | ReFinED |
| Entity Disambiguation | AIDA-CoNLL | In-KB Accuracy | 93.9 | ReFinED |
| Entity Disambiguation | ACE2004 | Micro-F1 | 91.6 | ReFinED |
| Entity Disambiguation | AQUAINT | Micro-F1 | 91.8 | ReFinED |
| Entity Disambiguation | WNED-CWEB | Micro-F1 | 79.4 | ReFinED |