Michael Schlichtkrull, Thomas N. Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, Max Welling
Knowledge graphs enable a wide variety of applications, including question answering and information retrieval. Despite the great effort invested in their creation and maintenance, even the largest (e.g., Yago, DBPedia or Wikidata) remain incomplete. We introduce Relational Graph Convolutional Networks (R-GCNs) and apply them to two standard knowledge base completion tasks: Link prediction (recovery of missing facts, i.e. subject-predicate-object triples) and entity classification (recovery of missing entity attributes). R-GCNs are related to a recent class of neural networks operating on graphs, and are developed specifically to deal with the highly multi-relational data characteristic of realistic knowledge bases. We demonstrate the effectiveness of R-GCNs as a stand-alone model for entity classification. We further show that factorization models for link prediction such as DistMult can be significantly improved by enriching them with an encoder model to accumulate evidence over multiple inference steps in the relational graph, demonstrating a large improvement of 29.8% on FB15k-237 over a decoder-only baseline.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Node Classification | AIFB | Accuracy | 95.83 | R-GCN |
| Node Classification | MUTAG | Accuracy | 73.23 | R-GCN |
| Node Classification | AM | Accuracy | 89.29 | R-GCN |
| Node Classification | BGS | Accuracy | 83.1 | R-GCN |
| Node Classification | IMDB (Heterogeneous Node Classification) | Macro-F1 | 58.85 | RGCN |
| Node Classification | IMDB (Heterogeneous Node Classification) | Micro-F1 | 62.05 | RGCN |
| Node Classification | Freebase (Heterogeneous Node Classification) | Macro-F1 | 46.78 | RGCN |
| Node Classification | Freebase (Heterogeneous Node Classification) | Micro-F1 | 58.33 | RGCN |
| Node Classification | DBLP (Heterogeneous Node Classification) | Macro-F1 | 91.52 | RGCN |
| Node Classification | DBLP (Heterogeneous Node Classification) | Micro-F1 | 92.07 | RGCN |
| Node Classification | ACM (Heterogeneous Node Classification) | Macro-F1 | 91.55 | RGCN |
| Node Classification | ACM (Heterogeneous Node Classification) | Micro-F1 | 91.41 | RGCN |
| Node Classification | OAG-Venue | MRR | 31.51 | RGCN |
| Node Classification | OAG-Venue | NDCG | 48.93 | RGCN |
| Node Classification | OAG-L1-Field | MRR | 84.92 | RGCN |
| Node Classification | OAG-L1-Field | NDCG | 85.91 | RGCN |
| Node Property Prediction | ogbn-mag | Number of params | 154373028 | R-GSN |
| Node Property Prediction | ogbn-mag | Number of params | 154366772 | Full-batch R-GCN |