Yushi Bai, Xin Lv, Juanzi Li, Lei Hou
Answering complex logical queries on incomplete knowledge graphs is a challenging task, and has been widely studied. Embedding-based methods require training on complex queries, and cannot generalize well to out-of-distribution query structures. Recent work frames this task as an end-to-end optimization problem, and it only requires a pretrained link predictor. However, due to the exponentially large combinatorial search space, the optimal solution can only be approximated, limiting the final accuracy. In this work, we propose QTO (Query Computation Tree Optimization) that can efficiently find the exact optimal solution. QTO finds the optimal solution by a forward-backward propagation on the tree-like computation graph, i.e., query computation tree. In particular, QTO utilizes the independence encoded in the query computation tree to reduce the search space, where only local computations are involved during the optimization procedure. Experiments on 3 datasets show that QTO obtains state-of-the-art performance on complex query answering, outperforming previous best results by an average of 22%. Moreover, QTO can interpret the intermediate solutions for each of the one-hop atoms in the query with over 90% accuracy. The code of our paper is at https://github.com/bys0318/QTO.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Knowledge Graphs | FB15k | MRR 1p | 0.895 | QTO |
| Knowledge Graphs | FB15k | MRR 2i | 0.803 | QTO |
| Knowledge Graphs | FB15k | MRR 2p | 0.674 | QTO |
| Knowledge Graphs | FB15k | MRR 2u | 0.767 | QTO |
| Knowledge Graphs | FB15k | MRR 3i | 0.836 | QTO |
| Knowledge Graphs | FB15k | MRR 3p | 0.588 | QTO |
| Knowledge Graphs | FB15k | MRR ip | 0.74 | QTO |
| Knowledge Graphs | FB15k | MRR pi | 0.752 | QTO |
| Knowledge Graphs | FB15k | MRR up | 0.613 | QTO |
| Knowledge Graphs | NELL-995 | MRR 1p | 0.607 | QTO |
| Knowledge Graphs | NELL-995 | MRR 2i | 0.425 | QTO |
| Knowledge Graphs | NELL-995 | MRR 2p | 0.241 | QTO |
| Knowledge Graphs | NELL-995 | MRR 2u | 0.204 | QTO |
| Knowledge Graphs | NELL-995 | MRR 3i | 0.506 | QTO |
| Knowledge Graphs | NELL-995 | MRR 3p | 0.216 | QTO |
| Knowledge Graphs | NELL-995 | MRR ip | 0.265 | QTO |
| Knowledge Graphs | NELL-995 | MRR pi | 0.313 | QTO |
| Knowledge Graphs | NELL-995 | MRR up | 0.179 | QTO |
| Knowledge Graphs | FB15k-237 | MRR 1p | 0.49 | QTO |
| Knowledge Graphs | FB15k-237 | MRR 2i | 0.431 | QTO |
| Knowledge Graphs | FB15k-237 | MRR 2p | 0.214 | QTO |
| Knowledge Graphs | FB15k-237 | MRR 2u | 0.227 | QTO |
| Knowledge Graphs | FB15k-237 | MRR 3i | 0.568 | QTO |
| Knowledge Graphs | FB15k-237 | MRR 3p | 0.212 | QTO |
| Knowledge Graphs | FB15k-237 | MRR ip | 0.28 | QTO |
| Knowledge Graphs | FB15k-237 | MRR pi | 0.381 | QTO |
| Knowledge Graphs | FB15k-237 | MRR up | 0.214 | QTO |
| Knowledge Graph Completion | FB15k | MRR 1p | 0.895 | QTO |
| Knowledge Graph Completion | FB15k | MRR 2i | 0.803 | QTO |
| Knowledge Graph Completion | FB15k | MRR 2p | 0.674 | QTO |
| Knowledge Graph Completion | FB15k | MRR 2u | 0.767 | QTO |
| Knowledge Graph Completion | FB15k | MRR 3i | 0.836 | QTO |
| Knowledge Graph Completion | FB15k | MRR 3p | 0.588 | QTO |
| Knowledge Graph Completion | FB15k | MRR ip | 0.74 | QTO |
| Knowledge Graph Completion | FB15k | MRR pi | 0.752 | QTO |
| Knowledge Graph Completion | FB15k | MRR up | 0.613 | QTO |
| Knowledge Graph Completion | NELL-995 | MRR 1p | 0.607 | QTO |
| Knowledge Graph Completion | NELL-995 | MRR 2i | 0.425 | QTO |
| Knowledge Graph Completion | NELL-995 | MRR 2p | 0.241 | QTO |
| Knowledge Graph Completion | NELL-995 | MRR 2u | 0.204 | QTO |
| Knowledge Graph Completion | NELL-995 | MRR 3i | 0.506 | QTO |
| Knowledge Graph Completion | NELL-995 | MRR 3p | 0.216 | QTO |
| Knowledge Graph Completion | NELL-995 | MRR ip | 0.265 | QTO |
| Knowledge Graph Completion | NELL-995 | MRR pi | 0.313 | QTO |
| Knowledge Graph Completion | NELL-995 | MRR up | 0.179 | QTO |
| Knowledge Graph Completion | FB15k-237 | MRR 1p | 0.49 | QTO |
| Knowledge Graph Completion | FB15k-237 | MRR 2i | 0.431 | QTO |
| Knowledge Graph Completion | FB15k-237 | MRR 2p | 0.214 | QTO |
| Knowledge Graph Completion | FB15k-237 | MRR 2u | 0.227 | QTO |
| Knowledge Graph Completion | FB15k-237 | MRR 3i | 0.568 | QTO |
| Knowledge Graph Completion | FB15k-237 | MRR 3p | 0.212 | QTO |
| Knowledge Graph Completion | FB15k-237 | MRR ip | 0.28 | QTO |
| Knowledge Graph Completion | FB15k-237 | MRR pi | 0.381 | QTO |
| Knowledge Graph Completion | FB15k-237 | MRR up | 0.214 | QTO |
| Large Language Model | FB15k | MRR 1p | 0.895 | QTO |
| Large Language Model | FB15k | MRR 2i | 0.803 | QTO |
| Large Language Model | FB15k | MRR 2p | 0.674 | QTO |
| Large Language Model | FB15k | MRR 2u | 0.767 | QTO |
| Large Language Model | FB15k | MRR 3i | 0.836 | QTO |
| Large Language Model | FB15k | MRR 3p | 0.588 | QTO |
| Large Language Model | FB15k | MRR ip | 0.74 | QTO |
| Large Language Model | FB15k | MRR pi | 0.752 | QTO |
| Large Language Model | FB15k | MRR up | 0.613 | QTO |
| Large Language Model | NELL-995 | MRR 1p | 0.607 | QTO |
| Large Language Model | NELL-995 | MRR 2i | 0.425 | QTO |
| Large Language Model | NELL-995 | MRR 2p | 0.241 | QTO |
| Large Language Model | NELL-995 | MRR 2u | 0.204 | QTO |
| Large Language Model | NELL-995 | MRR 3i | 0.506 | QTO |
| Large Language Model | NELL-995 | MRR 3p | 0.216 | QTO |
| Large Language Model | NELL-995 | MRR ip | 0.265 | QTO |
| Large Language Model | NELL-995 | MRR pi | 0.313 | QTO |
| Large Language Model | NELL-995 | MRR up | 0.179 | QTO |
| Large Language Model | FB15k-237 | MRR 1p | 0.49 | QTO |
| Large Language Model | FB15k-237 | MRR 2i | 0.431 | QTO |
| Large Language Model | FB15k-237 | MRR 2p | 0.214 | QTO |
| Large Language Model | FB15k-237 | MRR 2u | 0.227 | QTO |
| Large Language Model | FB15k-237 | MRR 3i | 0.568 | QTO |
| Large Language Model | FB15k-237 | MRR 3p | 0.212 | QTO |
| Large Language Model | FB15k-237 | MRR ip | 0.28 | QTO |
| Large Language Model | FB15k-237 | MRR pi | 0.381 | QTO |
| Large Language Model | FB15k-237 | MRR up | 0.214 | QTO |
| Inductive knowledge graph completion | FB15k | MRR 1p | 0.895 | QTO |
| Inductive knowledge graph completion | FB15k | MRR 2i | 0.803 | QTO |
| Inductive knowledge graph completion | FB15k | MRR 2p | 0.674 | QTO |
| Inductive knowledge graph completion | FB15k | MRR 2u | 0.767 | QTO |
| Inductive knowledge graph completion | FB15k | MRR 3i | 0.836 | QTO |
| Inductive knowledge graph completion | FB15k | MRR 3p | 0.588 | QTO |
| Inductive knowledge graph completion | FB15k | MRR ip | 0.74 | QTO |
| Inductive knowledge graph completion | FB15k | MRR pi | 0.752 | QTO |
| Inductive knowledge graph completion | FB15k | MRR up | 0.613 | QTO |
| Inductive knowledge graph completion | NELL-995 | MRR 1p | 0.607 | QTO |
| Inductive knowledge graph completion | NELL-995 | MRR 2i | 0.425 | QTO |
| Inductive knowledge graph completion | NELL-995 | MRR 2p | 0.241 | QTO |
| Inductive knowledge graph completion | NELL-995 | MRR 2u | 0.204 | QTO |
| Inductive knowledge graph completion | NELL-995 | MRR 3i | 0.506 | QTO |
| Inductive knowledge graph completion | NELL-995 | MRR 3p | 0.216 | QTO |
| Inductive knowledge graph completion | NELL-995 | MRR ip | 0.265 | QTO |
| Inductive knowledge graph completion | NELL-995 | MRR pi | 0.313 | QTO |
| Inductive knowledge graph completion | NELL-995 | MRR up | 0.179 | QTO |
| Inductive knowledge graph completion | FB15k-237 | MRR 1p | 0.49 | QTO |
| Inductive knowledge graph completion | FB15k-237 | MRR 2i | 0.431 | QTO |
| Inductive knowledge graph completion | FB15k-237 | MRR 2p | 0.214 | QTO |
| Inductive knowledge graph completion | FB15k-237 | MRR 2u | 0.227 | QTO |
| Inductive knowledge graph completion | FB15k-237 | MRR 3i | 0.568 | QTO |
| Inductive knowledge graph completion | FB15k-237 | MRR 3p | 0.212 | QTO |
| Inductive knowledge graph completion | FB15k-237 | MRR ip | 0.28 | QTO |
| Inductive knowledge graph completion | FB15k-237 | MRR pi | 0.381 | QTO |
| Inductive knowledge graph completion | FB15k-237 | MRR up | 0.214 | QTO |