Rajarshi Das, Ameya Godbole, Nicholas Monath, Manzil Zaheer, Andrew McCallum
A case-based reasoning (CBR) system solves a new problem by retrieving `cases' that are similar to the given problem. If such a system can achieve high accuracy, it is appealing owing to its simplicity, interpretability, and scalability. In this paper, we demonstrate that such a system is achievable for reasoning in knowledge-bases (KBs). Our approach predicts attributes for an entity by gathering reasoning paths from similar entities in the KB. Our probabilistic model estimates the likelihood that a path is effective at answering a query about the given entity. The parameters of our model can be efficiently computed using simple path statistics and require no iterative optimization. Our model is non-parametric, growing dynamically as new entities and relations are added to the KB. On several benchmark datasets our approach significantly outperforms other rule learning approaches and performs comparably to state-of-the-art embedding-based approaches. Furthermore, we demonstrate the effectiveness of our model in an "open-world" setting where new entities arrive in an online fashion, significantly outperforming state-of-the-art approaches and nearly matching the best offline method. Code available at https://github.com/ameyagodbole/Prob-CBR
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Link Prediction | NELL-995 | HITS@3 | 0.85 | Prob-CBR |
| Link Prediction | NELL-995 | Hits@1 | 0.77 | Prob-CBR |
| Link Prediction | NELL-995 | Hits@10 | 0.89 | Prob-CBR |
| Link Prediction | NELL-995 | MRR | 0.81 | Prob-CBR |
| Link Prediction | FB122 | HITS@3 | 74.2 | Prob-CBR |
| Link Prediction | FB122 | Hits@10 | 78.2 | Prob-CBR |
| Link Prediction | FB122 | Hits@5 | 76 | Prob-CBR |
| Link Prediction | FB122 | MRR | 72.7 | Prob-CBR |
| Link Prediction | WN18RR | Hits@1 | 0.43 | ProbCBR |
| Link Prediction | WN18RR | Hits@10 | 0.55 | ProbCBR |
| Link Prediction | WN18RR | Hits@3 | 0.49 | ProbCBR |
| Link Prediction | WN18RR | MRR | 0.48 | ProbCBR |