Lu Haonan, Seth H. Huang, Tian Ye, Guo Xiuyan
In this work, we present graph star net (GraphStar), a novel and unified graph neural net architecture which utilizes message-passing relay and attention mechanism for multiple prediction tasks - node classification, graph classification and link prediction. GraphStar addresses many earlier challenges facing graph neural nets and achieves non-local representation without increasing the model depth or bearing heavy computational costs. We also propose a new method to tackle topic-specific sentiment analysis based on node classification and text classification as graph classification. Our work shows that 'star nodes' can learn effective graph-data representation and improve on current methods for the three tasks. Specifically, for graph classification and link prediction, GraphStar outperforms the current state-of-the-art models by 2-5% on several key benchmarks.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Link Prediction | Cora (biased evaluation) | AP | 96.15 | GraphStar (double weight on positive examples) |
| Link Prediction | Cora (biased evaluation) | AUC | 95.65 | GraphStar (double weight on positive examples) |
| Link Prediction | Cora (biased evaluation) | Accuracy | 95.9 | GraphStar (double weight on positive examples) |
| Link Prediction | Pubmed (biased evaluation) | AP | 98.64 | GraphStar (double weight on positive examples) |
| Link Prediction | Pubmed (biased evaluation) | AUC | 97.67 | GraphStar (double weight on positive examples) |
| Link Prediction | Pubmed (biased evaluation) | Accuracy | 98.16 | GraphStar (double weight on positive examples) |
| Link Prediction | Citeseer (biased evaluation) | AP | 97.93 | GraphStar (double weight on positive examples) |
| Link Prediction | Citeseer (biased evaluation) | AUC | 97.47 | GraphStar (double weight on positive examples) |
| Link Prediction | Citeseer (biased evaluation) | Accuracy | 97.7 | GraphStar (double weight on positive examples) |
| Sentiment Analysis | MR | Accuracy | 76.6 | GraphStar |
| Sentiment Analysis | IMDb | Accuracy | 96 | GraphStar |
| Text Classification | R52 | Accuracy | 95 | GraphStar |
| Text Classification | Ohsumed | Accuracy | 64.2 | GraphStar |
| Text Classification | R8 | Accuracy | 97.4 | GraphStar |
| Text Classification | 20NEWS | Accuracy | 86.9 | GraphStar |
| Node Classification | Citeseer | Accuracy | 71 | GraphStar |
| Node Classification | PPI | F1 | 99.4 | GraphStar |
| Classification | R52 | Accuracy | 95 | GraphStar |
| Classification | Ohsumed | Accuracy | 64.2 | GraphStar |
| Classification | R8 | Accuracy | 97.4 | GraphStar |
| Classification | 20NEWS | Accuracy | 86.9 | GraphStar |