Graph neural networks (GNNs) work well when the graph structure is provided. However, this structure may not always be available in real-world applications. One solution to this problem is to infer a task-specific latent structure and then apply a GNN to the inferred graph. Unfortunately, the space of possible graph structures grows super-exponentially with the number of nodes and so the task-specific supervision may be insufficient for learning both the structure and the GNN parameters. In this work, we propose the Simultaneous Learning of Adjacency and GNN Parameters with Self-supervision, or SLAPS, a method that provides more supervision for inferring a graph structure through self-supervision. A comprehensive experimental study demonstrates that SLAPS scales to large graphs with hundreds of thousands of nodes and outperforms several models that have been proposed to learn a task-specific graph structure on established benchmarks.
Bibtex
@inproceedings{slaps,
title = {SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networks},
authors = {Bahare Fatemi and Layla El Asri and Seyed Mehran Kazemi},
year = {2021},
booktitle = {Proceedings of Advances in Neural Information Processing Systems (NeurIPS)},
}
Related Research
-
Stay Positive: Knowledge Graph Embedding Without Negative Sampling
Stay Positive: Knowledge Graph Embedding Without Negative Sampling
A. Hajimoradlou, and S. M. Kazemi. International Conference on Machine Learning Workshop on Graph Representation Learning and Beyond (ICML)
Publications
-
Our NeurIPS 2021 Reading List
Our NeurIPS 2021 Reading List
Y. Cao, K. Y. C. Lui, T. Durand, J. He, P. Xu, N. Mehrasa, A. Radovic, A. Lehrmann, R. Deng, A. Abdi, M. Schlegel, and S. Liu.
Computer Vision; Data Visualization; Graph Representation Learning; Learning And Generalization; Natural Language Processing; Optimization; Reinforcement Learning; Time series Modelling; Unsupervised Learning
Research
-
Representation Learning for Dynamic Graphs: A Survey
Representation Learning for Dynamic Graphs: A Survey
M. Kazemi, R. Goel, K. Jain, I. Kobyzev, A. Sethi, P. Forsyth, and P. Poupart. Journal of Machine Learning Research (JMLR)
Publications