Journal
MACHINE LEARNING
Volume 110, Issue 7, Pages 1695-1738Publisher
SPRINGER
DOI: 10.1007/s10994-021-06017-3
Keywords
Graph neural networks; Lifted relational neural networks; Symmetries; Datalog; Differentiable programming; Relational learning; Molecule classification
Categories
Funding
- Czech Science Foundation [20-19104Y, 20-29260S]
- CERIT Scientific Cloud under the programme Projects of Large Research, Development, and Innovations Infrastructures [LM2015085]
Ask authors/readers for more resources
The framework provides a unified representation of neural models based on logic programming and allows for easy extension of GNN models. In experiments, the framework demonstrated correctness and computation efficiency.
We introduce a declarative differentiable programming framework, based on the language of Lifted Relational Neural Networks, where small parameterized logic programs are used to encode deep relational learning scenarios through the underlying symmetries. When presented with relational data, such as various forms of graphs, the logic program interpreter dynamically unfolds differentiable computation graphs to be used for the program parameter optimization by standard means. Following from the declarative, relational logic-based encoding, this results into a unified representation of a wide range of neural models in the form of compact and elegant learning programs, in contrast to the existing procedural approaches operating directly on the computational graph level. We illustrate how this idea can be used for a concise encoding of existing advanced neural architectures, with the main focus on Graph Neural Networks (GNNs). Importantly, using the framework, we also show how the contemporary GNN models can be easily extended towards higher expressiveness in various ways. In the experiments, we demonstrate correctness and computation efficiency through comparison against specialized GNN frameworks, while shedding some light on the learning performance of the existing GNN models.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available