Neural Probabilistic Logic Learning for Knowledge Graph Reasoning
Fengsong Sun, Jinyu Wang, Zhiqing Wei, Xianchao Zhang

TL;DR
This paper introduces Neural Probabilistic Logic Learning (NPLL), a framework that combines embedding networks with probabilistic logic to improve reasoning accuracy and interpretability on large-scale knowledge graphs.
Contribution
The paper proposes NPLL, integrating a scoring module and Markov Logic Networks with variational inference to enhance reasoning accuracy and interpretability.
Findings
Significantly improves reasoning accuracy on benchmark datasets
Balances model simplicity with reasoning capabilities
Enhances interpretability through probabilistic logic integration
Abstract
Knowledge graph (KG) reasoning is a task that aims to predict unknown facts based on known factual samples. Reasoning methods can be divided into two categories: rule-based methods and KG-embedding based methods. The former possesses precise reasoning capabilities but finds it challenging to reason efficiently over large-scale knowledge graphs. While gaining the ability to reason over large-scale knowledge graphs, the latter sacrifices reasoning accuracy. This paper aims to design a reasoning framework called Neural Probabilistic Logic Learning(NPLL) that achieves accurate reasoning on knowledge graphs. Our approach introduces a scoring module that effectively enhances the expressive power of embedding networks, striking a balance between model simplicity and reasoning capabilities. We improve the interpretability of the model by incorporating a Markov Logic Network based on variational…
Peer Reviews
Decision·ICLR 2025 Conference Withdrawn Submission
This paper is generally well-written, though the clarity of some parts could be improved. The experiments purportedly show huge gains by the paper's approach on standard benchmarks.
This paper does not clearly position its technical contributions with respect to prior research. Its approach resembles that of pLogicNet (Qu and Tang, 2019) and ExpressGNN (Zhang et al., 2020), both of which the paper cites. Both pLogicNet and ExpressGNN employ the same variational-EM approach as this paper, as well as the computational simplifications of mean-field approximation and pseudo-log-likelihood optimization. In light of these existing works, the primary contribution of this paper app
1. The methodological improvement introduced in this paper that leverages an embedding-based scoring module is straightforward. However, this simplicity contributes to the model’s robustness and ease of implementation, and the results achieved are notably impressive. 2. The experimental evaluation is thorough, covering a wide range of benchmark knowledge graphs. This comprehensive testing approach not only underscores the model’s versatility but also consistently demonstrates superior performan
## 1 Novelty Issue 1. The proposed methodology closely resembles the approach used in ExpressGNN [1], with the primary difference being the addition of a scoring module on factual triples $(e_h, l, e_t)$. It remains unclear what further distinctions, if any, exist between this model and ExpressGNN, raising concerns regarding the novelty of this contribution. ## 2 Insufficient and Unjustified Experimentation 1. Two model variants, NPLL-basic and NPLL-GNN, are proposed, with reasoning results pro
1. The proposed method outperforms the baseline methods by a large margin. 2. The proposed method also performs well in the data-scarce cases. 3. The proposed method is parameter efficient. 4. Code is provided.
1. This paper is ill-written. The motivation is extremely unclear. Over the entire paper, it is hard for me to capture what problem this paper want to address and how the proposed method is motivated. 2. The advantage of NPLL over other methods is not well discussed. The authors frequently claim that NPLL is more effective than the others. However, in what aspects and why? I can't understand. 3. As for the methodology, there lack of an overall picture of the whole framework. Just talk about what
Studying new methods in which embedding and rule based methods can be combined is clearly of interest. The experimental results are very good, spectacular even.
The core idea of this paper is identical to that of the pLogicNet paper, which also proposes a variational approximation of Markov logic networks based on embeddings. Furthermore, ExpressGNN builds on pLogicNet by using GNNs instead of embeddings, and this paper similarly analyses a variant based on GNNs. It is not clear what is novel about the proposed model compared to these two earlier models. Worryingly, while pLogicNet and ExpressGNN are cited in the paper, no mention at all is made of the
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSemantic Web and Ontologies · Bayesian Modeling and Causal Inference · Rough Sets and Fuzzy Logic
