Knowledgebra: An Algebraic Learning Framework for Knowledge Graph
Tong Yang, Yifei Wang, Long Sha, Jan Engelbrecht, Pengyu Hong

TL;DR
Knowledgebra introduces an algebraic framework for knowledge graph embeddings, leveraging semigroup structures and logic rule integration to improve consistency and performance in knowledge representation tasks.
Contribution
This work develops the first formal algebraic language for knowledge graphs, using semigroups and matrix models, and integrates human logic rules into embedding training.
Findings
Achieves state-of-the-art results on standard datasets.
Demonstrates the effectiveness of algebraic structures in knowledge graph embedding.
Shows improved knowledge representation consistency.
Abstract
Knowledge graph (KG) representation learning aims to encode entities and relations into dense continuous vector spaces such that knowledge contained in a dataset could be consistently represented. Dense embeddings trained from KG datasets benefit a variety of downstream tasks such as KG completion and link prediction. However, existing KG embedding methods fell short to provide a systematic solution for the global consistency of knowledge representation. We developed a mathematical language for KG based on an observation of their inherent algebraic structure, which we termed as Knowledgebra. By analyzing five distinct algebraic properties, we proved that the semigroup is the most reasonable algebraic structure for the relation embedding of a general knowledge graph. We implemented an instantiation model, SemE, using simple matrix semigroups, which exhibits state-of-the-art performance…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Graph Neural Networks · Topic Modeling · Bayesian Modeling and Causal Inference
