The Weighted Tsetlin Machine: Compressed Representations with Weighted Clauses
Adrian Phoulady, Ole-Christoffer Granmo, Saeed Rahimi Gorji, Hady, Ahmady Phoulady

TL;DR
The paper introduces the Weighted Tsetlin Machine (WTM), a more efficient and compact version of the TM that uses clause weighting and a novel sampling scheme to improve accuracy, reduce resource usage, and speed up training.
Contribution
The WTM incorporates clause weighting and a new sampling method, enabling better performance and efficiency compared to the original Tsetlin Machine.
Findings
WTM matches TM accuracy with fewer clauses on MNIST, IMDb, and Connect-4.
WTM outperforms TM with the same number of clauses, achieving higher test accuracies.
Sampling scheme reduces sample generation time by a factor of 7.
Abstract
The Tsetlin Machine (TM) is an interpretable mechanism for pattern recognition that constructs conjunctive clauses from data. The clauses capture frequent patterns with high discriminating power, providing increasing expression power with each additional clause. However, the resulting accuracy gain comes at the cost of linear growth in computation time and memory usage. In this paper, we present the Weighted Tsetlin Machine (WTM), which reduces computation time and memory usage by weighting the clauses. Real-valued weighting allows one clause to replace multiple, and supports fine-tuning the impact of each clause. Our novel scheme simultaneously learns both the composition of the clauses and their weights. Furthermore, we increase training efficiency by replacing Bernoulli trials of success probability with a uniform sample of average size , the size drawn from a binomial…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsOptimization and Search Problems · Multimodal Machine Learning Applications · Machine Learning and Algorithms
MethodsTest
