Storing sequences in binary tournament-based neural networks
Xiaoran Jiang, Vincent Gripon, Claude Berrou, Michael Rabbat

TL;DR
This paper introduces an extension to clique-based neural networks that efficiently stores sequences using oriented connections and redundancy, incorporating anticipation and a double-layered structure for accurate retrieval, while maintaining biological plausibility.
Contribution
It presents a novel extension enabling efficient sequence storage in neural networks with biological plausibility and a combined hetero- and auto-association structure.
Findings
Enhanced sequence storage efficiency demonstrated
Increased biological plausibility of the model
Effective sequence retrieval with the proposed structure
Abstract
An extension to a recently introduced architecture of clique-based neural networks is presented. This extension makes it possible to store sequences with high efficiency. To obtain this property, network connections are provided with orientation and with flexible redundancy carried by both spatial and temporal redundancy, a mechanism of anticipation being introduced in the model. In addition to the sequence storage with high efficiency, this new scheme also offers biological plausibility. In order to achieve accurate sequence retrieval, a double layered structure combining hetero-association and auto-association is also proposed.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural Networks and Applications · Blind Source Separation Techniques · Neural Networks and Reservoir Computing
