Computational Algebra with Attention: Transformer Oracles for Border Basis Algorithms
Hiroshi Kera, Nico Pelleriti, Yuki Ishihara, Max Zimmer, Sebastian Pokutta

TL;DR
This paper presents a Transformer-based oracle that accelerates border basis algorithms for solving polynomial systems, achieving up to 3.5x speedup while ensuring correctness, through a novel sampling method and specialized input encoding.
Contribution
It introduces the first deep learning oracle for border basis algorithms, combining speedup with guaranteed correctness and a new sampling theorem for training data generation.
Findings
Achieves up to 3.5x speedup in border basis computations.
Maintains correctness of solutions despite acceleration.
Develops a novel sampling method and tokenization scheme for algebraic data.
Abstract
Solving systems of polynomial equations, particularly those with finitely many solutions, is a crucial challenge across many scientific fields. Traditional methods like Gr\"obner and Border bases are fundamental but suffer from high computational costs, which have motivated recent Deep Learning approaches to improve efficiency, albeit at the expense of output correctness. In this work, we introduce the Oracle Border Basis Algorithm, the first Deep Learning approach that accelerates Border basis computation while maintaining output guarantees. To this end, we design and train a Transformer-based oracle that identifies and eliminates computationally expensive reduction steps, which we find to dominate the algorithm's runtime. By selectively invoking this oracle during critical phases of computation, we achieve substantial speedup factors of up to 3.5x compared to the base algorithm,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsPolynomial and algebraic computation · Cryptography and Residue Arithmetic · Numerical Methods and Algorithms
MethodsBalanced Selection
