Tensors Come of Age: Why the AI Revolution will help HPC
John L. Gustafson, Lenore M. Mullin
TL;DR
This paper explores how advanced tensor algorithms, combined with novel mathematical representations like Unum Arithmetic, are transforming high-performance computing and AI by enabling more accurate, scalable, and portable software solutions.
Contribution
It introduces a new approach to tensor algorithms using Mathematics of Arrays, Psi Calculus, and Unum Arithmetic to improve software reliability and scalability.
Findings
Enhanced numerical accuracy with Unum Arithmetic
Scalable tensor algorithms for AI and HPC
Improved portability and provability of software
Abstract
This article discusses how the automation of tensor algorithms, based on A Mathematics of Arrays and Psi Calculus, and a new way to represent numbers, Unum Arithmetic, enables mechanically provable, scalable, portable, and more numerically accurate software.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsComputational Physics and Python Applications