Lookup Table-based Multiplication-free All-digital DNN Accelerator Featuring Self-Synchronous Pipeline Accumulation
Hiroto Tagata, Takashi Sato, Hiromitsu Awano

TL;DR
This paper introduces an all-digital DNN accelerator that uses lookup tables and a self-synchronous pipeline to significantly improve energy and area efficiency while maintaining accuracy.
Contribution
It presents a novel MADDNESS-based digital accelerator with a self-synchronous pipeline accumulator, overcoming analog circuit limitations for better efficiency and PVT invariance.
Findings
2.5x higher energy efficiency (174 TOPS/W)
5x higher area efficiency (2.01 TOPS/mm2)
Compact and PVT-invariant design
Abstract
Deep neural networks (DNNs) have been widely applied in our society, yet reducing power consumption due to large-scale matrix computations remains a critical challenge. MADDNESS is a known approach to improving energy efficiency by substituting matrix multiplication with table lookup operations. Previous research has employed large analog computing circuits to convert inputs into LUT addresses, which presents challenges to area efficiency and computational accuracy. This paper proposes a novel MADDNESS-based all-digital accelerator featuring a self-synchronous pipeline accumulator, resulting in a compact, energy-efficient, and PVT-invariant computation. Post-layout simulation using a commercial 22nm process showed that 2.5 times higher energy efficiency (174 TOPS/W) and 5 times higher area efficiency (2.01 TOPS/mm2) can be achieved compared to the conventional accelerator.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsLow-power high-performance VLSI design · Parallel Computing and Optimization Techniques · Numerical Methods and Algorithms
