TL;DR
The paper introduces the concept of the hardware lottery, explaining how hardware constraints influence research success and delay progress, especially with specialized hardware making alternative ideas less viable.
Contribution
It defines the hardware lottery concept and illustrates its historical impact on research progress, highlighting implications for future hardware developments.
Findings
Hardware influences research success and failure.
Specialized hardware can entrench certain research directions.
Progress may become more uneven due to hardware constraints.
Abstract
Hardware, systems and algorithms research communities have historically had different incentive structures and fluctuating motivation to engage with each other explicitly. This historical treatment is odd given that hardware and software have frequently determined which research ideas succeed (and fail). This essay introduces the term hardware lottery to describe when a research idea wins because it is suited to the available software and hardware and not because the idea is superior to alternative research directions. Examples from early computer science history illustrate how hardware lotteries can delay research progress by casting successful ideas as failures. These lessons are particularly salient given the advent of domain specialized hardware which make it increasingly costly to stray off of the beaten path of research ideas. This essay posits that the gains from progress in…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
The Hardware Lottery (Paper Explained)· youtube
He Co-Invented the Transformer. Now: Continuous Thought Machines [Llion Jones / Luke Darlow]· youtube
Getting away from the "Hardware Lottery" with Sara Hooker· youtube
