An Alternative Trajectory for Generative AI
Margarita Belova, Yuval Kansal, Yihao Liang, Jiaxin Xiao, Niraj K. Jha

TL;DR
The paper proposes a new approach for generative AI focusing on domain-specific superintelligence using symbolic abstractions, enabling sustainable, efficient, and specialized AI ecosystems instead of large monolithic models.
Contribution
It introduces the concept of domain-specific superintelligence with explicit symbolic knowledge, and a society of specialized models orchestrated for sustainable and effective AI performance.
Findings
DSS models reduce compute costs compared to large language models.
Symbolic abstractions improve reasoning in specific domains.
Decoupling capability from size enhances sustainability and security.
Abstract
The generative artificial intelligence (AI) ecosystem is undergoing rapid transformations that threaten its sustainability. As models transition from research prototypes to high-traffic products, the energetic burden has shifted from one-time training to recurring, unbounded inference. This is exacerbated by reasoning models that inflate compute costs by orders of magnitude per query. The prevailing pursuit of artificial general intelligence through scaling of monolithic models is colliding with hard physical constraints: grid failures, water consumption, and diminishing returns on data scaling. This trajectory yields models with impressive factual recall but struggles in domains requiring in-depth reasoning, possibly due to insufficient abstractions in training data. Current large language models (LLMs) exhibit genuine reasoning depth only in domains like mathematics and coding,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsBig Data and Digital Economy · Ethics and Social Impacts of AI · Scientific Computing and Data Management
