Eight challenges in developing theory of intelligence
Haiping Huang

TL;DR
This paper discusses eight key challenges in developing a comprehensive theoretical framework for understanding intelligence, both biological and artificial, emphasizing the role of abstract models and mathematical beauty.
Contribution
It identifies and elaborates on eight fundamental challenges in formulating a theory of intelligence using bottom-up mechanistic modeling.
Findings
Highlights the importance of abstract models in understanding complex systems.
Proposes that many dimensions in neural systems are sloppy, with fewer stiff dimensions impacting observables.
Emphasizes the potential of this approach for advancing AI and biological intelligence theories.
Abstract
A good theory of mathematical beauty is more practical than any current observation, as new predictions of physical reality can be verified self-consistently. This belief applies to the current status of understanding deep neural networks including large language models and even the biological intelligence. Toy models provide a metaphor of physical reality, allowing mathematically formulating that reality (i.e., the so-called theory), which can be updated as more conjectures are justified or refuted. One does not need to pack all details into a model, but rather, more abstract models are constructed, as complex systems like brains or deep networks have many sloppy dimensions but much less stiff dimensions that strongly impact macroscopic observables. This kind of bottom-up mechanistic modeling is still promising in the modern era of understanding the natural or artificial intelligence.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural dynamics and brain function · Cell Image Analysis Techniques · Computability, Logic, AI Algorithms
