Agentic AIs Are the Missing Paradigm for Out-of-Distribution Generalization in Foundation Models

TL;DR

This paper argues that addressing out-of-distribution challenges in foundation models requires adopting an agentic paradigm, which extends beyond traditional model-centric approaches, to handle complex, real-world distribution shifts.

Contribution

It formalizes OOD for foundation models, proves limitations of model-centric methods, and advocates for agentic systems with four key structural properties as a necessary complementary paradigm.

Findings

Proves a parameter coverage ceiling for model-centric methods.

Defines four structural properties of agentic OOD systems.

Argues that agentic systems extend the capabilities beyond the ceiling.

Abstract

Foundation models (FMs) are increasingly deployed in open-world settings where distribution shift is the rule rather than the exception. The out-of-distribution (OOD) phenomena they face -- knowledge boundaries, capability ceilings, compositional shifts, and open-ended task variation -- differ in kind from the settings that have shaped prior OOD research, and are further complicated because the pretraining and post-training distributions of modern FMs are often only partially observed. Our position is that OOD for foundation models is a structurally distinct problem that cannot be solved within the prevailing model-centric paradigm, and that agentic systems constitute the missing paradigm required to address it. We defend this claim through four steps. First, we give a stage-aware formalization of OOD that accommodates partially observed multi-stage training distributions. Second, we prove a parameter coverage ceiling: there exist practically relevant inputs that no model-centric method (training-time or test-time) can handle within tolerance $\varepsilon$, for reasons intrinsic to parameter-based representation. Third, we characterize agentic OOD systems by four structural properties -- perception, strategy selection, external action, and closed-loop verification -- and show that they strictly extend the reachable set beyond the ceiling. Fourth, we respond to seven counterarguments, conceding two, and outline a research agenda. We do not claim that agentic methods subsume model-centric ones; we argue that the two are complementary, and that progress on FM-OOD requires explicit recognition of the agentic paradigm as a first-class research direction.