Capability Conditioned Scaffolding for Professional Human LLM Collaboration

TL;DR

This paper introduces Capability Conditioned Scaffolding, a framework that adapts AI intervention based on user expertise levels to improve professional human-AI collaboration.

Contribution

It proposes a novel typed framework that conditions AI interventions on structured capability profiles across different expertise domains.

Findings

Profile conditioned intervention behavior is consistent across multiple LLMs.

Swapping profiles can invert intervention categories.

Selective activation reduces domain drift risk.

Abstract

Large language model personalization typically adapts outputs to user preferences and style but does not account for differences in user evaluation capacity across domains of expertise. This limitation can encourage Professional Domain Drift, where users rely on AI generated reasoning in domains they cannot reliably evaluate. We introduce Capability Conditioned Scaffolding, a typed framework that partitions expertise into strong, mixed, and weak domains and conditions intervention behavior on structured capability profiles. A pilot evaluation across multiple MMLU subsets and four LLM substrates shows consistent profile conditioned intervention behavior, including categorical inversion under profile swapping and selective activation in mixed domain risk zones. These findings suggest that capability aware scaffolding can support more reliable professional human AI collaboration beyond stylistic personalization.