Learning to Compose for Cross-domain Agentic Workflow Generation

TL;DR

This paper introduces a novel LLM-based method for cross-domain agentic workflow generation that decomposes tasks into reusable capabilities, enabling single-pass, efficient, and adaptable workflow creation across diverse domains.

Contribution

It presents a decomposing-recomposing-deciding framework that internalizes reusable capabilities for one-pass workflow generation, outperforming iterative refinement methods in multi-domain settings.

Findings

Outperforms state-of-the-art refinement baselines in multi-domain tasks.

Reduces workflow generation latency and computational cost.

Achieves high success rates on unseen domains.

Abstract

Automatically generating agentic workflows -- executable operator graphs or codes that orchestrate reasoning, verification, and repair -- has become a practical way to solve complex tasks beyond what single-pass LLM generation can reliably handle. Yet what constitutes a good workflow depends heavily on the task distribution and the available operators. Under domain shift, current systems typically rely on iterative workflow refinement to discover a feasible workflow from a large workflow space, incurring high iteration costs and yielding unstable, domain-specific behavior. In response, we internalize a decompose-recompose-decide mechanism into an open-source LLM for cross-domain workflow generation. To decompose, we learn a compact set of reusable workflow capabilities across diverse domains. To recompose, we map each input task to a sparse composition over these bases to generate a task-specific workflow in a single pass. To decide, we attribute the success or failure of workflow generation to counterfactual contributions from learned capabilities, thereby capturing which capabilities actually drive success by their marginal effects. Across stringent multi-domain, cross-domain, and unseen-domain evaluations, our 1-pass generator surpasses SOTA refinement baselines that consume 20 iterations, while substantially reducing generation latency and cost.