AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machines

TL;DR

AutoWebWorld creates controllable, verifiable web environments using finite state machines, enabling efficient synthetic data generation that improves training of web GUI agents and outperforms baselines.

Contribution

It introduces a novel FSM-based framework for synthesizing verifiable web environments, facilitating automated data generation and verification for training autonomous web agents.

Findings

Generated over 11,663 verified trajectories at low cost

Training on synthetic data improves real-world agent performance

Performance scales with increased synthetic data volume

Abstract

The performance of autonomous Web GUI agents heavily relies on the quality and quantity of their training data. However, a fundamental bottleneck persists: collecting interaction trajectories from real-world websites is expensive and difficult to verify. The underlying state transitions are hidden, leading to reliance on inconsistent and costly external verifiers to evaluate step-level correctness. To address this, we propose AutoWebWorld, a novel framework for synthesizing controllable and verifiable web environments by modeling them as Finite State Machines (FSMs) and use coding agents to translate FSMs into interactive websites. Unlike real websites, where state transitions are implicit, AutoWebWorld explicitly defines all states, actions, and transition rules. This enables programmatic verification: action correctness is checked against predefined rules, and task success is confirmed by reaching a goal state in the FSM graph. AutoWebWorld enables a fully automated search-and-verify pipeline, generating over 11,663 verified trajectories from 29 diverse web environments at only $0.04 per trajectory. Training on this synthetic data significantly boosts real-world performance. Our 7B Web GUI agent outperforms all baselines within 15 steps on WebVoyager. Furthermore, we observe a clear scaling law: as the synthetic data volume increases, performance on WebVoyager and Online-Mind2Web consistently improves.