Envisioning Future Interactive Web Development: Editing Webpage with Natural Language
Truong Hai Dang, Jingyu Xiao, Yintong Huo

TL;DR
This paper presents a scalable method for training language models to edit web pages using natural language instructions, improving accuracy and coherence in code modifications for web development.
Contribution
It introduces Instruct4Edit, a novel dataset generated via LLMs for fine-tuning models to better understand and execute web editing commands from natural language.
Findings
Fine-tuned models show improved accuracy in web editing tasks.
The dataset enables models to generate structurally coherent and visually accurate code.
Open-source models achieve performance comparable to proprietary systems.
Abstract
The evolution of web applications relies on iterative code modifications, a process that is traditionally manual and time-consuming. While Large Language Models (LLMs) can generate UI code, their ability to edit existing code from new design requirements (e.g., "center the logo") remains a challenge. This is largely due to the absence of large-scale, high-quality tuning data to align model performance with human expectations. In this paper, we introduce a novel, automated data generation pipeline that uses LLMs to synthesize a high-quality fine-tuning dataset for web editing, named Instruct4Edit. Our approach generates diverse instructions, applies the corresponding code modifications, and performs visual verification to ensure correctness. By fine-tuning models on Instruct4Edit, we demonstrate consistent improvement in translating human intent into precise, structurally coherent, and…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
