Scaling Test-Driven Code Generation from Functions to Classes: An Empirical Study

TL;DR

This study extends test-driven code generation from functions to classes, demonstrating that an iterative TDD framework significantly improves class-level correctness and reliability across multiple large language models.

Contribution

The paper introduces a scalable TDD framework for class-level code generation, including a new evaluation dataset and empirical analysis across eight LLMs.

Findings

Class-level correctness improved by 12 to 26 points

Up to 71% of classes are fully correct after TDD

Requires only a small number of repairs on average

Abstract

Test-driven development (TDD) has been adopted to improve Large Language Model (LLM)-based code generation by using tests as executable specifications. However, existing TDD-style code generation studies are largely limited to function-level tasks, leaving class-level synthesis where multiple methods interact through shared state and call dependencies underexplored. In this paper, we scale test-driven code generation from functions to classes via an iterative TDD framework. Our approach first analyzes intra-class method dependencies to derive a feasible generation schedule, and then incrementally implements each method under method-level public tests with reflection-style execution feedback and bounded repair iterations. To support test-driven generation and rigorous class-level evaluation, we construct ClassEval-TDD, a cleaned and standardized variant of ClassEval with consistent specifications, deterministic test environments, and complete method-level public tests. We conduct an empirical study across eight LLMs and compare against the strongest direct-generation baseline (the best of holistic, incremental, and compositional strategies). Our class-level TDD framework consistently improves class-level correctness by 12 to 26 absolute points and achieves up to 71% fully correct classes, while requiring only a small number of repairs on average. These results demonstrate that test-driven generation can effectively scale beyond isolated functions and substantially improve class-level code generation reliability. All code and data are available at https://anonymous.4open.science/r/ClassEval-TDD-C4C9/