Automated CAD Modeling Sequence Generation from Text Descriptions via Transformer-Based Large Language Models

TL;DR

This paper introduces a transformer-based framework that automates CAD model generation from text descriptions, combining large language models and vision-language models to improve accuracy and efficiency in industrial design tasks.

Contribution

It presents a novel integrated approach using LLMs, VLLMs, and a transformer-based generator to automate and refine CAD modeling from textual inputs.

Findings

Outperforms traditional methods in accuracy and efficiency

Successfully automates complex CAD model generation from text

Demonstrates practical application in industrial design workflows

Abstract

Designing complex computer-aided design (CAD) models is often time-consuming due to challenges such as computational inefficiency and the difficulty of generating precise models. We propose a novel language-guided framework for industrial design automation to address these issues, integrating large language models (LLMs) with computer-automated design (CAutoD).Through this framework, CAD models are automatically generated from parameters and appearance descriptions, supporting the automation of design tasks during the detailed CAD design phase. Our approach introduces three key innovations: (1) a semi-automated data annotation pipeline that leverages LLMs and vision-language large models (VLLMs) to generate high-quality parameters and appearance descriptions; (2) a Transformer-based CAD generator (TCADGen) that predicts modeling sequences via dual-channel feature aggregation; (3) an enhanced CAD modeling generation model, called CADLLM, that is designed to refine the generated sequences by incorporating the confidence scores from TCADGen. Experimental results demonstrate that the proposed approach outperforms traditional methods in both accuracy and efficiency, providing a powerful tool for automating industrial workflows and generating complex CAD models from textual prompts. The code is available at https://jianxliao.github.io/cadllm-page/