EmbedGenius: Towards Automated Software Development for Generic Embedded IoT Systems

TL;DR

EmbedGenius is an automated platform leveraging large language models to streamline embedded IoT system development, significantly reducing manual effort and errors while achieving high accuracy and success rates.

Contribution

This paper introduces EmbedGenius, the first fully automated development platform for embedded IoT systems using LLMs and domain knowledge injection.

Findings

Code generation accuracy of 95.7%

Task success rate of 86.5%

Outperforms human-in-the-loop baselines by up to 37.7%

Abstract

Embedded IoT system development is crucial for enabling seamless connectivity and functionality across a wide range of applications. However, such a complex process requires cross-domain knowledge of hardware and software and hence often necessitates direct developer involvement, making it labor-intensive, time-consuming, and error-prone. To address this challenge, this paper introduces EmbedGenius, the first fully automated software development platform for general-purpose embedded IoT systems. The key idea is to leverage the reasoning ability of Large Language Models (LLMs) and embedded system expertise to automate the hardware-in-the-loop development process. The main methods include a component-aware library resolution method for addressing hardware dependencies, a library knowledge generation method that injects utility domain knowledge into LLMs, and an auto-programming method that ensures successful deployment. We evaluate EmbedGenius's performance across 71 modules and four mainstream embedded development platforms with over 350 IoT tasks. Experimental results show that EmbedGenius can generate codes with an accuracy of 95.7% and complete tasks with a success rate of 86.5%, surpassing human-in-the-loop baselines by 15.6%--37.7% and 25.5%--53.4%, respectively. We also show EmbedGenius's potential through case studies in environmental monitoring and remote control systems development.