I-Design: Personalized LLM Interior Designer

TL;DR

I-Design is a personalized interior design system that uses large language models and a novel evaluation protocol to generate and visualize customized 3D interior layouts from natural language input, making design more accessible.

Contribution

It introduces a multi-agent LLM-based dialogue system for translating text into feasible scene graphs and a new evaluation protocol, advancing personalized 3D interior design automation.

Findings

Outperforms existing methods in 3D design quality

Aligns well with user concepts and preferences

Effective in detailed object arrangement and conceptual fidelity

Abstract

Interior design allows us to be who we are and live how we want - each design is as unique as our distinct personality. However, it is not trivial for non-professionals to express and materialize this since it requires aligning functional and visual expectations with the constraints of physical space; this renders interior design a luxury. To make it more accessible, we present I-Design, a personalized interior designer that allows users to generate and visualize their design goals through natural language communication. I-Design starts with a team of large language model agents that engage in dialogues and logical reasoning with one another, transforming textual user input into feasible scene graph designs with relative object relationships. Subsequently, an effective placement algorithm determines optimal locations for each object within the scene. The final design is then constructed in 3D by retrieving and integrating assets from an existing object database. Additionally, we propose a new evaluation protocol that utilizes a vision-language model and complements the design pipeline. Extensive quantitative and qualitative experiments show that I-Design outperforms existing methods in delivering high-quality 3D design solutions and aligning with abstract concepts that match user input, showcasing its advantages across detailed 3D arrangement and conceptual fidelity.