Defurnishing with X-Ray Vision: Joint Removal of Furniture from Panoramas and Mesh
Alan Dolhasz, Chen Ma, Dave Gausebeck, Kevin Chen, Gregor Miller, Lucas Hayne, Gunnar Hovden, Azwad Sabik, Olaf Brandt, Mira Slavcheva

TL;DR
This paper introduces a pipeline that combines mesh editing and panoramic inpainting to remove furniture from indoor scenes, producing clean, textured 3D models and panoramas with improved quality over existing methods.
Contribution
It proposes a novel joint approach using mesh segmentation, plane extension, hole filling, and ControlNet-guided inpainting to effectively defurnish indoor scenes in both mesh and panoramic formats.
Findings
Produces higher quality defurnished meshes and panoramas than neural radiance field methods.
Effectively removes furniture while preserving scene structure and details.
Outperforms RGB-D inpainting methods in visual quality and accuracy.
Abstract
We present a pipeline for generating defurnished replicas of indoor spaces represented as textured meshes and corresponding multi-view panoramic images. To achieve this, we first segment and remove furniture from the mesh representation, extend planes, and fill holes, obtaining a simplified defurnished mesh (SDM). This SDM acts as an ``X-ray'' of the scene's underlying structure, guiding the defurnishing process. We extract Canny edges from depth and normal images rendered from the SDM. We then use these as a guide to remove the furniture from panorama images via ControlNet inpainting. This control signal ensures the availability of global geometric information that may be hidden from a particular panoramic view by the furniture being removed. The inpainted panoramas are used to texture the mesh. We show that our approach produces higher quality assets than methods that rely on neural…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
Topics3D Shape Modeling and Analysis · Advanced Vision and Imaging · Computer Graphics and Visualization Techniques
