World-Shaper: A Unified Framework for 360{\deg} Panoramic Editing

TL;DR

World-Shaper introduces a geometry-aware framework for 360-degree panoramic editing directly in the equirectangular domain, enabling more consistent and controllable editing of panoramic images.

Contribution

It reformulates panoramic editing in the ERP domain, employs a generate-then-edit paradigm, and introduces a geometry-aware learning strategy for improved consistency and fidelity.

Findings

Achieves superior geometric consistency over SOTA methods

Demonstrates high editing fidelity and text controllability

Enables coherent 360-degree visual world creation

Abstract

Being able to edit panoramic images is crucial for creating realistic 360{\deg} visual experiences. However, existing perspective-based image editing methods fail to model the spatial structure of panoramas. Conventional cube-map decompositions attempt to overcome this problem but inevitably break global consistency due to their mismatch with spherical geometry. Motivated by this insight, we reformulate panoramic editing directly in the equirectangular projection (ERP) domain and present World-Shaper, a unified geometry-aware framework that bridges panoramic generation and editing within a single editing-centric design. To overcome the scarcity of paired data, we adopt a generate-then-edit paradigm, where controllable panoramic generation serves as an auxiliary stage to synthesize diverse paired examples for supervised editing learning. To address geometric distortion, we introduce a geometry-aware learning strategy that explicitly enforces position-aware shape supervision and implicitly internalizes panoramic priors through progressive training. Extensive experiments on our new benchmark, PEBench, demonstrate that our method achieves superior geometric consistency, editing fidelity, and text controllability compared to SOTA methods, enabling coherent and flexible 360{\deg} visual world creation with unified editing control. Code, model, and data will be released at our project page: https://world-shaper-project.github.io/