Negative Shanshui: Real-time Interactive Ink Painting Synthesis
Aven-Le Zhou

TL;DR
Negative Shanshui introduces a real-time interactive AI system that reinterprets traditional Chinese landscape painting through gaze-driven VR, fostering ecological reflection and audience engagement.
Contribution
The paper develops a novel real-time AI synthesis method combining fine-tuned Stable Diffusion with gaze-based interaction for immersive art experiences.
Findings
Audience engaged through empathy and critical reflection.
System enables dynamic, gaze-responsive ink painting animations.
Successful deployment in an art festival setting.
Abstract
This paper presents Negative Shanshui, a real-time interactive AI synthesis approach that reinterprets classical Chinese landscape ink painting, i.e., shanshui, to engage with ecological crises in the Anthropocene. Negative Shanshui optimizes a fine-tuned Stable Diffusion model for real-time inferences and integrates it with gaze-driven inpainting, frame interpolation; it enables dynamic morphing animations in response to the viewer's gaze and presents as an interactive virtual reality (VR) experience. The paper describes the complete technical pipeline, covering the system framework, optimization strategies, gaze-based interaction, and multimodal deployment in an art festival. Further analysis of audience feedback collected during its public exhibition highlights how participants variously engaged with the work through empathy, ambivalence, and critical reflection.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
