Semantic Segmentation in Art Paintings
Nadav Cohen, Yael Newman, Ariel Shamir

TL;DR
This paper introduces an unsupervised domain adaptation approach for semantic segmentation of art paintings, leveraging style transfer and a new diverse dataset to improve segmentation across various artistic styles without ground truth annotations.
Contribution
It proposes a novel multi-domain adaptation method and a new dataset, DRAM, for unsupervised semantic segmentation of diverse art paintings, addressing the challenge of style and content variability.
Findings
Improved segmentation accuracy on diverse art styles.
Effective domain adaptation between photographs and paintings.
Generalization to unseen artistic movements.
Abstract
Semantic segmentation is a difficult task even when trained in a supervised manner on photographs. In this paper, we tackle the problem of semantic segmentation of artistic paintings, an even more challenging task because of a much larger diversity in colors, textures, and shapes and because there are no ground truth annotations available for segmentation. We propose an unsupervised method for semantic segmentation of paintings using domain adaptation. Our approach creates a training set of pseudo-paintings in specific artistic styles by using style-transfer on the PASCAL VOC 2012 dataset, and then applies domain confusion between PASCAL VOC 2012 and real paintings. These two steps build on a new dataset we gathered called DRAM (Diverse Realism in Art Movements) composed of figurative art paintings from four movements, which are highly diverse in pattern, color, and geometry. To segment…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Aesthetic Perception and Analysis · Computer Graphics and Visualization Techniques
