Multispectral Texture Synthesis using RGB Convolutional Neural Networks
S\'elim Ollivier, Yann Gousseau, Sidonie Lefebvre

TL;DR
This paper extends RGB texture synthesis algorithms to multispectral images using two methods that do not require retraining neural networks, enabling effective exemplar-based multispectral texture synthesis with good visual quality.
Contribution
It introduces two novel approaches for multispectral texture synthesis that adapt existing RGB methods without additional network training.
Findings
Methods achieve comparable quality to RGB state-of-the-art techniques.
Projection-based approach benefits from upstream color transfer.
Approaches perform well across various metrics.
Abstract
State-of-the-art RGB texture synthesis algorithms rely on style distances that are computed through statistics of deep features. These deep features are extracted by classification neural networks that have been trained on large datasets of RGB images. Extending such synthesis methods to multispectral images is not straightforward, since the pre-trained networks are designed for and have been trained on RGB images. In this work, we propose two solutions to extend these methods to multispectral imaging. Neither of them require additional training of the neural network from which the second order neural statistics are extracted. The first one consists in optimizing over batches of random triplets of spectral bands throughout training. The second one projects multispectral pixels onto a 3 dimensional space. We further explore the benefit of a color transfer operation upstream of the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
