Picture What you Read

TL;DR

This paper explores using convolutional neural networks to generate realistic images from text descriptions, enhancing visualization and comprehension of textual content.

Contribution

It introduces a CNN-based model capable of generating images conditioned on natural language descriptions, demonstrating its effectiveness through various experiments.

Findings

The model can produce realistic images from text descriptions.

Experiments show the generated images accurately reflect the semantic content.

The approach advances visualization techniques in NLP and image synthesis.

Abstract

Visualization refers to our ability to create an image in our head based on the text we read or the words we hear. It is one of the many skills that makes reading comprehension possible. Convolutional Neural Networks (CNN) are an excellent tool for recognizing and classifying text documents. In addition, it can generate images conditioned on natural language. In this work, we utilize CNNs capabilities to generate realistic images representative of the text illustrating the semantic concept. We conducted various experiments to highlight the capacity of the proposed model to generate representative images of the text descriptions used as input to the proposed model.