Verifying Design through Generative Visualization of Neural Activities

TL;DR

This paper introduces a novel method that uses neural networks to visualize brain activity, enabling the reconstruction of images from EEG signals to verify design effectiveness through cognitive visualization.

Contribution

It presents a new approach combining neural encoding and generative models to visualize mental associations with designs from brain activity data.

Findings

Successfully reconstructed images from EEG signals.

Demonstrated potential for verifying designs via neural visualization.

Indicated iconic designs can evoke specific cognitive associations.

Abstract

Current neuroscience focused approaches for evaluating the effectiveness of a design do not use direct visualisation of mental activity. A recurrent neural network is used as the encoder to learn latent representation from electroencephalogram (EEG) signals, recorded while subjects looked at 50 categories of images. A generative adversarial network (GAN) conditioned on the EEG latent representation is trained for reconstructing these images. After training, the neural network is able to reconstruct images from brain activity recordings. To demonstrate the proposed method in the context of the mental association with a design, we performed a study that indicates an iconic design image could inspire the subject to create cognitive associations with branding and valued products. The proposed method could have the potential in verifying designs by visualizing the cognitive understanding of underlying brain activity.