GUIDE-VAE: Advancing Data Generation with User Information and Pattern Dictionaries

TL;DR

GUIDE-VAE is a new conditional generative model that uses user embeddings and pattern dictionaries to produce realistic, user-guided data, especially effective in imbalanced multi-user datasets.

Contribution

It introduces GUIDE-VAE, combining user embeddings and pattern dictionary-based covariance to enhance data realism and performance in multi-user generative tasks.

Findings

Outperforms existing models in synthetic data generation.

Effectively handles data imbalance across users.

Produces more plausible and less noisy data.

Abstract

Generative modelling of multi-user datasets has become prominent in science and engineering. Generating a data point for a given user requires employing user information, and conventional generative models, including variational autoencoders (VAEs), often ignore this. This paper introduces GUIDE-VAE, a novel conditional generative model that leverages user embeddings to generate user-guided data. By leveraging shared patterns across users, GUIDE-VAE improves performance in multi-user settings, even under significant data imbalance. In addition to integrating user information, GUIDE-VAE incorporates a pattern dictionary-based covariance composition (PDCC) to improve the realism of generated samples by capturing complex feature dependencies. While user embeddings drive performance gains, PDCC addresses common issues such as noise and over-smoothing typically seen in VAEs. The proposed GUIDE-VAE was evaluated on a multi-user smart meter dataset characterised by substantial data imbalance across users. Quantitative results show that GUIDE-VAE performs effectively on both synthetic data generation and missing-record imputation tasks, while qualitative evaluations indicate that it produces more plausible and less noisy data. These results establish GUIDE-VAE as a promising tool for controlled, realistic data generation in multi-user datasets, with potential applications across domains that require user-informed modelling.