GFlowState: Visualizing the Training of Generative Flow Networks Beyond the Reward

TL;DR

GFlowState is a visual analytics tool that helps interpret and debug the training process of Generative Flow Networks by visualizing sampling trajectories and training dynamics.

Contribution

We introduce GFlowState, a novel visualization system that reveals the training dynamics and sampling behavior of GFlowNets, improving interpretability and development.

Findings

Enables analysis of sampling trajectories and policy evolution.

Assists in identifying underexplored regions and training failures.

Supports debugging and quality assessment of GFlowNets.

Abstract

We present GFlowState, a visual analytics system designed to illuminate the training process of Generative Flow Networks (GFlowNets or GFNs). GFlowNets are a probabilistic framework for generating samples proportionally to a reward function. While GFlowNets have proved to be powerful tools in applications such as molecule and material discovery, their training dynamics remain difficult to interpret. Standard machine learning tools allow metric tracking but do not reveal how models explore the sample space, construct sample trajectories, or shift sampling probabilities during training. Our solution, GFlowState, allows users to analyze sampling trajectories, compare the sample space relative to reference datasets, and analyze the training dynamics. To this end, we introduce multiple views, including a chart of candidate rankings, a state projection, a node-link diagram of the trajectory network, and a transition heatmap. These visualizations enable GFlowNet developers and users to investigate sampling behavior and policy evolution, and to identify underexplored regions and sources of training failure. Case studies demonstrate how the system supports debugging and assessing the quality of GFlowNets across application domains. By making the structural dynamics of GFlowNets observable, our work enhances their interpretability and can accelerate GFlowNet development in practice.