DTBIA: An Immersive Visual Analytics System for Brain-Inspired Research

TL;DR

DTBIA is an immersive visual analytics system designed to help brain researchers visualize and understand complex high-dimensional, spatiotemporal brain data generated by the Digital Twin Brain AI framework.

Contribution

The paper introduces DTBIA, a novel immersive visualization system tailored for brain-inspired data, incorporating hierarchical workflows and advanced visualization algorithms.

Findings

Enhanced understanding of neural behaviors through DTBIA

Improved visualization of high-dimensional brain data

Validated effectiveness via case studies with experts

Abstract

The Digital Twin Brain (DTB) is an advanced artificial intelligence framework that integrates spiking neurons to simulate complex cognitive functions and collaborative behaviors. For domain experts, visualizing the DTB's simulation outcomes is essential to understanding complex cognitive activities. However, this task poses significant challenges due to DTB data's inherent characteristics, including its high-dimensionality, temporal dynamics, and spatial complexity. To address these challenges, we developed DTBIA, an Immersive Visual Analytics System for Brain-Inspired Research. In collaboration with domain experts, we identified key requirements for effectively visualizing spatiotemporal and topological patterns at multiple levels of detail. DTBIA incorporates a hierarchical workflow - ranging from brain regions to voxels and slice sections - along with immersive navigation and a 3D edge bundling algorithm to enhance clarity and provide deeper insights into both functional (BOLD) and structural (DTI) brain data. The utility and effectiveness of DTBIA are validated through two case studies involving with brain research experts. The results underscore the system's role in enhancing the comprehension of complex neural behaviors and interactions.