syGlass: Interactive Exploration of Multidimensional Images Using Virtual Reality Head-mounted Displays

TL;DR

syGlass is a virtual reality software that enables immersive exploration and manipulation of large multidimensional biological image datasets, significantly enhancing perception and interaction in 3D space.

Contribution

It introduces a highly optimized VR visualization system capable of handling datasets up to 16TB, with interactive tools for data exploration, annotation, and cataloguing.

Findings

Enhanced perception of complex 3D structures through stereoscopic VR

Successful visualization of datasets up to 16TB in size

Immersive interaction improves data understanding and analysis

Abstract

The quest for deeper understanding of biological systems has driven the acquisition of increasingly larger multidimensional image datasets. Inspecting and manipulating data of this complexity is very challenging in traditional visualization systems. We developed syGlass, a software package capable of visualizing large scale volumetric data with inexpensive virtual reality head-mounted display technology. This allows leveraging stereoscopic vision to significantly improve perception of complex 3D structures, and provides immersive interaction with data directly in 3D. We accomplished this by developing highly optimized data flow and volume rendering pipelines, tested on datasets up to 16TB in size, as well as tools available in a virtual reality GUI to support advanced data exploration, annotation, and cataloguing.