Nanosurveyor: a framework for real-time data processing

TL;DR

Nanosurveyor is a real-time data processing framework for high-throughput synchrotron experiments, enabling faster analysis, compression, and feedback to improve scientific observations.

Contribution

It introduces an integrated software framework that streamlines ptychography data analysis for high-speed experimental data processing.

Findings

Enhanced data throughput and compression capabilities.

Rapid feedback mechanism for microscope operators.

Improved resolution and analysis speed in synchrotron experiments.

Abstract

Scientists are drawn to synchrotrons and accelerator based light sources because of their brightness, coherence and flux. The rate of improvement in brightness and detector technology has outpaced Moore's law growth seen for computers, networks, and storage, and is enabling novel observations and discoveries with faster frame rates, larger fields of view, higher resolution, and higher dimensionality. Here we present an integrated software/algorithmic framework designed to capitalize on high throughput experiments, and describe the streamlined processing pipeline of ptychography data analysis. The pipeline provides throughput, compression, and resolution as well as rapid feedback to the microscope operators.