High-Performance Ptychographic Reconstruction with Federated Facilities

TL;DR

This paper introduces a system that integrates synchrotron beamline data acquisition with remote high-performance computing resources, enabling real-time ptychographic image reconstruction for large datasets using automated workflows and secure authentication.

Contribution

The authors develop a unified system leveraging Globus Auth, funcX, and Globus Flows to automate and streamline high-volume data analysis from beamlines to supercomputers, specifically applied to ptychography.

Findings

Real-time analysis of ptychography data achieved during experiments.

System successfully handles hundreds of gigabytes to terabytes of data.

Automated workflows enable timely feedback during data acquisition.

Abstract

Beamlines at synchrotron light source facilities are powerful scientific instruments used to image samples and observe phenomena at high spatial and temporal resolutions. Typically, these facilities are equipped only with modest compute resources for the analysis of generated experimental datasets. However, high data rate experiments can easily generate data in volumes that take days (or even weeks) to process on those local resources. To address this challenge, we present a system that unifies leadership computing and experimental facilities by enabling the automated establishment of data analysis pipelines that extend from edge data acquisition systems at synchrotron beamlines to remote computing facilities; under the covers, our system uses Globus Auth authentication to minimize user interaction, funcX to run user-defined functions on supercomputers, and Globus Flows to define and execute workflows. We describe the application of this system to ptychography, an ultra-high-resolution coherent diffraction imaging technique that can produce 100s of gigabytes to terabytes in a single experiment. When deployed on the DGX A100 ThetaGPU cluster at the Argonne Leadership Computing Facility and a microscopy beamline at the Advanced Photon Source, our system performs analysis as an experiment progresses to provide timely feedback.