SenseAI: Real-Time Inpainting for Electron Microscopy

TL;DR

SenseAI is a C++/CUDA library enabling real-time, dictionary-based inpainting for electron microscopy, significantly reducing reconstruction times and facilitating subsampled data acquisition.

Contribution

The paper introduces SenseAI, a novel library that achieves real-time inpainting in electron microscopy using efficient dictionary learning and sparse coding techniques.

Findings

Enables real-time inpainting for EM data

Supports N-dimensional dictionary learning and visualization

Reduces reconstruction time significantly

Abstract

Despite their proven success and broad applicability to Electron Microscopy (EM) data, joint dictionary-learning and sparse-coding based inpainting algorithms have so far remained impractical for real-time usage with an Electron Microscope. For many EM applications, the reconstruction time for a single frame is orders of magnitude longer than the data acquisition time, making it impossible to perform exclusively subsampled acquisition. This limitation has led to the development of SenseAI, a C++/CUDA library capable of extremely efficient dictionary-based inpainting. SenseAI provides N-dimensional dictionary learning, live reconstructions, dictionary transfer and visualization, as well as real-time plotting of statistics, parameters, and image quality metrics.