Toward a Thinking Microscope: Deep Learning in Optical Microscopy and Image Reconstruction

TL;DR

This paper explores how deep learning is revolutionizing optical microscopy and image reconstruction, enabling new imaging transformations and potentially transforming hardware and methods holistically.

Contribution

It highlights the emerging applications of deep learning in optical microscopy and discusses its potential to fundamentally change imaging hardware and reconstruction techniques.

Findings

Deep learning enables new transformations among imaging modes.

It has the potential to change microscopy hardware design.

Deep learning-driven reconstruction improves image quality.

Abstract

We discuss recently emerging applications of the state-of-art deep learning methods on optical microscopy and microscopic image reconstruction, which enable new transformations among different modes and modalities of microscopic imaging, driven entirely by image data. We believe that deep learning will fundamentally change both the hardware and image reconstruction methods used in optical microscopy in a holistic manner.