CRISP: A Framework for Cryo-EM Image Segmentation and Processing with Conditional Random Field

TL;DR

This paper introduces CRISP, a modular framework for cryo-EM image segmentation that combines various models and CRFs to improve accuracy and resolution in particle detection, even with limited training data.

Contribution

CRISP provides a flexible, automated pipeline integrating segmentation models and CRFs, enabling high-quality cryo-EM micrograph analysis with minimal training data.

Findings

Achieves over 90% accuracy and related metrics on synthetic data.

Produces higher resolution 3D density maps compared to existing methods.

Performs comparably to expert manual curation on real datasets.

Abstract

Differentiating signals from the background in micrographs is a critical initial step for cryogenic electron microscopy (cryo-EM), yet it remains laborious due to low signal-to-noise ratio (SNR), the presence of contaminants and densely packed particles of varying sizes. Although image segmentation has recently been introduced to distinguish particles at the pixel level, the low SNR complicates the automated generation of accurate annotations for training supervised models. Moreover, platforms for systematically comparing different design choices in pipeline construction are lacking. Thus, a modular framework is essential to understand the advantages and limitations of this approach and drive further development. To address these challenges, we present a pipeline that automatically generates high-quality segmentation maps from cryo-EM data to serve as ground truth labels. Our modular framework enables the selection of various segmentation models and loss functions. We also integrate Conditional Random Fields (CRFs) with different solvers and feature sets to refine coarse predictions, thereby producing fine-grained segmentation. This flexibility facilitates optimal configurations tailored to cryo-EM datasets. When trained on a limited set of micrographs, our approach achieves over 90% accuracy, recall, precision, Intersection over Union (IoU), and F1-score on synthetic data. Furthermore, to demonstrate our framework's efficacy in downstream analyses, we show that the particles extracted by our pipeline produce 3D density maps with higher resolution than those generated by existing particle pickers on real experimental datasets, while achieving performance comparable to that of manually curated datasets from experts.