Benchmarking Preprocessing and Integration Methods in Single-Cell Genomics

TL;DR

This paper systematically evaluates various preprocessing, normalization, and integration methods for single-cell multimodal data, highlighting optimal combinations and their performance across diverse datasets.

Contribution

It provides a comprehensive benchmarking of preprocessing and integration techniques in single-cell genomics, guiding method selection based on dataset characteristics.

Findings

Harmony and Seurat are top data integration methods.

Harmony is more time-efficient for large datasets.

UMAP pairs well with various integration techniques.

Abstract

Single-cell data analysis has the potential to revolutionize personalized medicine by characterizing disease-associated molecular changes at the single-cell level. Advanced single-cell multimodal assays can now simultaneously measure various molecules (e.g., DNA, RNA, Protein) across hundreds of thousands of individual cells, providing a comprehensive molecular readout. A significant analytical challenge is integrating single-cell measurements across different modalities. Various methods have been developed to address this challenge, but there has been no systematic evaluation of these techniques with different preprocessing strategies. This study examines a general pipeline for single-cell data analysis, which includes normalization, data integration, and dimensionality reduction. The performance of different algorithm combinations often depends on the dataset sizes and characteristics. We evaluate six datasets across diverse modalities, tissues, and organisms using three metrics: Silhouette Coefficient Score, Adjusted Rand Index, and Calinski-Harabasz Index. Our experiments involve combinations of seven normalization methods, four dimensional reduction methods, and five integration methods. The results show that Seurat and Harmony excel in data integration, with Harmony being more time-efficient, especially for large datasets. UMAP is the most compatible dimensionality reduction method with the integration techniques, and the choice of normalization method varies depending on the integration method used.