# A self-supervised machine learning pipeline for extracting information from live cell images at multiple doses and timepoints

## TL;DR

This paper introduces a new machine learning pipeline for analyzing live cell images to detect subtle changes in cell states over time and across drug doses.

## Contribution

The novel LCD pipeline uses self-supervised learning with plane-agnostic augmentation and cross-batch sampling for live brightfield imaging.

## Key findings

- LCD outperforms baseline models in phenotypic activity and MoA classification across multiple doses and timepoints.
- The method enables detection of compound polypharmacology from multi-dose/timepoint profiles.
- Unsupervised nuclei detection and counting are supported by the proposed pipeline.

## Abstract

Live cells are complex information-processing systems that continuously sense their environment and respond dynamically. However, conventional endpoint assays typically require fixation or cell destruction and fail to capture complex temporal changes. Live brightfield imaging offers a scalable, label-free solution that remains underutilized due to particularly low contrast, acute technical batch sensitivity, and the limited availability of robust computational methods for this modality. Leveraging recent self-supervised learning developments, we introduce Live Cell Dynamics (LCD), a novel end-to-end transformer-based pipeline, using novel plane-agnostic augmentation (treating different focal planes as views of the same state) and incorporating cross-batch sampling. LCD addresses brightfield modality challenges and extracts subtle dose- and time-dependent live cell states. Through systematic ablation we evaluate each self-supervised training innovation on a single cell line, measuring phenotypic activity (mean Average Precision) and Mechanism of Action (MoA) classification (F1-score), with 189 compounds in pre-training and 81 in holdout spanning ten MoAs. Our approach outperforms ablated baselines across all doses and timepoints for activity and MoA classification, enables compound polypharmacology detection from multi-dose/timepoint profiles, and supports unsupervised nuclei detection and counting. It leads to training foundation models from continuous live brightfield imaging to detect subtle live cell state changes, enabling scalable, cost-effective drug development.

The online version contains supplementary material available at 10.1038/s41598-025-32685-5.