BROW: Better featuRes fOr Whole slide image based on self-distillation

TL;DR

BROW is a foundation model for whole slide images that uses self-distillation and multi-scale features to improve WSI feature extraction, enabling better performance across various downstream pathology tasks.

Contribution

The paper introduces BROW, a novel transformer-based foundation model utilizing self-distillation and multi-scale pyramid features for enhanced WSI representation.

Findings

BROW achieves superior performance on slide-level subtyping.

The model demonstrates robustness across diverse tasks.

It generalizes well to different datasets.

Abstract

Whole slide image (WSI) processing is becoming part of the key components of standard clinical diagnosis for various diseases. However, the direct application of conventional image processing algorithms to WSI faces certain obstacles because of WSIs' distinct property: the super-high resolution. The performance of most WSI-related tasks relies on the efficacy of the backbone which extracts WSI patch feature representations. Hence, we proposed BROW, a foundation model for extracting better feature representations for WSIs, which can be conveniently adapted to downstream tasks without or with slight fine-tuning. The model takes transformer architecture, pretrained using self-distillation framework. To improve model's robustness, techniques such as patch shuffling have been employed. Additionally, the model leverages the unique properties of WSIs, utilizing WSI's multi-scale pyramid to incorporate an additional global view, thereby further enhancing its performance. We used both private and public data to make up a large pretraining dataset, containing more than 11000 slides, over 180M extracted patches, encompassing WSIs related to various organs and tissues. To assess the effectiveness of \ourmodel, we run a wide range of downstream tasks, including slide-level subtyping, patch-level classification and nuclei instance segmentation. The results confirmed the efficacy, robustness and good generalization ability of the proposed model. This substantiates its potential as foundation model for WSI feature extraction and highlights promising prospects for its application in WSI processing.