Quantification and Classification of Carbon Nanotubes in Electron Micrographs using Vision Foundation Models

TL;DR

This paper introduces an automated framework using vision foundation models to accurately quantify and classify carbon nanotubes in electron microscopy images, significantly improving speed and reproducibility over manual methods.

Contribution

It presents a novel combination of SAM for segmentation and DINOv2 for classification, enabling high-accuracy, instance-level analysis of CNTs with minimal training data.

Findings

Achieved 95.5% accuracy in classifying four CNT morphologies

Outperformed existing baseline methods

Enabled analysis of mixed samples within single images

Abstract

Accurate characterization of carbon nanotube morphologies in electron microscopy images is vital for exposure assessment and toxicological studies, yet current workflows rely on slow, subjective manual segmentation. This work presents a unified framework leveraging vision foundation models to automate the quantification and classification of CNTs in electron microscopy images. First, we introduce an interactive quantification tool built on the Segment Anything Model (SAM) that segments particles with near-perfect accuracy using minimal user input. Second, we propose a novel classification pipeline that utilizes these segmentation masks to spatially constrain a DINOv2 vision transformer, extracting features exclusively from particle regions while suppressing background noise. Evaluated on a dataset of 1,800 TEM images, this architecture achieves 95.5% accuracy in distinguishing between four different CNT morphologies, significantly outperforming the current baseline despite using a fraction of the training data. Crucially, this instance-level processing allows the framework to resolve mixed samples, correctly classifying distinct particle types co-existing within a single field of view. These results demonstrate that integrating zero-shot segmentation with self-supervised feature learning enables high-throughput, reproducible nanomaterial analysis, transforming a labor-intensive bottleneck into a scalable, data-driven process.