# A hybrid pipeline for carotid artery segmentation using YOLOv11n and contour models

**Authors:** Gerges M. Salama, Mohammed Safy, Dina A. Hassanin, Ashraf A. M. Khalaf, Mahmoud Khaled Abd-Ellah

PMC · DOI: 10.1038/s41598-026-41007-2 · 2026-03-23

## TL;DR

This paper introduces a fast and accurate hybrid system for automatically segmenting carotid arteries in ultrasound images, improving detection of vascular disease.

## Contribution

A novel hybrid pipeline combining YOLOv11n and contour models for automatic carotid artery segmentation in both transverse and longitudinal sections.

## Key findings

- The pipeline achieved 94.9% Dice index and 97.7% accuracy for longitudinal carotid artery segmentation.
- For transverse sections, the system reached 90.8% Dice index and 99.6% accuracy.
- The system operates in near real-time (<1 second) on low-end hardware, showing computational efficiency.

## Abstract

Carotid artery segmentation is critical for determining the degree of vascular disease, and for recommending treatment options. Early detection of carotid atherosclerosis is critical for preventing stroke. Stroke-related brain damage can cause deficits in speech or vision, and large strokes can be fatal. However, automatic segmentation of the carotid artery lumen remains difficult due to the low quality of US images, and the existence of stenosis, jugular veins, and abnormalities in carotid images. This article presents a hybrid pipeline for segmenting both carotid transverse and longitudinal lumens without any user interaction. This hybrid pipeline starts with automatically localizing the carotid artery lumen in the transverse and longitudinal sections via YOLOv11n. Then, a multistage preprocessing framework was applied to the transverse section before its lumen was segmented by the active contour. For the longitudinal section, an automated padded mask was generated to guarantee reliable initialization for Chan-Vese level-set evolution. A paired t test validated the relevance of the proposed modules (p < 0.0001). The proposed multiphase segmentation pipeline achieved a Dice index and accuracy of 94.9% and 97.7%, respectively, for the longitudinal section and 90.8% and 99.6%, respectively, for the transverse section. A comprehensive ablation analysis has shown that numerical stability depends on the YOLOv11n localization phase. The system attained near real-time inference for the carotid transverse section (< 1 s) despite being evaluated on low-end hardware, demonstrating its computational efficiency and promise for clinical integration.

## Linked entities

- **Diseases:** stroke (MONDO:0005098)

## Full-text entities

- **Diseases:** Carotid artery disease (MESH:D002340), Stroke (MESH:D020521), cerebrovascular disorders (MESH:D002561), heart attack (MESH:D009203), CCA (MESH:C536211), deficits in speech or vision (MESH:D014786), death (MESH:D003643), arteries (MESH:D012078), Heart disease (MESH:D006331), carotid stenosis (MESH:D016893), brain damage (MESH:D001925), cardiovascular disorders (MESH:D002318), vascular disease (MESH:D014652), atherosclerosis (MESH:D050197), intracranial aneurysms (MESH:D002532), diabetic (MESH:D003920)
- **Chemicals:** cholesterol (MESH:D002784), CLAHE (-), lipid (MESH:D008055), SP (MESH:C000604007)
- **Species:** Homo sapiens (human, species) [taxon 9606]
- **Cell lines:** YOLOv11n — Homo sapiens (Human), Induced pluripotent stem cell (CVCL_VM32)

## Figures

11 figures with captions in the complete paper: https://tomesphere.com/paper/PMC13018575/full.md

---
Source: https://tomesphere.com/paper/PMC13018575