# A digital twin–driven deep learning framework for online quality inspection in tobacco transplanting

## TL;DR

This paper introduces a digital twin and deep learning system to improve the efficiency and accuracy of tobacco transplanting quality inspection.

## Contribution

A lightweight YAN-YOLO11 algorithm and a digital twin framework for real-time tobacco transplanting quality inspection are proposed.

## Key findings

- The YAN-YOLO11 algorithm improves precision, recall, and mAP metrics compared to YOLO11n while reducing model complexity.
- The system achieves 30 FPS real-time performance and 90.74% overall recognition accuracy in field tests.
- The digital twin framework enables real-time visualization and feedback for replanting decisions and machine optimization.

## Abstract

Tobacco transplanting quality inspection is crucial for tobacco production, as it directly affects crop yield and quality of tobacco leaves. Accurate transplanting status detection and assessment provide essential support for replanting decisions and transplanting machine optimization. Traditional methods rely on manual inspection, which suffer from high cost, low efficiency, and unstable results. To tackle the aforementioned issues, this paper proposes a Deep Learning and Digital Twin driven Online Quality Inspection Method for Tobacco Transplanting, which consists of four core modules: Transplanting Status Detection, Multi-sensor Data Fusion, Digital Twin Visualization, and Operational Optimization Feedback. This paper proposes a lightweight improved YAN-YOLO11 algorithm capable of assessing normal, exposed-root, and buried seedlings. By fusing GNSS positioning data with visual detection results, the system estimates in-row spacing and performs status assessment for missed planting and double planting. The system establishes a virtual-real interactive closed-loop of “collection-detection-mapping-feedback” via the digital twin. By visualizing operational status in real-time and generating replanting path suggestions, it provides guidance for operation management and significantly improves inspection efficiency. Field experiments demonstrate that, compared with YOLO11n, YAN-YOLO11 improves precision and recall by 2.4% and 2.5%, respectively; mAP@50 increased by 3% to 80.9% ± 1.4%, and mAP@0.5:0.95 increased by 5.8% to 54.2% ± 1.0%, while significantly reducing model complexity. The system achieves a real-time performance of 30 FPS in the field, with an overall recognition accuracy of 90.74%, meeting practical application requirements. This study effectively enhances the digitalization, automation, and refined management of tobacco transplanting operations, providing a theoretical foundation and practical solution for the intelligent transformation of transplanting machinery and precision crop management.