6D Strawberry Pose Estimation: Real-time and Edge AI Solutions Using Purely Synthetic Training Data

TL;DR

This paper presents a real-time 6D strawberry pose estimation method using synthetic data generated through a procedural pipeline, optimized for edge AI devices, to improve automated fruit harvesting.

Contribution

It introduces a novel synthetic data generation pipeline and employs YOLOX-6D-Pose for accurate, real-time strawberry pose estimation suitable for resource-constrained environments.

Findings

Achieves comparable accuracy on NVIDIA RTX 3090 and Jetson Orin Nano

Demonstrates real-time performance suitable for edge deployment

Shows effective pose estimation for ripe strawberries, with challenges in unripe detection

Abstract

Automated and selective harvesting of fruits has become an important area of research, particularly due to challenges such as high costs and a shortage of seasonal labor in advanced economies. This paper focuses on 6D pose estimation of strawberries using purely synthetic data generated through a procedural pipeline for photorealistic rendering. We employ the YOLOX-6D-Pose algorithm, a single-shot approach that leverages the YOLOX backbone, known for its balance between speed and accuracy, and its support for edge inference. To address the lacking availability of training data, we introduce a robust and flexible pipeline for generating synthetic strawberry data from various 3D models via a procedural Blender pipeline, where we focus on enhancing the realism of the synthesized data in comparison to previous work to make it a valuable resource for training pose estimation algorithms. Quantitative evaluations indicate that our models achieve comparable accuracy on both the NVIDIA RTX 3090 and Jetson Orin Nano across several ADD-S metrics, with the RTX 3090 demonstrating superior processing speed. However, the Jetson Orin Nano is particularly suited for resource-constrained environments, making it an excellent choice for deployment in agricultural robotics. Qualitative assessments further confirm the model's performance, demonstrating its capability to accurately infer the poses of ripe and partially ripe strawberries, while facing challenges in detecting unripe specimens. This suggests opportunities for future improvements, especially in enhancing detection capabilities for unripe strawberries (if desired) by exploring variations in color. Furthermore, the methodology presented could be adapted easily for other fruits such as apples, peaches, and plums, thereby expanding its applicability and impact in the field of agricultural automation.