Kiwifruit detection in challenging conditions
Mahla Nejati, Nicky Penhall, Henry Williams, Jamie Bell, JongYoon Lim,, Ho Seok Ahn, Bruce MacDonald

TL;DR
This paper introduces a semantic segmentation method with novel image preprocessing techniques to improve kiwifruit detection accuracy in challenging orchard lighting conditions, addressing occlusion and lighting issues for robotic harvesting.
Contribution
The paper presents two new image preprocessing techniques that significantly enhance kiwifruit detection under harsh lighting in a semantic segmentation framework.
Findings
Semantic segmentation achieves 0.82 F1_score in typical lighting.
Preprocessing improves F1_score to 0.42 under harsh lighting.
Detects 87% of non-occluded and 30% of occluded kiwifruit.
Abstract
Accurate and reliable kiwifruit detection is one of the biggest challenges in developing a selective fruit harvesting robot. The vision system of an orchard robot faces difficulties such as dynamic lighting conditions and fruit occlusions. This paper presents a semantic segmentation approach with two novel image prepossessing techniques designed to detect kiwifruit under the harsh lighting conditions found in the canopy. The performance of the presented system is evaluated on a 3D real-world image set of kiwifruit under different lighting conditions (typical, glare, and overexposed). Alone the semantic segmentation approach achieves an F1_score of 0.82 on the typical lighting image set, but struggles with harsh lighting with an F1_score of 0.13. Utilising the prepossessing techniques the vision system under harsh lighting improves to an F1_score 0.42. To address the fruit occlusion…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSmart Agriculture and AI · Spectroscopy and Chemometric Analyses · Advanced Chemical Sensor Technologies
