ChatGPT and general-purpose AI count fruits in pictures surprisingly well
Konlavach Mengsuwan, Juan Camilo Rivera Palacio, Masahiro Ryo

TL;DR
This study shows that foundation models like T-Rex and ChatGPT can effectively count fruits in images with minimal training, saving time and effort compared to traditional deep learning models like YOLOv8.
Contribution
The paper demonstrates that foundation models and ChatGPT can perform object counting tasks with few-shot learning, reducing data requirements and implementation time in practical applications.
Findings
Foundation model with few-shot learning outperforms YOLOv8 in accuracy.
ChatGPT shows promising counting performance with minimal training.
Implementation time for foundation models and ChatGPT is significantly shorter.
Abstract
Object counting is a popular task in deep learning applications in various domains, including agriculture. A conventional deep learning approach requires a large amount of training data, often a logistic problem in a real-world application. To address this issue, we examined how well ChatGPT (GPT4V) and a general-purpose AI (foundation model for object counting, T-Rex) can count the number of fruit bodies (coffee cherries) in 100 images. The foundation model with few-shot learning outperformed the trained YOLOv8 model (R2 = 0.923 and 0.900, respectively). ChatGPT also showed some interesting potential, especially when few-shot learning with human feedback was applied (R2 = 0.360 and 0.460, respectively). Moreover, we examined the time required for implementation as a practical question. Obtaining the results with the foundation model and ChatGPT were much shorter than the YOLOv8 model…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsArtificial Intelligence in Healthcare and Education
MethodsYou Only Look Once
