A Segment Anything Model-based tool for semi-automated behavioural analysis of Drosophila and other model organisms
Sarah Mele, Joshua Millward, Long Nguyen, Natasha Ruth, Jemma Gasperoni, Sebastian Dworkin, Zhen He, Travis K. Johnson

TL;DR
A new tool called SAMBA uses advanced AI to track and analyze the behavior of fruit flies and other organisms without needing special equipment or coding skills.
Contribution
SAMBA introduces a semi-automated behavioral analysis pipeline using the Segment Anything Model 2, enabling cross-species behavior tracking with minimal user input.
Findings
SAMBA accurately tracks movement and detects behavioral states in Drosophila models of neurological disease.
The tool shows adaptability to both adult Drosophila and larval zebrafish, demonstrating cross-species utility.
SAMBA reduces technical barriers for analyzing motor pattern defects and supports batch processing.
Abstract
Quantitative behavioural analysis is a powerful approach for linking genotype to phenotype, but many existing tools require specialised hardware, extensive preprocessing or coding expertise. We present Segment Anything Model for Behavioural Analysis (SAMBA), an open-access, Google Colab-based pipeline that harnesses the Segment Anything Model 2 (SAM2) for accurate, semi-automated tracking without thresholding or background subtraction. With minimal user input, SAMBA extracts movement parameters, detects behavioural states and supports batch processing. Validating SAMBA in three Drosophila melanogaster models of human neurological disease revealed impaired locomotion, reduced speed and altered decision-making. We further demonstrated adaptability to adult Drosophila and larval zebrafish, underscoring its cross-species utility. By combining foundation-model segmentation with an accessible…
Genes, proteins, chemicals, diseases, species, mutations and cell lines named across the full text — each resolved to its canonical identifier and authoritative record.
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsZebrafish Biomedical Research Applications · Neurobiology and Insect Physiology Research · Developmental Biology and Gene Regulation
