In the sight of my wearable camera: Classifying my visual experience
Alessandro Perina, Nebojsa Jojic

TL;DR
This paper presents a new dataset resembling biological vision input, demonstrating high accuracy in scene classification and highlighting the effectiveness of generative models for low-resolution, cluttered wearable camera data.
Contribution
Introduction of a biologically inspired dataset and analysis showing generative models outperform discriminative ones for wearable camera scene classification.
Findings
Over 80% accuracy in classifying dozens of scenes
Generative models are more robust to low resolution and clutter
Potential applications include dementia detection and automatic reminders
Abstract
We introduce and we analyze a new dataset which resembles the input to biological vision systems much more than most previously published ones. Our analysis leaded to several important conclusions. First, it is possible to disambiguate over dozens of visual scenes (locations) encountered over the course of several weeks of a human life with accuracy of over 80%, and this opens up possibility for numerous novel vision applications, from early detection of dementia to everyday use of wearable camera streams for automatic reminders, and visual stream exchange. Second, our experimental results indicate that, generative models such as Latent Dirichlet Allocation or Counting Grids, are more suitable to such types of data, as they are more robust to overtraining and comfortable with images at low resolution, blurred and characterized by relatively random clutter and a mix of objects.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Image and Video Retrieval Techniques · Visual Attention and Saliency Detection · Image Retrieval and Classification Techniques
