Who Ordered This?: Exploiting Implicit User Tag Order Preferences for Personalized Image Tagging
Amandianeze O. Nwana, Tsuhan Chen

TL;DR
This paper investigates how implicit user tag order preferences can be exploited to enhance personalized image tagging systems, revealing that tag order is a valuable cue for improving auto-tagging accuracy.
Contribution
It introduces a novel approach that measures tag preferences based on order and incorporates this into a personalized tagging objective, improving existing auto-tagging methods.
Findings
Exploiting tag order improves auto-tagging performance.
Personalized tag order modeling enhances accuracy for individual users.
The proposed algorithm effectively optimizes the new tagging objective.
Abstract
What makes a person pick certain tags over others when tagging an image? Does the order that a person presents tags for a given image follow an implicit bias that is personal? Can these biases be used to improve existing automated image tagging systems? We show that tag ordering, which has been largely overlooked by the image tagging community, is an important cue in understanding user tagging behavior and can be used to improve auto-tagging systems. Inspired by the assumption that people order their tags, we propose a new way of measuring tag preferences, and also propose a new personalized tagging objective function that explicitly considers a user's preferred tag orderings. We also provide a (partially) greedy algorithm that produces good solutions to our new objective and under certain conditions produces an optimal solution. We validate our method on a subset of Flickr images that…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
