TL;DR
This paper introduces neural network models trained on human annotations to predict the importance of elements in visual designs, aiding automatic retargeting, thumbnailing, and interactive design feedback.
Contribution
The paper presents a new dataset and neural network models for predicting visual importance in designs, enabling improved automated and interactive design tools.
Findings
Models outperform existing saliency methods in importance prediction
Importance-driven applications match or surpass state-of-the-art performance
User studies validate effectiveness of importance-based design tools
Abstract
Knowing where people look and click on visual designs can provide clues about how the designs are perceived, and where the most important or relevant content lies. The most important content of a visual design can be used for effective summarization or to facilitate retrieval from a database. We present automated models that predict the relative importance of different elements in data visualizations and graphic designs. Our models are neural networks trained on human clicks and importance annotations on hundreds of designs. We collected a new dataset of crowdsourced importance, and analyzed the predictions of our models with respect to ground truth importance and human eye movements. We demonstrate how such predictions of importance can be used for automatic design retargeting and thumbnailing. User studies with hundreds of MTurk participants validate that, with limited…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
