Does the Layout Really Matter? A Study on Visual Model Accuracy Estimation
Nicolas Grossmann, J\"urgen Bernard, Michael Sedlmair, Manuela Waldner

TL;DR
This study investigates how image complexity and layout affect visual model accuracy estimation, finding that image complexity influences performance but layout has minimal impact, with users outperforming automated methods.
Contribution
It provides a systematic analysis of the effects of layout and image complexity on accuracy estimation in visual interactive labeling.
Findings
Users outperform automated accuracy estimation methods.
Image complexity affects estimation performance.
Layout has little to no effect on accuracy estimation.
Abstract
In visual interactive labeling, users iteratively assign labels to data items until the machine model reaches an acceptable accuracy. A crucial step of this process is to inspect the model's accuracy and decide whether it is necessary to label additional elements. In scenarios with no or very little labeled data, visual inspection of the predictions is required. Similarity-preserving scatterplots created through a dimensionality reduction algorithm are a common visualization that is used in these cases. Previous studies investigated the effects of layout and image complexity on tasks like labeling. However, model evaluation has not been studied systematically. We present the results of an experiment studying the influence of image complexity and visual grouping of images on model accuracy estimation. We found that users outperform traditional automated approaches when estimating a…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsData Visualization and Analytics · Data Analysis with R · Image Retrieval and Classification Techniques
