# A Benchmark of Visual Storytelling in Social Media

## TL;DR

This paper introduces SocialStories, a benchmark with curated social media stories and new metrics to evaluate visual storytelling quality for news coverage, addressing challenges in organizing social media content coherently.

## Contribution

It presents a new benchmark dataset and evaluation metrics for assessing visual storytelling in social media, aiding the development of automated news visual storyline editing.

## Key findings

- Provides 40 curated social media stories for benchmarking.
- Introduces novel quantitative metrics for evaluation.
- Facilitates rigorous assessment of visual storytelling methods.

## Abstract

Media editors in the newsroom are constantly pressed to provide a "like-being there" coverage of live events. Social media provides a disorganised collection of images and videos that media professionals need to grasp before publishing their latest news updated. Automated news visual storyline editing with social media content can be very challenging, as it not only entails the task of finding the right content but also making sure that news content evolves coherently over time. To tackle these issues, this paper proposes a benchmark for assessing social media visual storylines. The SocialStories benchmark, comprised by total of 40 curated stories covering sports and cultural events, provides the experimental setup and introduces novel quantitative metrics to perform a rigorous evaluation of visual storytelling with social media data.