SemEval-2020 Task 10: Emphasis Selection for Written Text in Visual Media
Amirreza Shirani, Franck Dernoncourt, Nedim Lipka, Paul Asente, Jose, Echevarria, Thamar Solorio

TL;DR
This paper reports on SemEval-2020 Task 10, which focused on developing automatic emphasis selection methods for short social media texts, highlighting the effectiveness of pre-trained language models like BERT and RoBERTa.
Contribution
It presents the shared task setup, participant results, and insights into effective features and models for emphasis selection in visual media texts.
Findings
BERT and RoBERTa were the most used models
Part of speech tags improved emphasis prediction
Highest system achieved 0.823 Matchm score
Abstract
In this paper, we present the main findings and compare the results of SemEval-2020 Task 10, Emphasis Selection for Written Text in Visual Media. The goal of this shared task is to design automatic methods for emphasis selection, i.e. choosing candidates for emphasis in textual content to enable automated design assistance in authoring. The main focus is on short text instances for social media, with a variety of examples, from social media posts to inspirational quotes. Participants were asked to model emphasis using plain text with no additional context from the user or other design considerations. SemEval-2020 Emphasis Selection shared task attracted 197 participants in the early phase and a total of 31 teams made submissions to this task. The highest-ranked submission achieved 0.823 Matchm score. The analysis of systems submitted to the task indicates that BERT and RoBERTa were the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
MethodsLinear Layer · WordPiece · Dense Connections · Linear Warmup With Linear Decay · Refunds@Expedia|||How do I get a full refund from Expedia? · Residual Connection · Layer Normalization · Attention Is All You Need · Multi-Head Attention · Dropout
