Detecting Frames in News Headlines and Lead Images in U.S. Gun Violence Coverage
Isidora Chara Tourni, Lei Guo, Hengchang Hu, Edward Halim, Prakash, Ishwar, Taufiq Daryanto, Mona Jalal, Boqi Chen, Margrit Betke, Fabian, Zhafransyah, Sha Lai, Derry Tanti Wijaya

TL;DR
This paper introduces a multimodal approach combining images and text to identify framing in U.S. gun violence news coverage, demonstrating improved accuracy and releasing a new annotated dataset for further research.
Contribution
It is the first study to combine lead images and text for framing detection and provides a new dataset for multimodal media analysis.
Findings
Multimodal features outperform single-mode in frame prediction.
Relevance of images correlates with ease of conveying frames.
First annotated multimodal dataset for gun violence news framing.
Abstract
News media structure their reporting of events or issues using certain perspectives. When describing an incident involving gun violence, for example, some journalists may focus on mental health or gun regulation, while others may emphasize the discussion of gun rights. Such perspectives are called \say{frames} in communication research. We study, for the first time, the value of combining lead images and their contextual information with text to identify the frame of a given news article. We observe that using multiple modes of information(article- and image-derived features) improves prediction of news frames over any single mode of information when the images are relevant to the frames of the headlines. We also observe that frame image relevance is related to the ease of conveying frames via images, which we call frame concreteness. Additionally, we release the first multimodal news…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
MethodsFocus
