DEFEND: A Large-scale 1M Dataset and Foundation Model for Tobacco Addiction Prevention

TL;DR

This paper introduces Tobacco-1M, a large-scale dataset, and DEFEND, a foundation model for tobacco product understanding, significantly enhancing surveillance and regulation of tobacco marketing on social media.

Contribution

The paper presents a comprehensive dataset and a novel foundation model with advanced modules for improved tobacco product recognition and analysis.

Findings

Achieved 83.1% accuracy in product classification

Attained 73.8% accuracy in visual question-answering

Demonstrated strong zero-shot learning capabilities with 45.6% accuracy

Abstract

While tobacco advertising innovates at unprecedented speed, traditional surveillance methods remain frozen in time, especially in the context of social media. The lack of large-scale, comprehensive datasets and sophisticated monitoring systems has created a widening gap between industry advancement and public health oversight. This paper addresses this critical challenge by introducing Tobacco-1M, a comprehensive dataset of one million tobacco product images with hierarchical labels spanning 75 product categories, and DEFEND, a novel foundation model for tobacco product understanding. Our approach integrates a Feature Enhancement Module for rich multimodal representation learning, a Local-Global Visual Coherence mechanism for detailed feature discrimination, and an Enhanced Image-Text Alignment strategy for precise product characterization. Experimental results demonstrate DEFEND's superior performance, achieving 83.1% accuracy in product classification and 73.8% in visual question-answering tasks, outperforming existing methods by significant margins. Moreover, the model exhibits robust zero-shot learning capabilities with 45.6% accuracy on novel product categories. This work provides regulatory bodies and public health researchers with powerful tools for monitoring emerging tobacco products and marketing strategies, potentially revolutionizing approaches to tobacco control and public health surveillance.