AutoCas: Autoregressive Cascade Predictor in Social Networks via Large Language Models

TL;DR

AutoCas leverages large language models with specialized adaptations and prompt learning to accurately predict social network cascade popularity, outperforming traditional models and demonstrating scalable performance.

Contribution

The paper introduces AutoCas, a novel LLM-based cascade predictor that incorporates data tokenization, autoregressive reformulation, and prompt learning for improved accuracy.

Findings

AutoCas outperforms baseline models in cascade prediction accuracy.

AutoCas exhibits scalable performance aligned with LLM capabilities.

The approach effectively adapts LLMs to complex cascade data structures.

Abstract

Popularity prediction in information cascades plays a crucial role in social computing, with broad applications in viral marketing, misinformation control, and content recommendation. However, information propagation mechanisms, user behavior, and temporal activity patterns exhibit significant diversity, necessitating a foundational model capable of adapting to such variations. At the same time, the amount of available cascade data remains relatively limited compared to the vast datasets used for training large language models (LLMs). Recent studies have demonstrated the feasibility of leveraging LLMs for time-series prediction by exploiting commonalities across different time-series domains. Building on this insight, we introduce the Autoregressive Information Cascade Predictor (AutoCas), an LLM-enhanced model designed specifically for cascade popularity prediction. Unlike natural language sequences, cascade data is characterized by complex local topologies, diffusion contexts, and evolving dynamics, requiring specialized adaptations for effective LLM integration. To address these challenges, we first tokenize cascade data to align it with sequence modeling principles. Next, we reformulate cascade diffusion as an autoregressive modeling task to fully harness the architectural strengths of LLMs. Beyond conventional approaches, we further introduce prompt learning to enhance the synergy between LLMs and cascade prediction. Extensive experiments demonstrate that AutoCas significantly outperforms baseline models in cascade popularity prediction while exhibiting scaling behavior inherited from LLMs. Code is available at this repository: https://anonymous.4open.science/r/AutoCas-85C6