How memory can affect collective and cooperative behaviors in an LLM-Based Social Particle Swarm

TL;DR

This paper investigates how memory length and personality traits of LLM agents influence their collective and cooperative behaviors in a social particle swarm model, revealing contrasting effects across different LLMs.

Contribution

It extends the Social Particle Swarm model with LLM agents, demonstrating how memory length and personality traits affect cooperation and social dynamics.

Findings

Memory length critically influences cooperation, with longer memory suppressing cooperation in Gemini-2.0-Flash.

Contrastingly, in Gemma-3:4b, longer memory promotes cooperation and dense clusters.

Sentiment analysis shows differing interpretations of memory's negativity by Gemini and Gemma.

Abstract

This study examines how model-specific characteristics of Large Language Model (LLM) agents, including internal alignment, shape the effect of memory on their collective and cooperative dynamics in a multi-agent system. To this end, we extend the Social Particle Swarm (SPS) model, in which agents move in a two-dimensional space and play the Prisoner's Dilemma with neighboring agents, by replacing its rule-based agents with LLM agents endowed with Big Five personality scores and varying memory lengths. Using Gemini-2.0-Flash, we find that memory length is a critical parameter governing collective behavior: even a minimal memory drastically suppressed cooperation, transitioning the system from stable cooperative clusters through cyclical formation and collapse of clusters to a state of scattered defection as memory length increased. Big Five personality traits correlated with agent behaviors in partial agreement with findings from experiments with human participants, supporting the validity of the model. Comparative experiments using Gemma~3:4b revealed the opposite trend: longer memory promoted cooperation, accompanied by the formation of dense cooperative clusters. Sentiment analysis of agents' reasoning texts showed that Gemini interprets memory increasingly negatively as its length grows, while Gemma interprets it less negatively, and that this difference persists in the early phase of experiments before the macro-level dynamics converge. These results suggest that model-specific characteristics of LLMs, potentially including alignment, play a fundamental role in determining emergent social behavior in Generative Agent-Based Modeling, and provide a micro-level cognitive account of the contradictions found in prior work on memory and cooperation.