Fedivertex: a Graph Dataset based on Decentralized Social Networks for Trustworthy Machine Learning

TL;DR

Fedivertex is a new dataset of 182 graphs from Fediverse social networks, designed to benchmark decentralized machine learning algorithms and include a novel defederation task based on real-world link deletion dynamics.

Contribution

Introduces Fedivertex, a comprehensive graph dataset from Fediverse social networks, with tools and a new defederation task for decentralized ML research.

Findings

Dataset covers 7 social networks over 14 weeks.

Includes a novel defederation task based on link deletion.

Provides tools for easy dataset utilization.

Abstract

Decentralized machine learning - where each client keeps its own data locally and uses its own computational resources to collaboratively train a model by exchanging peer-to-peer messages - is increasingly popular, as it enables better scalability and control over the data. A major challenge in this setting is that learning dynamics depend on the topology of the communication graph, which motivates the use of real graph datasets for benchmarking decentralized algorithms. Unfortunately, existing graph datasets are largely limited to for-profit social networks crawled at a fixed point in time and often collected at the user scale, where links are heavily influenced by the platform and its recommendation algorithms. The Fediverse, which includes several free and open-source decentralized social media platforms such as Mastodon, Misskey, and Lemmy, offers an interesting real-world alternative. We introduce Fedivertex, a new dataset of 182 graphs, covering seven social networks from the Fediverse, crawled weekly over 14 weeks. We release the dataset along with a Python package to facilitate its use, and illustrate its utility on several tasks, including a new defederation task, which captures a process of link deletion observed on these networks.