An Empirical Comparison of Big Graph Frameworks in the Context of Network Analysis

TL;DR

This paper empirically compares four distributed graph processing frameworks for large-scale network analysis, highlighting their performance differences and suitability depending on network size and complexity.

Contribution

It provides a comprehensive performance comparison of GraphLab, Giraph, Giraph++, and Flink for large-scale graph algorithms in a distributed setting.

Findings

GraphLab and Giraph outperform other frameworks in distributed environments.

Distributed frameworks enable analysis of networks with billions of edges.

Shared-memory implementations outperform distributed ones for smaller, memory-resident networks.

Abstract

Complex networks are relational data sets commonly represented as graphs. The analysis of their intricate structure is relevant to many areas of science and commerce, and data sets may reach sizes that require distributed storage and processing. We describe and compare programming models for distributed computing with a focus on graph algorithms for large-scale complex network analysis. Four frameworks - GraphLab, Apache Giraph, Giraph++ and Apache Flink - are used to implement algorithms for the representative problems Connected Components, Community Detection, PageRank and Clustering Coefficients. The implementations are executed on a computer cluster to evaluate the frameworks' suitability in practice and to compare their performance to that of the single-machine, shared-memory parallel network analysis package NetworKit. Out of the distributed frameworks, GraphLab and Apache Giraph generally show the best performance. In our experiments a cluster of eight computers running Apache Giraph enables the analysis of a network with about 2 billion edges, which is too large for a single machine of the same type. However, for networks that fit into memory of one machine, the performance of the shared-memory parallel implementation is far better than the distributed ones. The study provides experimental evidence for selecting the appropriate framework depending on the task and data volume.