GiViP: A Visual Profiler for Distributed Graph Processing Systems

TL;DR

GiViP is a visual profiling tool designed to analyze and debug large-scale distributed graph processing systems by visualizing message exchanges and detecting anomalies.

Contribution

The paper introduces GiViP, a novel visual profiler that aids in analyzing and debugging distributed graph computations with an interactive interface.

Findings

GiViP effectively visualizes message exchanges in distributed graph computations.

GiViP helps identify slow computing units and anomalous message patterns.

The tool improves debugging efficiency for large-scale graph processing.

Abstract

Analyzing large-scale graphs provides valuable insights in different application scenarios. While many graph processing systems working on top of distributed infrastructures have been proposed to deal with big graphs, the tasks of profiling and debugging their massive computations remain time consuming and error-prone. This paper presents GiViP, a visual profiler for distributed graph processing systems based on a Pregel-like computation model. GiViP captures the huge amount of messages exchanged throughout a computation and provides an interactive user interface for the visual analysis of the collected data. We show how to take advantage of GiViP to detect anomalies related to the computation and to the infrastructure, such as slow computing units and anomalous message patterns.