Understanding Main Path Analysis

TL;DR

This paper provides a new theoretical foundation for main path analysis in citation networks, introduces basket-based methods for better core knowledge identification, and demonstrates their effectiveness over traditional approaches.

Contribution

It establishes an information-theoretic basis for main path analysis, proposes basket-based algorithms for more comprehensive core node detection, and shows their practical advantages in real networks.

Findings

Entropy-based variants optimize geometric distance measures.

Longest path approach yields similar results with simpler implementation.

Basket-based methods effectively identify core knowledge structures.

Abstract

Main path analysis has long been used to trace knowledge trajectories in citation networks, yet it lacks solid theoretical foundations. To understand when and why this approach succeeds, we analyse directed acyclic graphs created from two types of artificial models and by looking at over twenty networks derived from real data. We show that entropy-based variants of main path analysis optimise geometric distance measures, providing its first information-theoretic and geometric basis. Numerical results demonstrate that existing algorithms converge on near-geodesic solutions. We also show that an approach based on longest paths produces similar results, is equally well motivated yet is much simpler to implement. However, the traditional single-path focus is unnecessarily restrictive, as many near-optimal paths highlight different key nodes. We introduce an approach using ``baskets'' of nodes where we select a fraction of nodes with the smallest values of a measure we call ``generalised criticality''. Analysis of large vaccine citation networks shows that these baskets achieve comprehensive algorithmic coverage, offering a robust, simple, and computationally efficient way to identify core knowledge structures. In practice, we find that those nodes with zero unit criticality capture the information in main paths in almost all cases and capture a wider range of key nodes without unnecessarily increasing the number of nodes considered. We find no advantage in using the traditional main path methods.