Optimal Change Point Detection and Localization in Sparse Dynamic Networks

TL;DR

This paper addresses the challenge of detecting and localizing change points in sparse dynamic networks by proposing algorithms that are both computationally feasible and statistically optimal under various model conditions.

Contribution

It introduces the Network Binary Segmentation algorithm and a Local Refinement method, establishing their consistency and near-optimality in change point localization in dynamic networks.

Findings

Network Binary Segmentation is consistent outside an identified impossibility region.

Local Refinement achieves minimax optimal localization rates.

Algorithms work under varying network sparsity and change magnitudes.

Abstract

We study the problem of change point localization in dynamic networks models. We assume that we observe a sequence of independent adjacency matrices of the same size, each corresponding to a realization of an unknown inhomogeneous Bernoulli model. The underlying distribution of the adjacency matrices are piecewise constant, and may change over a subset of the time points, called change points. We are concerned with recovering the unknown number and positions of the change points. In our model setting we allow for all the model parameters to change with the total number of time points, including the network size, the minimal spacing between consecutive change points, the magnitude of the smallest change and the degree of sparsity of the networks. We first identify a region of impossibility in the space of the model parameters such that no change point estimator is provably consistent if the data are generated according to parameters falling in that region. We propose a computationally-simple algorithm for network change point localization, called Network Binary Segmentation, that relies on weighted averages of the adjacency matrices. We show that Network Binary Segmentation is consistent over a range of the model parameters that nearly cover the complement of the impossibility region, thus demonstrating the existence of a phase transition for the problem at hand. Next, we devise a more sophisticated algorithm based on singular value thresholding, called Local Refinement, that delivers more accurate estimates of the change point locations. Under appropriate conditions, Local Refinement guarantees a minimax optimal rate for network change point localization while remaining computationally feasible.