Causal Lifting and Link Prediction

TL;DR

This paper introduces a novel causal model for link prediction that handles path-dependent link formation, leveraging causal lifting and structural embeddings to improve causal inference in complex graph scenarios.

Contribution

It develops the first causal model capable of addressing path dependencies in link prediction and introduces causal lifting for causal query identification with limited data.

Findings

Causal lifting enables identification of causal link queries with limited interventional data.

Structural pairwise embeddings reduce bias and better capture causal structure.

Validated on knowledge base, covariance estimation, and recommendation scenarios.

Abstract

Existing causal models for link prediction assume an underlying set of inherent node factors -- an innate characteristic defined at the node's birth -- that governs the causal evolution of links in the graph. In some causal tasks, however, link formation is path-dependent: The outcome of link interventions depends on existing links. Unfortunately, these existing causal methods are not designed for path-dependent link formation, as the cascading functional dependencies between links (arising from path dependence) are either unidentifiable or require an impractical number of control variables. To overcome this, we develop the first causal model capable of dealing with path dependencies in link prediction. In this work we introduce the concept of causal lifting, an invariance in causal models of independent interest that, on graphs, allows the identification of causal link prediction queries using limited interventional data. Further, we show how structural pairwise embeddings exhibit lower bias and correctly represent the task's causal structure, as opposed to existing node embeddings, e.g., graph neural network node embeddings and matrix factorization. Finally, we validate our theoretical findings on three scenarios for causal link prediction tasks: knowledge base completion, covariance matrix estimation and consumer-product recommendations.