The Importance of Parameters in Ranking Functions

TL;DR

This paper investigates the computation of SHAP scores for column weights in ranking functions, analyzing their complexity and proposing approximation schemes across various ranking and effect functions.

Contribution

It provides a comprehensive complexity analysis of SHAP score computation for different ranking functions and effect measures, extending to Shapley value calculations.

Findings

All cases admit an additive FPRAS for approximation.

Exact computation is polynomial-time solvable or #P-hard depending on the case.

Complexity results extend to computing Shapley values for columns.

Abstract

How important is the weight of a given column in determining the ranking of tuples in a table? To address such an explanation question about a ranking function, we investigate the computation of SHAP scores for column weights, adopting a recent framework by Grohe et al.[ICDT'24]. The exact definition of this score depends on three key components: (1) the ranking function in use, (2) an effect function that quantifies the impact of using alternative weights on the ranking, and (3) an underlying weight distribution. We analyze the computational complexity of different instantiations of this framework for a range of fundamental ranking and effect functions, focusing on probabilistically independent finite distributions for individual columns. For the ranking functions, we examine lexicographic orders and score-based orders defined by the summation, minimum, and maximum functions. For the effect functions, we consider global, top-k, and local perspectives: global measures quantify the divergence between the perturbed and original rankings, top-k measures inspect the change in the set of top-k answers, and local measures capture the impact on an individual tuple of interest. Although all cases admit an additive fully polynomial-time randomized approximation scheme (FPRAS), we establish the complexity of exact computation, identifying which cases are solvable in polynomial time and which are #P-hard. We further show that all complexity results, lower bounds and upper bounds, extend to a related task of computing the Shapley value of whole columns (regardless of their weight).