Approximate Modularity Revisited

TL;DR

This paper investigates the robustness of approximate modularity in linear set functions, providing stronger bounds and an efficient deterministic learning algorithm with minimal queries.

Contribution

It offers improved theoretical bounds on approximate modularity and introduces a deterministic, query-efficient learning algorithm using Hadamard transforms.

Findings

Stronger upper bounds for approximate modularity close to linear functions.

Improved lower bounds for the proximity of approximately linear functions.

A deterministic, query-efficient algorithm for learning near-linear functions.

Abstract

Set functions with convenient properties (such as submodularity) appear in application areas of current interest, such as algorithmic game theory, and allow for improved optimization algorithms. It is natural to ask (e.g., in the context of data driven optimization) how robust such properties are, and whether small deviations from them can be tolerated. We consider two such questions in the important special case of linear set functions. One question that we address is whether any set function that approximately satisfies the modularity equation (linear functions satisfy the modularity equation exactly) is close to a linear function. The answer to this is positive (in a precise formal sense) as shown by Kalton and Roberts [1983] (and further improved by Bondarenko, Prymak, and Radchenko [2013]). We revisit their proof idea that is based on expander graphs, and provide significantly stronger upper bounds by combining it with new techniques. Furthermore, we provide improved lower bounds for this problem. Another question that we address is that of how to learn a linear function $h$ that is close to an approximately linear function $f$, while querying the value of $f$ on only a small number of sets. We present a deterministic algorithm that makes only linearly many (in the number of items) nonadaptive queries, by this improving over a previous algorithm of Chierichetti, Das, Dasgupta and Kumar [2015] that is randomized and makes more than a quadratic number of queries. Our learning algorithm is based on a Hadamard transform.