Data Distribution Valuation
Xinyi Xu, Shuaiqi Wang, Chuan-Sheng Foo, Bryan Kian Hsiang Low and, Giulia Fanti

TL;DR
This paper introduces a new data distribution valuation method based on maximum mean discrepancy, enabling effective comparison of data distributions from samples for applications like data marketplace pricing.
Contribution
It proposes a theoretically grounded MMD-based valuation approach for data distributions, addressing the challenge of comparing distributions from limited samples.
Findings
Sample-efficient and effective in identifying valuable data distributions
Outperforms existing baselines on real-world datasets
Applicable to classification and regression tasks
Abstract
Data valuation is a class of techniques for quantitatively assessing the value of data for applications like pricing in data marketplaces. Existing data valuation methods define a value for a discrete dataset. However, in many use cases, users are interested in not only the value of the dataset, but that of the distribution from which the dataset was sampled. For example, consider a buyer trying to evaluate whether to purchase data from different vendors. The buyer may observe (and compare) only a small preview sample from each vendor, to decide which vendor's data distribution is most useful to the buyer and purchase. The core question is how should we compare the values of data distributions from their samples? Under a Huber characterization of the data heterogeneity across vendors, we propose a maximum mean discrepancy (MMD)-based valuation method which enables theoretically…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsInsurance, Mortality, Demography, Risk Management
