Dealing with missing data: An inpainting application to the MICROSCOPE space mission

TL;DR

This paper demonstrates that inpainting algorithms can effectively reconstruct missing data in MICROSCOPE space mission datasets, enabling precise tests of the Weak Equivalence Principle at the $10^{-15}$ level.

Contribution

It introduces the application of inpainting to MICROSCOPE data, showing its effectiveness in handling missing data for high-precision physics measurements.

Findings

Inpainting can reconstruct missing data with minimal impact on signal detection.

The method allows for testing Equivalence Principle violations close to the mission's sensitivity.

Inpainting, combined with KARMA, enables independent validation of results.

Abstract

Missing data are a common problem in experimental and observational physics. They can be caused by various sources, either an instrument's saturation, or a contamination from an external event, or a data loss. In particular, they can have a disastrous effect when one is seeking to characterize a colored-noise-dominated signal in Fourier space, since they create a spectral leakage that can artificially increase the noise. It is therefore important to either take them into account or to correct for them prior to e.g. a Least-Square fit of the signal to be characterized. In this paper, we present an application of the {\it inpainting} algorithm to mock MICROSCOPE data; {\it inpainting} is based on a sparsity assumption, and has already been used in various astrophysical contexts; MICROSCOPE is a French Space Agency mission, whose launch is expected in 2016, that aims to test the Weak Equivalence Principle down to the $10^{-15}$ level. We then explore the {\it inpainting} dependence on the number of gaps and the total fraction of missing values. We show that, in a worst-case scenario, after reconstructing missing values with {\it inpainting}, a Least-Square fit may allow us to significantly measure a $1.1\times10^{-15}$ Equivalence Principle violation signal, which is sufficiently close to the MICROSCOPE requirements to implement {\it inpainting} in the official MICROSCOPE data processing and analysis pipeline. Together with the previously published KARMA method, {\it inpainting} will then allow us to independently characterize and cross-check an Equivalence Principle violation signal detection down to the $10^{-15}$ level.