RANSAC Scoring Functions: Analysis and Reality Check
A. Shekhovtsov

TL;DR
This paper critically analyzes RANSAC scoring functions, revealing that many advanced methods are equivalent to simple models, and proposes a new evaluation methodology for scoring functions in geometric model fitting.
Contribution
It provides a theoretical and experimental re-evaluation of RANSAC scoring functions, clarifies misconceptions about MAGSAC++, and introduces a new methodology for assessing scoring functions.
Findings
MAGSAC++ score is numerically equivalent to a simple Gaussian-uniform likelihood.
All tested scoring functions perform similarly under the proposed evaluation methodology.
MAGSAC++ is not necessarily better or less sensitive than simpler scoring functions.
Abstract
We revisit the problem of assigning a score (a quality of fit) to candidate geometric models -- one of the key components of RANSAC for robust geometric fitting. In a non-robust setting, the ``gold standard'' scoring function, known as the geometric error, follows from a probabilistic model with Gaussian noises. We extend it to spherical noises. In a robust setting, we consider a mixture with uniformly distributed outliers and show that a threshold-based parameterization leads to a unified view of likelihood-based and robust M-estimators and associated local optimization schemes. Next we analyze MAGSAC++ which stands out for two reasons. First, it achieves the best results according to existing benchmarks. Second, it makes quite different modeling assumptions and derivation steps. We discovered, however that the derivation does not correspond to sound principles and the resulting…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAnomaly Detection Techniques and Applications · Adversarial Robustness in Machine Learning · Machine Learning and Data Classification
