Improved Replicable Boosting with Majority-of-Majorities

TL;DR

This paper presents a novel replicable boosting algorithm that enhances sample efficiency by employing a two-layer majority voting scheme, building upon prior work to achieve better performance.

Contribution

The paper introduces a new two-layer majority voting boosting algorithm that improves sample complexity over previous replicable boosting methods.

Findings

Significant reduction in sample complexity compared to prior algorithms

Effective implementation of two-layer majority voting in boosting

Improved replicability in boosting algorithms

Abstract

We introduce a new replicable boosting algorithm which significantly improves the sample complexity compared to previous algorithms. The algorithm works by doing two layers of majority voting, using an improved version of the replicable boosting algorithm introduced by Impagliazzo et al. [2022] in the bottom layer.