The Perceptron with Dynamic Margin
Constantinos Panagiotakopoulos, Petroula Tsampouka

TL;DR
This paper introduces the perceptron with dynamic margin (PDM), a new classifier that converges finitely and aims to approximate the maximum margin by adjusting updates based on a dynamic upper bound.
Contribution
The paper proposes PDM, a perceptron variant that updates based on a dynamic margin criterion, providing finite convergence guarantees and empirical comparisons.
Findings
PDM converges in a finite number of steps.
PDM performs competitively with SVMs and other perceptron algorithms.
Experimental results validate the effectiveness of PDM on hard margin tasks.
Abstract
The classical perceptron rule provides a varying upper bound on the maximum margin, namely the length of the current weight vector divided by the total number of updates up to that time. Requiring that the perceptron updates its internal state whenever the normalized margin of a pattern is found not to exceed a certain fraction of this dynamic upper bound we construct a new approximate maximum margin classifier called the perceptron with dynamic margin (PDM). We demonstrate that PDM converges in a finite number of steps and derive an upper bound on them. We also compare experimentally PDM with other perceptron-like algorithms and support vector machines on hard margin tasks involving linear kernels which are equivalent to 2-norm soft margin.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural Networks and Applications · Fuzzy Logic and Control Systems · Face and Expression Recognition
