Nonmonotone local minimax methods for finding multiple saddle points
Wei Liu, Ziqing Xie, Wenfan Yi

TL;DR
This paper introduces a novel nonmonotone local minimax method with Barzilai--Borwein step-size for efficiently finding multiple saddle points in nonconvex functionals, demonstrating faster convergence and effectiveness in elliptic boundary value problems.
Contribution
It develops a globally convergent nonmonotone local minimax method with a Barzilai--Borwein-type step-size, improving convergence speed and computational efficiency over traditional methods.
Findings
Faster convergence compared to monotone strategies
Effective in finding multiple saddle points in elliptic problems
Numerical results confirm improved efficiency
Abstract
In this paper, by designing a normalized nonmonotone search strategy with the Barzilai--Borwein-type step-size, a novel local minimax method (LMM), which is a globally convergent iterative method, is proposed and analyzed to find multiple (unstable) saddle points of nonconvex functionals in Hilbert spaces. Compared to traditional LMMs with monotone search strategies, this approach, which does not require strict decrease of the objective functional value at each iterative step, is observed to converge faster with less computations. Firstly, based on a normalized iterative scheme coupled with a local peak selection that pulls the iterative point back onto the solution submanifold, by generalizing the Zhang--Hager (ZH) search strategy in the optimization theory to the LMM framework, a kind of normalized ZH-type nonmonotone step-size search strategy is introduced, and then a novel…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Optimization Algorithms Research · Fractional Differential Equations Solutions · Iterative Methods for Nonlinear Equations
