Efficient method for accelerating line searches using a combined Schur complement domain decomposition and Born series expansions in photonic-based adjoint optimization
Nathan Zhao, Salim Boutami, Shanhui Fan

TL;DR
This paper introduces an accelerated line search method combining Schur complement domain decomposition and Born series expansions, significantly reducing computational cost in photonic adjoint optimization.
Contribution
It presents a novel approach that combines domain decomposition and Born series to speed up line searches in gradient-based optimization.
Findings
Achieves up to 10-fold speed-up in optimization
Reduces number of iterations to convergence
Decreases wall-clock time per iteration
Abstract
A line search in gradient-based optimization algorithm solves the problem of determining the optimal learning rate for a given gradient or search direction in a single iteration. For most problems, this is determined by evaluating different candidate learning rates to find the optimum, which can be expensive. Recent work has provided an efficient way to perform a line search with the use of the Shanks transformation of a Born series derived from the Lippman-Schwinger formalism. In this paper we show that the cost for performing such a line search can be further reduced with the use of the method of the Schur complement domain decomposition, which can lead to a 10-fold total speed-up resulting from the reduced number of iterations to convergence and reduced wall-clock time per iteration.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsPhotonic and Optical Devices · Optical Network Technologies · Neural Networks and Reservoir Computing
