Entropy Penalized Semidefinite Programming
Mikhail Krechetov, Jakub Marecek, Yury Maximov, Martin Takac

TL;DR
This paper introduces Entropy Penalized SDP (EP-SDP), a unified, computationally efficient framework for low-rank semidefinite programming applicable to machine learning and optimization tasks.
Contribution
It proposes a novel entropy-based penalty framework for SDP that is easier to implement and computationally efficient compared to traditional determinant or Schatten-norm penalties.
Findings
EP-SDP admits an almost linear time gradient algorithm.
The approach effectively solves combinatorial and machine learning problems.
EP-SDP demonstrates practical efficiency in experiments.
Abstract
Low-rank methods for semidefinite programming (SDP) have gained a lot of interest recently, especially in machine learning applications. Their analysis often involves determinant-based or Schatten-norm penalties, which are hard to implement in practice due to high computational efforts. In this paper, we propose Entropy Penalized Semi-definite programming (EP-SDP) which provides a unified framework for a wide class of penalty functions used in practice to promote a low-rank solution. We show that EP-SDP problems admit efficient numerical algorithm having (almost) linear time complexity of the gradient iteration which makes it useful for many machine learning and optimization problems. We illustrate the practical efficiency of our approach on several combinatorial optimization and machine learning problems.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
