A Majorization-Minimization Gauss-Newton Method for 1-Bit Matrix Completion

AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning


View a PDF of the paper titled A Majorization-Minimization Gauss-Newton Method for 1-Bit Matrix Completion, by Xiaoqian Liu and 3 other authors

View PDF
HTML (experimental)

Abstract:In 1-bit matrix completion, the aim is to estimate an underlying low-rank matrix from a partial set of binary observations. We propose a novel method for 1-bit matrix completion called Majorization-Minimization Gauss-Newton (MMGN). Our method is based on the majorization-minimization principle, which converts the original optimization problem into a sequence of standard low-rank matrix completion problems. We solve each of these sub-problems by a factorization approach that explicitly enforces the assumed low-rank structure and then apply a Gauss-Newton method. Using simulations and a real data example, we illustrate that in comparison to existing 1-bit matrix completion methods, MMGN outputs comparable if not more accurate estimates. In addition, it is often significantly faster, and less sensitive to the spikiness of the underlying matrix. In comparison with three standard generic optimization approaches that directly minimize the original objective, MMGN also exhibits a clear computational advantage, especially when the fraction of observed entries is small.

Submission history

From: Xiaoqian Liu [view email]
[v1]
Thu, 27 Apr 2023 03:16:52 UTC (2,038 KB)
[v2]
Tue, 23 Apr 2024 02:10:25 UTC (199 KB)
[v3]
Mon, 23 Sep 2024 23:20:44 UTC (125 KB)



Source link
lol

By stp2y

Leave a Reply

Your email address will not be published. Required fields are marked *

No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.