REFINE: Random RangE FInder for Network Embedding
Hao Zhu, Piotr Koniusz

TL;DR
REFINE introduces a fast, scalable network embedding method using randomized QR decomposition, enabling embedding of large networks in seconds with high accuracy for node classification.
Contribution
The paper presents REFINE, a novel network embedding algorithm that significantly reduces computation time using randomized QR, outperforming existing methods in speed while maintaining accuracy.
Findings
REFINE embeds one million nodes within 30 seconds.
REFINE is 10x faster than ProNE and 10-400x faster than other methods.
Experimental results show high efficiency and good performance across datasets.
Abstract
Network embedding approaches have recently attracted considerable interest as they learn low-dimensional vector representations of nodes. Embeddings based on the matrix factorization are effective but they are usually computationally expensive due to the eigen-decomposition step. In this paper, we propose a Random RangE FInder based Network Embedding (REFINE) algorithm, which can perform embedding on one million of nodes (YouTube) within 30 seconds in a single thread. REFINE is 10x faster than ProNE, which is 10-400x faster than other methods such as LINE, DeepWalk, Node2Vec, GraRep, and Hope. Firstly, we formulate our network embedding approach as a skip-gram model, but with an orthogonal constraint, and we reformulate it into the matrix factorization problem. Instead of using randomized tSVD (truncated SVD) as other methods, we employ the Randomized Blocked QR decomposition to obtain…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
MethodsDeepWalk · Graph Representation with Global structure
