ImplicitSLIM and How it Improves Embedding-based Collaborative Filtering
Ilya Shenbin, Sergey Nikolenko

TL;DR
ImplicitSLIM introduces an efficient unsupervised method that enhances embedding-based collaborative filtering by leveraging SLIM-like models, leading to better performance and faster convergence without heavy computations.
Contribution
It proposes ImplicitSLIM, a novel approach that extracts embeddings from SLIM-like models efficiently, improving scalability and effectiveness in collaborative filtering.
Findings
Improves performance of collaborative filtering models
Speeds up convergence in training
Reduces memory usage compared to traditional SLIM methods
Abstract
We present ImplicitSLIM, a novel unsupervised learning approach for sparse high-dimensional data, with applications to collaborative filtering. Sparse linear methods (SLIM) and their variations show outstanding performance, but they are memory-intensive and hard to scale. ImplicitSLIM improves embedding-based models by extracting embeddings from SLIM-like models in a computationally cheap and memory-efficient way, without explicit learning of heavy SLIM-like models. We show that ImplicitSLIM improves performance and speeds up convergence for both state of the art and classical collaborative filtering methods. The source code for ImplicitSLIM, related models, and applications is available at https://github.com/ilya-shenbin/ImplicitSLIM.
Peer Reviews
Decision·ICLR 2024 poster
Strengths: - The approaches addresses the memory-intensive and scalability issues of SLIM-like models in collaborative filtering. - The authors provided various experiments on publicly available benchmark datasets - Source code is also provided - Many appendices were given for more explanation
Weaknesses: - In Section 3 Proposed Approach, the authors should explain more on the formular choices when developing ImplicitSLIM. For example, why do we use LLE, but use the neighbourhood of NN(i) = {1,2,…,I} \ {i} to make it ‘global’ (Section 3.1)? Why do we drop the sum-to-one constraint (Section 3.2) (the authors did mention they have no good reasons, but why)? In my opinion, Section 3 is very important and the authors should provide deeper explanations and discussions about this. Otherwis
This paper learns embeddings with closed form solutions. Good Experimental study.
- This paper is very theoretical and hard to follow the formulas.
- mathematically sound approach with a closed-form solution - showcases practical efficiency in the standard collaborative filtering task - good generalization capabilities
- not a standalone approach which makes training less straightforward - applicable to embedding-based models only - the source code is not provided
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSpeech and dialogue systems
