Recommendation Subgraphs for Web Discovery

TL;DR

This paper formalizes recommendation subgraphs for web discovery as a graph optimization problem, analyzes three algorithms with theoretical guarantees, and demonstrates that simple heuristics often suffice in real-world scenarios.

Contribution

It introduces a formal framework for recommendation subgraphs, compares algorithms with theoretical analysis, and shows simple heuristics are effective in practice.

Findings

Simple heuristics perform well in real-world data.

More sophisticated algorithms are needed only in specific parameter ranges.

Theoretical analysis guides practical algorithm choice.

Abstract

Recommendations are central to the utility of many websites including YouTube, Quora as well as popular e-commerce stores. Such sites typically contain a set of recommendations on every product page that enables visitors to easily navigate the website. Choosing an appropriate set of recommendations at each page is one of the key features of backend engines that have been deployed at several e-commerce sites. Specifically at BloomReach, an engine consisting of several independent components analyzes and optimizes its clients' websites. This paper focuses on the structure optimizer component which improves the website navigation experience that enables the discovery of novel content. We begin by formalizing the concept of recommendations used for discovery. We formulate this as a natural graph optimization problem which in its simplest case, reduces to a bipartite matching problem. In practice, solving these matching problems requires superlinear time and is not scalable. Also, implementing simple algorithms is critical in practice because they are significantly easier to maintain in production. This motivated us to analyze three methods for solving the problem in increasing order of sophistication: a sampling algorithm, a greedy algorithm and a more involved partitioning based algorithm. We first theoretically analyze the performance of these three methods on random graph models characterizing when each method will yield a solution of sufficient quality and the parameter ranges when more sophistication is needed. We complement this by providing an empirical analysis of these algorithms on simulated and real-world production data. Our results confirm that it is not always necessary to implement complicated algorithms in the real-world and that very good practical results can be obtained by using heuristics that are backed by the confidence of concrete theoretical guarantees.