Supervised Contrastive Learning for Product Matching

TL;DR

This paper introduces supervised contrastive learning for product matching in e-commerce, demonstrating significant performance improvements over previous methods through a novel pre-training and sampling strategy.

Contribution

It applies supervised contrastive learning to product matching, proposing a source-aware sampling method that enhances performance without requiring product identifiers.

Findings

Achieved state-of-the-art F1-scores on multiple benchmarks.

Supervised contrastive pre-training improves matching accuracy.

Data augmentation benefits small datasets, while self-supervised contrastive learning underperforms.

Abstract

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in e-commerce using product offers from different e-shops. More specifically, we employ a supervised contrastive learning technique to pre-train a Transformer encoder which is afterward fine-tuned for the matching task using pair-wise training data. We further propose a source-aware sampling strategy that enables contrastive learning to be applied for use cases in which the training data does not contain product identifiers. We show that applying supervised contrastive pre-training in combination with source-aware sampling significantly improves the state-of-the-art performance on several widely used benchmarks: For Abt-Buy, we reach an F1-score of 94.29 (+3.24 compared to the previous state-of-the-art), for Amazon-Google 79.28 (+ 3.7). For WDC Computers datasets, we reach improvements between +0.8 and +8.84 in F1-score depending on the training set size. Further experiments with data augmentation and self-supervised contrastive pre-training show that the former can be helpful for smaller training sets while the latter leads to a significant decline in performance due to inherent label noise. We thus conclude that contrastive pre-training has a high potential for product matching use cases in which explicit supervision is available.