Citation-Driven Multi-View Training for Patent Embeddings: QaECTER and Sophia-Bench

TL;DR

This paper introduces Sophiabench, a comprehensive patent retrieval benchmark, and QaECTER, a compact embedding model that achieves state-of-the-art results across diverse patent search scenarios.

Contribution

The paper presents a new large-scale patent retrieval benchmark and a novel embedding model that outperforms larger models across multiple patent search tasks.

Findings

QaECTER outperforms a 23x larger model on patent retrieval benchmarks.

Sophiabench evaluates retrieval across 12 query types and multiple jurisdictions.

QaECTER surpasses all prior models without task-specific prompts.

Abstract

Patent retrieval underpins critical decisions in innovation, examination, and IP strategy, yet progress has been hampered by the absence of benchmarks that reflect the diversity of real world search scenarios. We address this gap with two contributions. First, we introduce Sophiabench, a large-scale patent retrieval benchmark comprising 10,000 queries and 75,000 corpus documents stratified across ten years, eight IPC technology sections, and twelve filing jurisdictions. Unlike prior benchmarks, Sophia-bench tests retrieval using 12 different query types-from structured patent fields to AI-generated summaries-and evaluates results against citation-based ground truth enhanced with a novel domain-relevance metric (InScope). Together, these enable systematic measurement of how well models perform across query types, technology domains, and jurisdictions. Second, we introduce QaECTER, a 344M-parameter embedding model trained on patent citation graphs and multi-view self-alignment. Despite its compact size, QaECTER establishes a new state of the art for patent retrieval. It outperforms the \#1 model on the English retrieval text embedding benchmark (RTEB), a model 23x larger, as well as all existing patent specific models across every query type, IPC section, and jurisdiction on Sophia-bench, with gains of up to 7.2% average NDCG@10 over the next-best model. These results are confirmed on an independent external benchmark, where QaECTER surpasses all prior models without requiring task-specific instruction prompts. Both the benchmark and the model are designed for practical deployment in large-scale patent search systems.