CORGI: Efficient Pattern Matching With Quadratic Guarantees

TL;DR

CORGI is a new pattern-matching algorithm that guarantees quadratic time and space complexity, enabling efficient, scalable matching in real-time AI systems without high-latency delays or memory overflows.

Contribution

We introduce CORGI, a novel pattern-matching algorithm that provides quadratic guarantees and streamlines matching by avoiding traditional conflict set storage, improving performance over RETE-based methods.

Findings

CORGI outperforms RETE-based systems in combinatorial matching tasks.

CORGI maintains quadratic time and space guarantees.

CORGI reduces latency and memory issues in real-time applications.

Abstract

Rule-based systems must solve complex matching problems within tight time constraints to be effective in real-time applications, such as planning and reactive control for AI agents, as well as low-latency relational database querying. Pattern-matching systems can encounter issues where exponential time and space are required to find matches for rules with many underconstrained variables, or which produce combinatorial intermediate partial matches (but are otherwise well-constrained). When online AI systems automatically generate rules from example-driven induction or code synthesis, they can easily produce worst-case matching patterns that slow or halt program execution by exceeding available memory. In our own work with cognitive systems that learn from example, we've found that aggressive forms of anti-unification-based generalization can easily produce these circumstances. To make these systems practical without hand-engineering constraints or succumbing to unpredictable failure modes, we introduce a new matching algorithm called CORGI (Collection-Oriented Relational Graph Iteration). Unlike RETE-based approaches, CORGI offers quadratic time and space guarantees for finding single satisficing matches, and the ability to iteratively stream subsequent matches without committing entire conflict sets to memory. CORGI differs from RETE in that it does not have a traditional $\beta$-memory for collecting partial matches. Instead, CORGI takes a two-step approach: a graph of grounded relations is built/maintained in a forward pass, and an iterator generates matches as needed by working backward through the graph. This approach eliminates the high-latency delays and memory overflows that can result from populating full conflict sets. In a performance evaluation, we demonstrate that CORGI significantly outperforms RETE implementations from SOAR and OPS5 on a simple combinatorial matching task.