Reward Maximization in General Dynamic Matching Systems

TL;DR

This paper introduces an asymptotically optimal, real-time matching scheme for dynamic systems with random arrivals, leveraging a virtual system and an extended greedy primal-dual algorithm, applicable broadly beyond matching problems.

Contribution

It proposes a novel virtual system-based matching scheme with an extended GPD algorithm that is asymptotically optimal and adaptable without prior knowledge of arrival rates.

Findings

The scheme maximizes long-term reward while maintaining queue stability.

The extended GPD algorithm is proven asymptotically optimal.

The approach is robust and adaptable to changing conditions.

Abstract

We consider a matching system with random arrivals of items of different types. The items wait in queues -- one per each item type -- until they are "matched." Each matching requires certain quantities of items of different types; after a matching is activated, the associated items leave the system. There exists a finite set of possible matchings, each producing a certain amount of "reward". This model has a broad range of important applications, including assemble-to-order systems, Internet advertising, matching web portals, etc. We propose an optimal matching scheme in the sense that it asymptotically maximizes the long-term average matching reward, while keeping the queues stable. The scheme makes matching decisions in a specially constructed virtual system, which in turn control decisions in the physical system. The key feature of the virtual system is that, unlike the physical one, it allows the queues to become negative. The matchings in the virtual system are controlled by an extended version of the greedy primal-dual (GPD) algorithm, which we prove to be asymptotically optimal -- this in turn implies the asymptotic optimality of the entire scheme. The scheme is real-time, at any time it uses simple rules based on the current state of virtual and physical queues. It is very robust in that it does not require any knowledge of the item arrival rates, and automatically adapts to changing rates. The extended GPD algorithm and its asymptotic optimality apply to a quite general queueing network framework, not limited to matching problems, and therefore is of independent interest.