Uniform Bounds for Scheduling with Job Size Estimates

TL;DR

This paper develops a new scheduling policy for M/G/1 queues with estimated job sizes, achieving near-optimal response times when estimates are accurate and providing bounds even with less precise estimates, without needing prior knowledge of estimate accuracy.

Contribution

It introduces a simple SRPT variant that guarantees bounded approximation ratios based on estimate accuracy, and analyzes the limitations of naive approaches and related policies.

Findings

Proposed SRPT variant's approximation ratio approaches 1 as estimates become accurate.

Naive SRPT with estimated sizes can have arbitrarily large approximation ratios.

PSJF with estimated sizes satisfies certain approximation bounds and criteria.

Abstract

We consider the problem of scheduling to minimize mean response time in M/G/1 queues where only estimated job sizes (processing times) are known to the scheduler, where a job of true size $s$ has estimated size in the interval $[\beta s, \alpha s]$ for some $\alpha \geq \beta > 0$. We evaluate each scheduling policy by its approximation ratio, which we define to be the ratio between its mean response time and that of Shortest Remaining Processing Time (SRPT), the optimal policy when true sizes are known. Our question: is there a scheduling policy that (a) has approximation ratio near 1 when $\alpha$ and $\beta$ are near 1, (b) has approximation ratio bounded by some function of $\alpha$ and $\beta$ even when they are far from 1, and (c) can be implemented without knowledge of $\alpha$ and $\beta$? We first show that naively running SRPT using estimated sizes in place of true sizes is not such a policy: its approximation ratio can be arbitrarily large for any fixed $\beta < 1$. We then provide a simple variant of SRPT for estimated sizes that satisfies criteria (a), (b), and (c). In particular, we prove its approximation ratio approaches 1 uniformly as $\alpha$ and $\beta$ approach 1. This is the first result showing this type of convergence for M/G/1 scheduling. We also study the Preemptive Shortest Job First (PSJF) policy, a cousin of SRPT. We show that, unlike SRPT, naively running PSJF using estimated sizes in place of true sizes satisfies criteria (b) and (c), as well as a weaker version of (a).