Theoretically Guaranteed Online Workload Dispatching for Deadline-Aware Multi-Server Jobs

TL;DR

This paper introduces a theoretically guaranteed online dispatching policy for deadline-aware multi-server jobs, optimizing resource allocation and outperforming baseline policies in simulations.

Contribution

It presents the first $ extit{ extbf{alpha}}$-competitive online dispatching policy for deadline-aware multi-server jobs with a formal proof of its competitiveness.

Findings

Policy is $ extit{ extbf{alpha}}$-competitive with $ extbf{ extit{alpha}} extgreater=2$

Outperforms baseline policies in simulation results

Effectively balances job utilities and cluster utility

Abstract

Multi-server jobs are imperative in modern computing clusters. A multi-server job has multiple task components and each of the task components is responsible for processing a specific size of workloads. Efficient online workload dispatching is crucial but challenging to co-located heterogeneous multi-server jobs. The dispatching policy should decide $(i)$ where to launch each task component instance of the arrived jobs and $(ii)$ the size of workloads that each task component processes. Existing policies are explicit and effective when facing service locality and resource contention in both offline and online settings. However, when adding the deadline-aware constraint, the theoretical superiority of these policies could not be guaranteed. To fill the theoretical gap, in this paper, we design an $\alpha$-competitive online workload dispatching policy for deadline-aware multi-server jobs based on the spatio-temporal resource mesh model. We formulate the problem as a social welfare maximization program and solve it online with several well designed pseudo functions. The social welfare is formulated as the sum of the utilities of jobs and the utility of the computing cluster. The proposed policy is rigorously proved to be $\alpha$-competitive for some $\alpha \geq 2$. We also validate the theoretical superiority of it with simulations and the results show that it distinctly outperforms two handcrafted baseline policies on the social welfare.