Cloud Scheduler: a resource manager for distributed compute clouds

TL;DR

Cloud Scheduler is a virtual machine resource manager designed to simplify and automate the deployment of scientific applications on distributed IaaS clouds, making cloud computing more accessible for researchers.

Contribution

It introduces a virtual machine resource manager that automates VM management in response to job submissions, enhancing usability for scientific computing on clouds.

Findings

Effective management of user-customized VMs on science and commercial clouds.

Reduced effort required for researchers to deploy applications on cloud resources.

Demonstrated scalability and practicality of Cloud Scheduler in real-world scenarios.

Abstract

The availability of Infrastructure-as-a-Service (IaaS) computing clouds gives researchers access to a large set of new resources for running complex scientific applications. However, exploiting cloud resources for large numbers of jobs requires significant effort and expertise. In order to make it simple and transparent for researchers to deploy their applications, we have developed a virtual machine resource manager (Cloud Scheduler) for distributed compute clouds. Cloud Scheduler boots and manages the user-customized virtual machines in response to a user's job submission. We describe the motivation and design of the Cloud Scheduler and present results on its use on both science and commercial clouds.