# Machine Learning Based Prediction and Classification of Computational   Jobs in Cloud Computing Centers

**Authors:** Zheqi Zhu, Pingyi Fan

arXiv: 1903.03759 · 2021-05-10

## TL;DR

This paper explores machine learning techniques, specifically LSTM and BIRCH clustering, to predict and classify computational jobs in cloud data centers, improving resource management and understanding of job characteristics.

## Contribution

It introduces a combined approach using LSTM for prediction and BIRCH clustering for classification of cloud computing jobs, enhancing accuracy and interpretability.

## Key findings

- LSTM improves job arrival prediction accuracy.
- BIRCH clustering provides interpretable job classifications.
- Method outperforms existing approaches on Google Cluster data.

## Abstract

With the rapid growth of the data volume and the fast increasing of the computational model complexity in the scenario of cloud computing, it becomes an important topic that how to handle users' requests by scheduling computational jobs and assigning the resources in data center.   In order to have a better perception of the computing jobs and their requests of resources, we analyze its characteristics and focus on the prediction and classification of the computing jobs with some machine learning approaches. Specifically, we apply LSTM neural network to predict the arrival of the jobs and the aggregated requests for computing resources. Then we evaluate it on Google Cluster dataset and it shows that the accuracy has been improved compared to the current existing methods. Additionally, to have a better understanding of the computing jobs, we use an unsupervised hierarchical clustering algorithm, BIRCH, to make classification and get some interpretability of our results in the computing centers.

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/1903.03759/full.md

## Figures

18 figures with captions in the complete paper: https://tomesphere.com/paper/1903.03759/full.md

## References

22 references — full list in the complete paper: https://tomesphere.com/paper/1903.03759/full.md

---
Source: https://tomesphere.com/paper/1903.03759