Migration of CMSWEB Cluster at CERN to Kubernetes
Muhammad Imran, Valentin Kuznetsov, Lina Marcella, Katarzyna Maria, Dziedziniewicz-Wojcik, Andreas Pfeiffer, Panos Paparrigopoulos

TL;DR
This paper discusses migrating the CMSWEB cluster at CERN from virtual machines to a Kubernetes-based containerized architecture to improve deployment efficiency and reduce operational costs.
Contribution
It presents a detailed migration process, compares VM and Kubernetes deployment approaches, and shares lessons learned to enhance cluster sustainability.
Findings
Reduced release upgrade cycle
Cost savings in operations
Successful migration to Kubernetes
Abstract
The CMS experiment heavily relies on the CMSWEB cluster to host critical services for its operational needs. The cluster is deployed on virtual machines (VMs) from the CERN OpenStack cloud and is manually maintained by operators and developers. The release cycle is composed of several steps, from building RPMs, their deployment to perform validation, and integration tests. To enhance the sustainability of the CMSWEB cluster, CMS decided to migrate its cluster to a containerized solution such as Docker, orchestrated with Kubernetes (k8s). This allows us to significantly reduce the release upgrade cycle, follow the end-to-end deployment procedure, and reduce operational cost. This paper gives an overview of the current CMSWEB cluster and its issues. We describe the new architecture of the CMSWEB cluster in Kubernetes. We also provide a comparison of VM and Kubernetes deployment approaches…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
