Optimizing Spot Instance Reliability and Security Using Cloud-Native Data and Tools

TL;DR

This paper introduces Cloudlab, a cloud-native laboratory built on Google Cloud that supports network security research and training through containerized workloads, automation, and advanced security tools.

Contribution

It presents a comprehensive, scalable environment integrating Kubernetes, serverless architectures, and security tools for research and training in cloud-native security.

Findings

Supports secure, containerized workloads with Kubernetes and serverless architectures.

Integrates security tools like Palo Alto firewalls and Bridgecrew for automated security.

Enables exploration of advanced security concepts in a scalable cloud environment.

Abstract

This paper represents "Cloudlab", a comprehensive, cloud - native laboratory designed to support network security research and training. Built on Google Cloud and adhering to GitOps methodologies, Cloudlab facilitates the the creation, testing, and deployment of secure, containerized workloads using Kubernetes and serverless architectures. The lab integrates tools like Palo Alto Networks firewalls, Bridgecrew for "Security as Code," and automated GitHub workflows to establish a robust Continuous Integration/Continuous Machine Learning pipeline. By providing an adaptive and scalable environment, Cloudlab supports advanced security concepts such as role-based access control, Policy as Code, and container security. This initiative enables data scientists and engineers to explore cutting-edge practices in a dynamic cloud-native ecosystem, fostering innovation and improving operational resilience in modern IT infrastructures.