Performance Cost Tradeoffs in Intelligent Load Balancing for Multi Data Center Cloud Systems: From Static Policies to Adaptive Resource Distribution

TL;DR

This paper evaluates the performance and cost tradeoffs of static and adaptive load balancing strategies in multi data center cloud systems, highlighting the importance of adaptive policies for efficiency and scalability.

Contribution

It provides a comprehensive comparison of load balancing strategies using simulation, emphasizing the benefits of adaptive resource distribution in diverse cloud deployment scenarios.

Findings

Equally Spread and Throttled strategies improve workload stability under high demand.

Distributing resources reduces latency and enhances scalability.

No single strategy is optimal; effectiveness depends on workload and system objectives.

Abstract

Cloud computing infrastructures increasingly rely on geographically distributed data centers to meet the growing demand for low latency, high availability, and cost-efficient service delivery. In this context, load balancing plays a critical role in optimizing resource utilization while maintaining acceptable quality of service (QoS) under dynamic and heterogeneous workloads. This study presents a comprehensive performance and cost evaluation of three widely used load balancing strategies, namely Round Robin, Equally Spread Current Execution Load, and Throttled, within a multi data center cloud environment using the Cloud Analyst simulation framework. Multiple deployment scenarios are examined by varying data center locations, user base distribution, network latency, and workload intensity. Key performance metrics, including overall response time, data center processing time, request handling behavior, and operational cost such as virtual machine and data transfer costs, are analyzed across two strategy steps. The results indicate that while the Round Robin strategy achieves lower internal processing times, the Equally Spread and Throttled strategies provide improved workload stability and reduced peak response times under high demand conditions. Furthermore, distributing resources across multiple data centers significantly reduces user perceived latency and enhances system scalability, albeit with associated cost tradeoffs. The findings demonstrate that no single load balancing strategy is universally optimal; instead, performance and cost efficiency depend on workload characteristics, geographic distribution, and system objectives. This work offers practical insights for cloud service providers and system designers, emphasizing the importance of intelligent resource distribution and adaptive load balancing policies for sustainable and high-performance cloud infrastructures.