Data Dams: A Novel Framework for Regulating and Managing Data Flow in Large-Scale Systems
Mohamed Aly Bouke, Azizol Abdullah, Korhan Cengiz, Nikola Ivkovi\'c,, Ivan Mihaljevi\'c, Mudathir Ahmed Mohamud, and Ahmed Kowrina

TL;DR
This paper introduces Data Dams, a dynamic framework inspired by physical dams, to optimize data flow regulation in large-scale systems, improving efficiency and preventing overflow through predictive analytics and adaptive controls.
Contribution
The paper presents a novel, scalable framework for real-time data flow regulation in large-scale systems, combining physical dam concepts with intelligent analytics.
Findings
Significantly reduces average storage levels.
Increases total data outflow.
Outperforms static flow control models.
Abstract
In the era of big data, managing dynamic data flows efficiently is crucial as traditional storage models struggle with real-time regulation and risk overflow. This paper introduces Data Dams, a novel framework designed to optimize data inflow, storage, and outflow by dynamically adjusting flow rates to prevent congestion while maximizing resource utilization. Inspired by physical dam mechanisms, the framework employs intelligent sluice controls and predictive analytics to regulate data flow based on system conditions such as bandwidth availability, processing capacity, and security constraints. Simulation results demonstrate that the Data Dam significantly reduces average storage levels (371.68 vs. 426.27 units) and increases total outflow (7999.99 vs. 7748.76 units) compared to static baseline models. By ensuring stable and adaptive outflow rates under fluctuating data loads, this…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Data Storage Technologies · Blockchain Technology Applications and Security · Privacy-Preserving Technologies in Data
