Configurable Runtime Orchestration for Dynamic Data Retrieval in Distributed Systems
Abhiram Kandiraju

TL;DR
This paper introduces a configuration-driven runtime orchestration framework that dynamically generates execution graphs for distributed data retrieval, enabling flexible, low-latency integration without redeploying workflows.
Contribution
It proposes a novel framework that generates execution graphs at request time from configurations, allowing dynamic, scalable orchestration in evolving distributed systems.
Findings
Enables low-latency orchestration without redeployments.
Supports dependency-aware scheduling and parallel execution.
Demonstrates effectiveness through a Customer 360 case study.
Abstract
Modern enterprise platforms increasingly depend on distributed microservices, analytical data platforms, and external APIs to construct composite responses for applications. Orchestrating data retrieval across these heterogeneous systems is challenging because many workflow platforms rely on predefined workflows or state-machine definitions. Systems such as Apache Airflow, AWS Step Functions, and Temporal provide powerful orchestration capabilities but typically assume workflows are defined prior to execution. This paper presents a configuration-driven runtime orchestration framework for dynamic data retrieval in distributed systems. The framework generates execution graphs dynamically from configuration at request time, enabling low-latency orchestration without redeploying workflow code when integrations evolve. The execution planner performs dependency-aware scheduling and parallel…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSoftware System Performance and Reliability · Advanced Database Systems and Queries · Cloud Computing and Resource Management
