Efficient Distributed DNNs in the Mobile-edge-cloud Continuum
Francesco Malandrino, Carla Fabiana Chiasserini, Giuseppe Di, Giacomo

TL;DR
This paper introduces RightTrain, a joint decision-making framework for optimizing data, model, and resource matching in distributed deep neural network training across mobile, edge, and cloud nodes, reducing energy use while maintaining quality.
Contribution
It presents a novel formulation and a polynomial-time solution, leveraging an expanded-graph and Steiner tree, with provable near-optimality and significant performance improvements.
Findings
Runs in polynomial time with a competitive ratio of 2(1+ε)
Outperforms state-of-the-art solutions by over 50%
Validated through real-world implementation
Abstract
In the mobile-edge-cloud continuum, a plethora of heterogeneous data sources and computation-capable nodes are available. Such nodes can cooperate to perform a distributed learning task, aided by a learning controller (often located at the network edge). The controller is required to make decisions concerning (i) data selection, i.e., which data sources to use; (ii) model selection, i.e., which machine learning model to adopt, and (iii) matching between the layers of the model and the available physical nodes. All these decisions influence each other, to a significant extent and often in counter-intuitive ways. In this paper, we formulate a problem addressing all of the above aspects and present a solution concept called RightTrain, aiming at making the aforementioned decisions in a joint manner, minimizing energy consumption subject to learning quality and latency constraints.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsBrain Tumor Detection and Classification · IoT and Edge/Fog Computing · Advanced Graph Neural Networks
