Synergy: Towards On-Body AI via Tiny AI Accelerator Collaboration on Wearables
Taesik Gong, Si Young Jang, Utku G\"unay Acer, Fahim Kawsar, Chulhong, Min

TL;DR
Synergy enables efficient on-body AI by orchestrating collaborative execution of multiple AI models on wearable devices, significantly improving throughput, reducing latency, and lowering power consumption.
Contribution
This work introduces a system-driven approach with device-agnostic interfaces and intelligent execution planning for AI accelerators in wearables, enhancing performance and efficiency.
Findings
23.0x increase in throughput
73.9% reduction in latency
15.8% power savings
Abstract
The advent of tiny artificial intelligence (AI) accelerators enables AI to run at the extreme edge, offering reduced latency, lower power cost, and improved privacy. When integrated into wearable devices, these accelerators open exciting opportunities, allowing various AI apps to run directly on the body. We present Synergy that provides AI apps with best-effort performance via system-driven holistic collaboration over AI accelerator-equipped wearables. To achieve this, Synergy provides device-agnostic programming interfaces to AI apps, giving the system visibility and controllability over the app's resource use. Then, Synergy maximizes the inference throughput of concurrent AI models by creating various execution plans for each app considering AI accelerator availability and intelligently selecting the best set of execution plans. Synergy further improves throughput by leveraging…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsScientific Computing and Data Management · Parallel Computing and Optimization Techniques · Cloud Computing and Resource Management
MethodsSparse Evolutionary Training
