LEAF + AIO: Edge-Assisted Energy-Aware Object Detection for Mobile Augmented Reality

TL;DR

This paper introduces LEAF + AIO, an edge-assisted system that dynamically adjusts configurations of mobile augmented reality devices to optimize energy consumption while maintaining performance, through a comprehensive analytical model and adaptive algorithms.

Contribution

It presents the first comprehensive analytical energy model for MAR devices and develops adaptive algorithms for configuration and resource management to enhance energy efficiency.

Findings

Significant reduction in energy consumption without performance loss.

Effective dynamic adaptation of MAR configurations based on user and network conditions.

Validated through extensive evaluations demonstrating improved energy efficiency.

Abstract

Today very few deep learning-based mobile augmented reality (MAR) applications are applied in mobile devices because they are significantly energy-guzzling. In this paper, we design an edge-based energy-aware MAR system that enables MAR devices to dynamically change their configurations, such as CPU frequency, computation model size, and image offloading frequency based on user preferences, camera sampling rates, and available radio resources. Our proposed dynamic MAR configuration adaptations can minimize the per frame energy consumption of multiple MAR clients without degrading their preferred MAR performance metrics, such as latency and detection accuracy. To thoroughly analyze the interactions among MAR configurations, user preferences, camera sampling rate, and energy consumption, we propose, to the best of our knowledge, the first comprehensive analytical energy model for MAR devices. Based on the proposed analytical model, we design a LEAF optimization algorithm to guide the MAR configuration adaptation and server radio resource allocation. An image offloading frequency orchestrator, coordinating with the LEAF, is developed to adaptively regulate the edge-based object detection invocations and to further improve the energy efficiency of MAR devices. Extensive evaluations are conducted to validate the performance of the proposed analytical model and algorithms.