Efficient Implementation of LinearUCB through Algorithmic Improvements and Vector Computing Acceleration for Embedded Learning Systems

TL;DR

This paper introduces combined algorithmic and hardware optimizations to efficiently implement LinearUCB algorithms on resource-limited embedded devices, enabling real-time autonomous decision-making in IoT applications.

Contribution

It proposes novel algorithmic modifications and vector computing acceleration techniques to improve the efficiency of LinearUCB algorithms on embedded systems.

Findings

Significant reduction in execution time.

Lower energy consumption.

Enhanced suitability for real-time IoT applications.

Abstract

As the Internet of Things expands, embedding Artificial Intelligence algorithms in resource-constrained devices has become increasingly important to enable real-time, autonomous decision-making without relying on centralized cloud servers. However, implementing and executing complex algorithms in embedded devices poses significant challenges due to limited computational power, memory, and energy resources. This paper presents algorithmic and hardware techniques to efficiently implement two LinearUCB Contextual Bandits algorithms on resource-constrained embedded devices. Algorithmic modifications based on the Sherman-Morrison-Woodbury formula streamline model complexity, while vector acceleration is harnessed to speed up matrix operations. We analyze the impact of each optimization individually and then combine them in a two-pronged strategy. The results show notable improvements in execution time and energy consumption, demonstrating the effectiveness of combining algorithmic and hardware optimizations to enhance learning models for edge computing environments with low-power and real-time requirements.