Continual Error Correction on Low-Resource Devices

TL;DR

This paper introduces a resource-efficient on-device error correction system for AI models, enabling users to fix misclassifications with minimal computational resources through prototype-based updates, suitable for low-resource devices.

Contribution

It presents a novel on-device error correction method combining server-side knowledge distillation with prototype adaptation, optimized for low-resource environments.

Findings

Achieved over 50% one-shot error correction on Food-101 and Flowers-102 datasets.

Maintained less than 0.02% forgetting during correction.

Demonstrated practical implementation via an Android app.

Abstract

The proliferation of AI models in everyday devices has highlighted a critical challenge: prediction errors that degrade user experience. While existing solutions focus on error detection, they rarely provide efficient correction mechanisms, especially for resource-constrained devices. We present a novel system enabling users to correct AI misclassifications through few-shot learning, requiring minimal computational resources and storage. Our approach combines server-side foundation model training with on-device prototype-based classification, enabling efficient error correction through prototype updates rather than model retraining. The system consists of two key components: (1) a server-side pipeline that leverages knowledge distillation to transfer robust feature representations from foundation models to device-compatible architectures, and (2) a device-side mechanism that enables ultra-efficient error correction through prototype adaptation. We demonstrate our system's effectiveness on both image classification and object detection tasks, achieving over 50% error correction in one-shot scenarios on Food-101 and Flowers-102 datasets while maintaining minimal forgetting (less than 0.02%) and negligible computational overhead. Our implementation, validated through an Android demonstration app, proves the system's practicality in real-world scenarios.