Network-Adaptive Cloud Processing for Visual Neuroprostheses

TL;DR

This paper proposes a network-adaptive cloud processing pipeline for visual neuroprostheses that dynamically adjusts image transmission based on network conditions to maintain perceptual stability.

Contribution

It introduces a real-time adaptive encoding method that reduces latency and maintains scene understanding despite network variability in cloud-assisted visual processing.

Findings

Adaptive encoding reduces latency during network congestion.

Modest degradation of scene structure with adaptive encoding.

Boundary precision degrades more sharply under adverse conditions.

Abstract

Cloud-based machine learning is increasingly explored as a preprocessing strategy for next-generation visual neuroprostheses, where advanced scene understanding may exceed the computational and energy constraints of battery-powered visual processing units. Offloading computation to remote servers enables the use of state-of-the-art vision models, but also introduces sensitivity to network latency, jitter, and packet loss, which can disrupt the temporal consistency of the delivered neural stimulus. In this work, we examine the feasibility of cloud-assisted visual preprocessing for artificial vision by framing remote inference as a perceptually constrained systems problem. We present a network-adaptive cloud-assisted pipeline in which real-time round-trip-time feedback is used to dynamically modulate image resolution, compression, and transmission rate, explicitly prioritizing temporal continuity under adverse network conditions. PIDNet is used as a fixed real-time semantic segmentation backbone, allowing us to isolate how network-adaptive input encoding affects communication delay, inference time, and perceptual fidelity. Results show that adaptive visual encoding substantially reduces end-to-end latency during network congestion, with only modest degradation of global scene structure, while boundary precision degrades more sharply. Together, these findings delineate operating regimes in which cloud-assisted preprocessing may remain viable for future visual neuroprostheses and underscore the importance of network-aware adaptation for maintaining perceptual stability.