VisionGRU: A Linear-Complexity RNN Model for Efficient Image Analysis

TL;DR

VisionGRU introduces a linear-complexity RNN architecture for efficient high-resolution image analysis, outperforming ViTs in accuracy and resource usage, and enabling scalable vision tasks.

Contribution

It proposes a novel RNN-based model, VisionGRU, with a simplified minGRU and hierarchical modules for efficient multi-scale image feature extraction.

Findings

Outperforms ViTs on ImageNet and ADE20K datasets.

Reduces memory and computational costs significantly.

Effective for high-resolution image classification and segmentation.

Abstract

Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) are two dominant models for image analysis. While CNNs excel at extracting multi-scale features and ViTs effectively capture global dependencies, both suffer from high computational costs, particularly when processing high-resolution images. Recently, state-space models (SSMs) and recurrent neural networks (RNNs) have attracted attention due to their efficiency. However, their performance in image classification tasks remains limited. To address these challenges, this paper introduces VisionGRU, a novel RNN-based architecture designed for efficient image classification. VisionGRU leverages a simplified Gated Recurrent Unit (minGRU) to process large-scale image features with linear complexity. It divides images into smaller patches and progressively reduces the sequence length while increasing the channel depth, thus facilitating multi-scale feature extraction. A hierarchical 2DGRU module with bidirectional scanning captures both local and global contexts, improving long-range dependency modeling, particularly for tasks like semantic segmentation. Experimental results on the ImageNet and ADE20K datasets demonstrate that VisionGRU outperforms ViTs, significantly reducing memory usage and computational costs, especially for high-resolution images. These findings underscore the potential of RNN-based approaches for developing efficient and scalable computer vision solutions. Codes will be available at https://github.com/YangLiu9208/VisionGRU.