Beyond Quadratic: Linear-Time Change Detection with RWKV

TL;DR

This paper presents ChangeRWKV, a novel change detection architecture that combines the efficiency of RNNs with the global context capturing ability of Transformers, achieving state-of-the-art results with reduced computational costs.

Contribution

It introduces ChangeRWKV, integrating hierarchical RWKV encoding and a Spatial-Temporal Fusion Module for efficient, high-performance remote sensing change detection.

Findings

Achieves 85.46% IoU on LEVIR-CD benchmark.

Reduces parameters and FLOPs compared to previous methods.

Demonstrates state-of-the-art performance in change detection.

Abstract

Existing paradigms for remote sensing change detection are caught in a trade-off: CNNs excel at efficiency but lack global context, while Transformers capture long-range dependencies at a prohibitive computational cost. This paper introduces ChangeRWKV, a new architecture that reconciles this conflict. By building upon the Receptance Weighted Key Value (RWKV) framework, our ChangeRWKV uniquely combines the parallelizable training of Transformers with the linear-time inference of RNNs. Our approach core features two key innovations: a hierarchical RWKV encoder that builds multi-resolution feature representation, and a novel Spatial-Temporal Fusion Module (STFM) engineered to resolve spatial misalignments across scales while distilling fine-grained temporal discrepancies. ChangeRWKV not only achieves state-of-the-art performance on the LEVIR-CD benchmark, with an 85.46% IoU and 92.16% F1 score, but does so while drastically reducing parameters and FLOPs compared to previous leading methods. This work demonstrates a new, efficient, and powerful paradigm for operational-scale change detection. Our code and model are publicly available.