Remote Sensing Image Classification Using Deep Ensemble Learning

TL;DR

This paper introduces a fusion ensemble model combining CNNs and Vision Transformers for remote sensing image classification, achieving high accuracy and efficient training by mitigating feature redundancy.

Contribution

It proposes a novel ensemble approach that trains multiple CNN-ViT fusion models and combines their outputs, improving classification accuracy and computational efficiency.

Findings

Achieved 98.10% accuracy on UC Merced dataset

Outperformed existing architectures on multiple datasets

Demonstrated efficient training with reduced redundancy

Abstract

Remote sensing imagery plays a crucial role in many applications and requires accurate computerized classification techniques. Reliable classification is essential for transforming raw imagery into structured and usable information. While Convolutional Neural Networks (CNNs) are mostly used for image classification, they excel at local feature extraction, but struggle to capture global contextual information. Vision Transformers (ViTs) address this limitation through self attention mechanisms that model long-range dependencies. Integrating CNNs and ViTs, therefore, leads to better performance than standalone architectures. However, the use of additional CNN and ViT components does not lead to further performance improvement and instead introduces a bottleneck caused by redundant feature representations. In this research, we propose a fusion model that combines the strengths of CNNs and ViTs for remote sensing image classification. To overcome the performance bottleneck, the proposed approach trains four independent fusion models that integrate CNN and ViT backbones and combine their outputs at the final prediction stage through ensembling. The proposed method achieves accuracy rates of 98.10 percent, 94.46 percent, and 95.45 percent on the UC Merced, RSSCN7, and MSRSI datasets, respectively. These results outperform competing architectures and highlight the effectiveness of the proposed solution, particularly due to its efficient use of computational resources during training.