# FERFusion: A Fast and Efficient Recursive Neural Network for Infrared and Visible Image Fusion

**Authors:** Kaixuan Yang, Wei Xiang, Zhenshuai Chen, Yunpeng Liu

PMC · DOI: 10.3390/s24082466 · Sensors (Basel, Switzerland) · 2024-04-11

## TL;DR

This paper introduces FERFusion, a neural network that efficiently fuses infrared and visible images using fewer resources and training data.

## Contribution

The novel contribution is a recursive neural network with shared attention and parallel dilated convolutions for efficient image fusion.

## Key findings

- FERFusion uses minimal parameters and training batches while achieving excellent fusion results.
- The model outperforms nine state-of-the-art methods on three public datasets.
- The approach significantly reduces time, space, and computational resource consumption during training.

## Abstract

The rapid development of deep neural networks has attracted significant attention in the infrared and visible image fusion field. However, most existing fusion models have many parameters and consume high computational and spatial resources. This paper proposes a fast and efficient recursive fusion neural network model to solve this complex problem that few people have touched. Specifically, we designed an attention module combining a traditional fusion knowledge prior with channel attention to extract modal-specific features efficiently. We used a shared attention layer to perform the early fusion of modal-shared features. Adopting parallel dilated convolution layers further reduces the network’s parameter count. Our network is trained recursively, featuring minimal model parameters, and requires only a few training batches to achieve excellent fusion results. This significantly reduces the consumption of time, space, and computational resources during model training. We compared our method with nine SOTA methods on three public datasets, demonstrating our method’s efficient training feature and good fusion results.

## Full-text entities

- **Diseases:** injury to people or property (MESH:C000719191), SCD (MESH:C536778), oral squamous cell carcinoma (MESH:D000077195)
- **Chemicals:** Cr (MESH:D002857), SCD (MESH:C536778), SF (-)
- **Species:** Homo sapiens (human, species) [taxon 9606]

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/PMC11053569/full.md

## Figures

10 figures with captions in the complete paper: https://tomesphere.com/paper/PMC11053569/full.md

## References

81 references — full list in the complete paper: https://tomesphere.com/paper/PMC11053569/full.md

---
Source: https://tomesphere.com/paper/PMC11053569