# Frequency-oriented hierarchical fusion network for single image raindrop removal

**Authors:** Juncheng Wang, Jie Zhang, Shuai Guo, Bo Li

PMC · DOI: 10.1371/journal.pone.0301439 · PLOS ONE · 2024-05-23

## TL;DR

This paper introduces a new method for removing raindrops from images by focusing on frequency information to improve image quality and reduce artifacts.

## Contribution

The paper proposes a frequency-oriented Hierarchical Fusion Network with a dynamic adaptive frequency loss and calibrated attention mechanism.

## Key findings

- The proposed method outperforms existing methods in raindrop removal.
- The dynamic adaptive frequency loss helps recover high-frequency components effectively.
- The hierarchical fusion network improves contextual and spatial feature learning.

## Abstract

Single image raindrop removal aims at recovering high-resolution images from degraded ones. However, existing methods primarily employ pixel-level supervision between image pairs to learn spatial features, thus ignoring the more discriminative frequency information. This drawback results in the loss of high-frequency structures and the generation of diverse artifacts in the restored image. To ameliorate this deficiency, we propose a novel frequency-oriented Hierarchical Fusion Network (HFNet) for raindrop image restoration. Specifically, to compensate for spatial representation deficiencies, we design a dynamic adaptive frequency loss (DAFL), which allows the model to adaptively handle the high-frequency components that are difficult to recover. To handle spatially diverse raindrops, we propose a hierarchical fusion network to efficiently learn both contextual information and spatial features. Meanwhile, a calibrated attention mechanism is proposed to facilitate the transfer of valuable information. Comparative experiments with existing methods indicate the advantages of the proposed algorithm.

## Full-text entities

- **Genes:** GPHA2 (glycoprotein hormone subunit alpha 2) [NCBI Gene 170589] {aka A2, GPA2, ZSIG51}, MS4A1 (membrane spanning 4-domains A1) [NCBI Gene 931] {aka B1, Bp35, CD20, CVID5, FMC7, LEU-16}, IGKV5-2 (immunoglobulin kappa variable 5-2) [NCBI Gene 28907] {aka B2, IGKV52}, RASIP1 (Ras interacting protein 1) [NCBI Gene 54922] {aka RAIN}
- **Diseases:** Charbonnier loss (MESH:D016388)
- **Chemicals:** CRM (-), DDN (MESH:C039018)

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/PMC11115234/full.md

## Figures

10 figures with captions in the complete paper: https://tomesphere.com/paper/PMC11115234/full.md

## References

20 references — full list in the complete paper: https://tomesphere.com/paper/PMC11115234/full.md

---
Source: https://tomesphere.com/paper/PMC11115234