TriFusion-SR: Joint Tri-Modal Medical Image Fusion and SR
Fayaz Ali Dharejo, Sharif S. M. A., Aiman Khalil, Nachiket Chaudhary, Rizwan Ali Naqvi, and Radu Timofte

TL;DR
This paper introduces TriFusionSR, a novel wavelet-guided diffusion framework that jointly performs tri-modal medical image fusion and super-resolution, significantly improving image quality and diagnostic utility.
Contribution
It presents a unified approach combining wavelet decomposition, frequency-aware interaction, and adaptive fusion for enhanced tri-modal medical image super-resolution.
Findings
Achieves 4.8-12.4% PSNR improvement over previous methods.
Reduces RMSE and LPIPS metrics substantially.
Demonstrates state-of-the-art performance across multiple upsampling scales.
Abstract
Multimodal medical image fusion facilitates comprehensive diagnosis by aggregating complementary structural and functional information, but its effectiveness is limited by resolution degradation and modality discrepancies. Existing approaches typically perform image fusion and super-resolution (SR) in separate stages, leading to artifacts and degraded perceptual quality. These limitations are further amplified in tri-modal settings that combine anatomical modalities (e.g., MRI, CT) with functional scans (e.g., PET, SPECT) due to pronounced frequency domain imbalances. We propose TriFusionSR, a wavelet-guided conditional diffusion framework for joint tri-modal fusion and SR. The framework explicitly decomposes multimodal features into frequency bands using the 2D Discrete Wavelet Transform, enabling frequency-aware crossmodal interaction. We further introduce a Rectified Wavelet Features…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Image Fusion Techniques · Advanced Image Processing Techniques · Image Enhancement Techniques
