Iwin Transformer: Hierarchical Vision Transformer using Interleaved Windows
Simin Huo, Ning Li

TL;DR
Iwin Transformer is a hierarchical vision transformer that combines interleaved window attention and depthwise separable convolution to enable efficient global and local information exchange, achieving strong performance across various vision tasks.
Contribution
It introduces a position-embedding-free hierarchical vision transformer with interleaved window attention and convolution, allowing direct fine-tuning from low to high resolution.
Findings
Achieves 87.4% top-1 accuracy on ImageNet-1K.
Excels in semantic segmentation and video action recognition.
The core component can replace self-attention in image generation.
Abstract
We introduce Iwin Transformer, a novel position-embedding-free hierarchical vision transformer, which can be fine-tuned directly from low to high resolution, through the collaboration of innovative interleaved window attention and depthwise separable convolution. This approach uses attention to connect distant tokens and applies convolution to link neighboring tokens, enabling global information exchange within a single module, overcoming Swin Transformer's limitation of requiring two consecutive blocks to approximate global attention. Extensive experiments on visual benchmarks demonstrate that Iwin Transformer exhibits strong competitiveness in tasks such as image classification (87.4 top-1 accuracy on ImageNet-1K), semantic segmentation and video action recognition. We also validate the effectiveness of the core component in Iwin as a standalone module that can seamlessly replace the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSensor Technology and Measurement Systems · CCD and CMOS Imaging Sensors · Neural Networks and Applications
