HS-ResNet: Hierarchical-Split Block on Convolutional Neural Network

TL;DR

This paper introduces the Hierarchical-Split Block, a plug-and-play module that enhances CNN performance across various vision tasks by capturing multi-scale features through hierarchical split and concatenate connections.

Contribution

The paper proposes a novel Hierarchical-Split Block that can be integrated into CNNs, significantly improving performance on multiple vision tasks with flexible and efficient architecture design.

Findings

HS-ResNet50 achieves 81.28% top-1 accuracy on ImageNet-1k

Significant performance improvements over baseline models across tasks

Hierarchical-Split Block enhances multi-scale feature extraction

Abstract

This paper addresses representational block named Hierarchical-Split Block, which can be taken as a plug-and-play block to upgrade existing convolutional neural networks, improves model performance significantly in a network. Hierarchical-Split Block contains many hierarchical split and concatenate connections within one single residual block. We find multi-scale features is of great importance for numerous vision tasks. Moreover, Hierarchical-Split block is very flexible and efficient, which provides a large space of potential network architectures for different applications. In this work, we present a common backbone based on Hierarchical-Split block for tasks: image classification, object detection, instance segmentation and semantic image segmentation/parsing. Our approach shows significant improvements over all these core tasks in comparison with the baseline. As shown in Figure1, for image classification, our 50-layers network(HS-ResNet50) achieves 81.28% top-1 accuracy with competitive latency on ImageNet-1k dataset. It also outperforms most state-of-the-art models. The source code and models will be available on: https://github.com/PaddlePaddle/PaddleClas