Real time backbone for semantic segmentation
Zhengeng Yang, Hongshan Yu, Qiang Fu, Wei Sun, Wenyan Jia, Mingui Sun,, Zhi-Hong Mao

TL;DR
This paper introduces a narrow yet deep backbone network for semantic segmentation that significantly improves efficiency and real-time performance, achieving 60.6% mIoU at 54 FPS on Cityscape dataset.
Contribution
The paper proposes a novel narrow and deep CNN backbone that reduces redundancy and computational cost, enabling real-time semantic segmentation.
Findings
Achieved 60.6% mIoU on Cityscape validation set.
Operates at 54 frames per second with 1024x2048 inputs.
Outperforms previous real-time segmentation methods like ENet.
Abstract
The rapid development of autonomous driving in recent years presents lots of challenges for scene understanding. As an essential step towards scene understanding, semantic segmentation thus received lots of attention in past few years. Although deep learning based state-of-the-arts have achieved great success in improving the segmentation accuracy, most of them suffer from an inefficiency problem and can hardly applied to practical applications. In this paper, we systematically analyze the computation cost of Convolutional Neural Network(CNN) and found that the inefficiency of CNN is mainly caused by its wide structure rather than the deep structure. In addition, the success of pruning based model compression methods proved that there are many redundant channels in CNN. Thus, we designed a very narrow while deep backbone network to improve the efficiency of semantic segmentation. By…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Neural Network Applications · Video Surveillance and Tracking Methods · Advanced Image and Video Retrieval Techniques
MethodsFully Convolutional Network · Dilated Convolution · 1x1 Convolution · Batch Normalization · Max Pooling · Convolution · ENet Dilated Bottleneck · ENet Bottleneck · ENet Initial Block · SpatialDropout
