BlendMask: Top-Down Meets Bottom-Up for Instance Segmentation

TL;DR

BlendMask introduces a novel top-down and bottom-up fusion approach for instance segmentation, achieving higher accuracy and faster inference than Mask R-CNN by effectively combining instance and semantic information.

Contribution

The paper proposes the BlendMask module that combines top-down and bottom-up strategies, improving mask prediction accuracy with a simple, fast, and easily integrable design.

Findings

Outperforms Mask R-CNN at the same training schedule

Achieves 34.2% mAP at 25 FPS on a single GPU

20% faster inference speed than Mask R-CNN

Abstract

Instance segmentation is one of the fundamental vision tasks. Recently, fully convolutional instance segmentation methods have drawn much attention as they are often simpler and more efficient than two-stage approaches like Mask R-CNN. To date, almost all such approaches fall behind the two-stage Mask R-CNN method in mask precision when models have similar computation complexity, leaving great room for improvement. In this work, we achieve improved mask prediction by effectively combining instance-level information with semantic information with lower-level fine-granularity. Our main contribution is a blender module which draws inspiration from both top-down and bottom-up instance segmentation approaches. The proposed BlendMask can effectively predict dense per-pixel position-sensitive instance features with very few channels, and learn attention maps for each instance with merely one convolution layer, thus being fast in inference. BlendMask can be easily incorporated with the state-of-the-art one-stage detection frameworks and outperforms Mask R-CNN under the same training schedule while being 20% faster. A light-weight version of BlendMask achieves $ 34.2% $ mAP at 25 FPS evaluated on a single 1080Ti GPU card. Because of its simplicity and efficacy, we hope that our BlendMask could serve as a simple yet strong baseline for a wide range of instance-wise prediction tasks. Code is available at https://git.io/AdelaiDet