Dual Mask Branches for Instance Segmentation

Abstract

Instance segmentation is an emerging and challenging task. A lot of previous methods have focused on this field and made great progress. However, complex background and mutual occlusion between instances still hinder the development of instance segmentation. In this paper, we aim to solve foreground confusion for instance segmentation. Based on Mask R-CNN, we first add an additional mask branch, which is parallel to the existing mask branch and expected to predict non-target foreground pixels within the predicted bounding box. To differentiate the two mask branches, the original mask branch is called Target Mask Branch while the additional mask branch is called Non-Target Mask Branch. Besides, in order to enhance the feature interaction and differences between the target mask branch and the non-target mask branch, we design a foreground confusion processing module to connect the dual mask branches. In this way, our method can distinguish the target instance and non-target foreground pixels within the corresponding predicted bounding box effectively, and obtain more accurate segmentation masks. Furthermore, a feature distinguish module is proposed to enhance the differences between features from the dual mask branches. We demonstrate our method's competitiveness on MS COCO dataset, which outperforms previous state-of-the-art instance segmentation methods. In addition, we also add our method into other instance segmentation methods, and the experiment results show our method still can obtain stable gains in performance.