This is a PyTorch implementation of the 2021 ACMMM paper "Auto-MSFNet: Search Multi-scale Fusion Network for Salient Object Detection", this paper can be download by this link(提取码:a28y).
Multi-scale features fusion plays a critical role in salient object detection. Most of existing methods have achieved remarkable performance by exploiting various multi-scale features fusion strategies. However, an elegant fusion framework requires expert knowledge and experience, heavily relying on laborious trial and error. In this paper, we propose a multi-scale features fusion framework based on Neural Architecture Search (NAS), named Auto-MSFNet. First, we design a novel search cell, named FusionCell to automatically decide multi-scale features aggregation. Rather than searching one repeatable cell stacked, we allow different FusionCells to flexibly integrate multi-level features. Simultaneously, considering features generated from CNNs are naturally spatial and channel-wise, we propose a new search space for efficiently focusing on the most relevant information. The search space mitigates incomplete object structures or over-predicted foreground regions caused by progressive fusion. Second, we propose a progressive polishing loss to further obtain exquisite boundaries by penalizing misalignment of salient object boundaries. Extensive experiments on five benchmark datasets demonstrate the effectiveness of the proposed method and achieve state-of-the-art performance on four evaluation metrics.
- Python 3.6
- Pytorch 1.6.0
- saliency maps: ResNet-50( Google | Baidu 提取码:3d22) Vgg-16(Google | Baidu 提取码:wv61 )
- trained model: ResNet-50( Google | Baidu 提取码:yfh8 ). Vgg-16(Google | Baidu 提取码:qhqs )
- Our quantitative comparisons
- Our qualitative comparisons
We use this python tools to evaluated the saliency maps.
First, you need download the Pycharm and download the checkpoint (based ResNet-50 or Vgg-16).
Second, you need change test.py some paths(e.g., dataset path) than
run test.py @InProceedings{Miao_2021_ACM_MM,
author = {Miao {Zhang} and Tingwei {Liu} and Yongri {Piao} and ShunYu {Yao} and Huchuan {Lu}},
title = {Auto-MSFNet: Search Multi-scale Fusion Network for Salient Object Detection},
booktitle = "ACM Multimedia Conference 2021",
year = {2021}
}