Abstract
Skin cancer is the most common type of cancer in the world and it is more treatable if diagnosed early. The diagnosis process usually starts with segmenting the skin lesion area and planning a follow-up treatment by the dermatologists. Thus, the segmentation process plays a critical role in the treatment process. In recent years, machine learning methods, especially deep convolutional neural networks are proposed to address the segmentation challenge. The common segmentation methods (e.g., U-Net) deploy a series of encoding blocks to model the local representation and subsequently a series of decoding blocks to capture the semantic relation. However, these structures are usually limited to model multi-scale objects with large variations in texture and shape. To address these limitations, we propose a Multi-Scale Attention U-Net (MSAU-Net) for skin lesion segmentation. In particular, we improve the typical U-net by inserting an attention mechanism at the bottleneck of the network to model the hierarchical representation. The attention module aggregates the multi-level representation in a non-linear fashion to selectively adjust the representative features. Then it deploys a Bidirectional Convolutional Long Short-term Memory (BDC-LSTM) structure to fetch the common discriminative features and suppress the less informative ones. We incorporate the resulted features in each block of the decoding path to highlight the important regions. We have evaluated our proposed network in three public skin lesion datasets, including ISIC 2017, ISIC 2018, and PH2 datasets. The experimental results demonstrate that the proposed pipeline outperforms the existing alternatives.