Multi-Resolution Supervision Network with an Adaptive Weighted Loss for Desert Segmentation

Desert segmentation of remote sensing images is the basis of analysis of desert area. Desert images are usually characterized by large image size, large-scale change, and irregular location distribution of surface objects. The multi-scale fusion method is widely used in the existing deep learning se...

Full description

Bibliographic Details
Main Authors: Lexuan Wang, Liguo Weng, Min Xia, Jia Liu, Haifeng Lin
Format: Article
Language:English
Published: MDPI AG 2021-05-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/13/11/2054
id doaj-23718665011c46be987957546a07defa
record_format Article
spelling doaj-23718665011c46be987957546a07defa2021-06-01T00:52:04ZengMDPI AGRemote Sensing2072-42922021-05-01132054205410.3390/rs13112054Multi-Resolution Supervision Network with an Adaptive Weighted Loss for Desert SegmentationLexuan Wang0Liguo Weng1Min Xia2Jia Liu3Haifeng Lin4Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology, Nanjing University of Information Science and Technology, Nanjing 210044, ChinaJiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology, Nanjing University of Information Science and Technology, Nanjing 210044, ChinaJiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology, Nanjing University of Information Science and Technology, Nanjing 210044, ChinaJiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology, Nanjing University of Information Science and Technology, Nanjing 210044, ChinaCollege of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, ChinaDesert segmentation of remote sensing images is the basis of analysis of desert area. Desert images are usually characterized by large image size, large-scale change, and irregular location distribution of surface objects. The multi-scale fusion method is widely used in the existing deep learning segmentation models to solve the above problems. Based on the idea of multi-scale feature extraction, this paper took the segmentation results of each scale as an independent optimization task and proposed a multi-resolution supervision network (MrsSeg) to further improve the desert segmentation result. Due to the different optimization difficulty of each branch task, we also proposed an auxiliary adaptive weighted loss function (AWL) to automatically optimize the training process. MrsSeg first used a lightweight backbone to extract different-resolution features, then adopted a multi-resolution fusion module to fuse the local information and global information, and finally, a multi-level fusion decoder was used to aggregate and merge the features at different levels to get the desert segmentation result. In this method, each branch loss was treated as an independent task, AWL was proposed to calculate and adjust the weight of each branch. By giving priority to the easy tasks, the improved loss function could effectively improve the convergence speed of the model and the desert segmentation result. The experimental results showed that MrsSeg-AWL effectively improved the learning ability of the model and has faster convergence speed, lower parameter complexity, and more accurate segmentation results.https://www.mdpi.com/2072-4292/13/11/2054multi-resolution supervisionadaptive weighted lossmulti-scalefusiondeep learning
collection DOAJ
language English
format Article
sources DOAJ
author Lexuan Wang
Liguo Weng
Min Xia
Jia Liu
Haifeng Lin
spellingShingle Lexuan Wang
Liguo Weng
Min Xia
Jia Liu
Haifeng Lin
Multi-Resolution Supervision Network with an Adaptive Weighted Loss for Desert Segmentation
Remote Sensing
multi-resolution supervision
adaptive weighted loss
multi-scale
fusion
deep learning
author_facet Lexuan Wang
Liguo Weng
Min Xia
Jia Liu
Haifeng Lin
author_sort Lexuan Wang
title Multi-Resolution Supervision Network with an Adaptive Weighted Loss for Desert Segmentation
title_short Multi-Resolution Supervision Network with an Adaptive Weighted Loss for Desert Segmentation
title_full Multi-Resolution Supervision Network with an Adaptive Weighted Loss for Desert Segmentation
title_fullStr Multi-Resolution Supervision Network with an Adaptive Weighted Loss for Desert Segmentation
title_full_unstemmed Multi-Resolution Supervision Network with an Adaptive Weighted Loss for Desert Segmentation
title_sort multi-resolution supervision network with an adaptive weighted loss for desert segmentation
publisher MDPI AG
series Remote Sensing
issn 2072-4292
publishDate 2021-05-01
description Desert segmentation of remote sensing images is the basis of analysis of desert area. Desert images are usually characterized by large image size, large-scale change, and irregular location distribution of surface objects. The multi-scale fusion method is widely used in the existing deep learning segmentation models to solve the above problems. Based on the idea of multi-scale feature extraction, this paper took the segmentation results of each scale as an independent optimization task and proposed a multi-resolution supervision network (MrsSeg) to further improve the desert segmentation result. Due to the different optimization difficulty of each branch task, we also proposed an auxiliary adaptive weighted loss function (AWL) to automatically optimize the training process. MrsSeg first used a lightweight backbone to extract different-resolution features, then adopted a multi-resolution fusion module to fuse the local information and global information, and finally, a multi-level fusion decoder was used to aggregate and merge the features at different levels to get the desert segmentation result. In this method, each branch loss was treated as an independent task, AWL was proposed to calculate and adjust the weight of each branch. By giving priority to the easy tasks, the improved loss function could effectively improve the convergence speed of the model and the desert segmentation result. The experimental results showed that MrsSeg-AWL effectively improved the learning ability of the model and has faster convergence speed, lower parameter complexity, and more accurate segmentation results.
topic multi-resolution supervision
adaptive weighted loss
multi-scale
fusion
deep learning
url https://www.mdpi.com/2072-4292/13/11/2054
work_keys_str_mv AT lexuanwang multiresolutionsupervisionnetworkwithanadaptiveweightedlossfordesertsegmentation
AT liguoweng multiresolutionsupervisionnetworkwithanadaptiveweightedlossfordesertsegmentation
AT minxia multiresolutionsupervisionnetworkwithanadaptiveweightedlossfordesertsegmentation
AT jialiu multiresolutionsupervisionnetworkwithanadaptiveweightedlossfordesertsegmentation
AT haifenglin multiresolutionsupervisionnetworkwithanadaptiveweightedlossfordesertsegmentation
_version_ 1721413598785306624