Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network
This paper focuses on intelligent photogrammetry deep learning:deep residual method.Salient object detection aims at identifying the visually interesting object regions that are consistent with human perception.Multispectral remote sensing images provide rich radiometric information in revealing the...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | zho |
Published: |
Surveying and Mapping Press
2018-06-01
|
Series: | Acta Geodaetica et Cartographica Sinica |
Subjects: | |
Online Access: | http://html.rhhz.net/CHXB/html/2018-6-873.htm |
id |
doaj-cd081422168b4d79a9849a49e05ceca8 |
---|---|
record_format |
Article |
spelling |
doaj-cd081422168b4d79a9849a49e05ceca82020-11-24T22:18:07ZzhoSurveying and Mapping PressActa Geodaetica et Cartographica Sinica1001-15951001-15952018-06-0147687388110.11947/j.AGCS.2018.201706332018060633Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual NetworkDAI Yuchao0ZHANG Jing1Fatih PORIKLI2HE Mingyi3School of Electronics and Information, Northwestern Polytechnical University, Xi'an 710129, ChinaSchool of Electronics and Information, Northwestern Polytechnical University, Xi'an 710129, ChinaResearch School of Engineering, Australian National University, Canberra 2601, AustraliaSchool of Electronics and Information, Northwestern Polytechnical University, Xi'an 710129, ChinaThis paper focuses on intelligent photogrammetry deep learning:deep residual method.Salient object detection aims at identifying the visually interesting object regions that are consistent with human perception.Multispectral remote sensing images provide rich radiometric information in revealing the physical properties of the observed objects,therefore promise a great potential in salient object detection tasks.Conventional salient object detection methods often employ handcrafted features to predict saliency by evaluating the pixel-wise or superpixel-wise similarity.With the recent emergence of deep learning based approaches,in particular,fully convolutional neural networks,there has been profound progress in visual saliency detection.However,this success has not been extended to multispectral remote sensing images,and existing multispectral salient object detection methods are still mainly based on handcrafted features,essentially due to the difficulties in image acquisition and labeling.In this paper,we propose a novel deep residual network based on a top-down model,which is trained in an end-to-end manner to tackle the above issues in multispectral salient object detection.Our model effectively exploits the saliency cues at different levels of the deep residual network.To overcome the limited availability of remote sensing images in training of our deep residual network,we also introduce a new spectral image reconstruction model that can generate multispectral images from RGB images.Our extensive experimental evaluations using both multispectral and RGB salient object detection datasets demonstrate a significant performance improvement of more than 10% compared with the state-of-the-art methods.http://html.rhhz.net/CHXB/html/2018-6-873.htmdeep residual networksalient object detectionspectral super-resolutiontop-down modelremote sensing image processing |
collection |
DOAJ |
language |
zho |
format |
Article |
sources |
DOAJ |
author |
DAI Yuchao ZHANG Jing Fatih PORIKLI HE Mingyi |
spellingShingle |
DAI Yuchao ZHANG Jing Fatih PORIKLI HE Mingyi Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network Acta Geodaetica et Cartographica Sinica deep residual network salient object detection spectral super-resolution top-down model remote sensing image processing |
author_facet |
DAI Yuchao ZHANG Jing Fatih PORIKLI HE Mingyi |
author_sort |
DAI Yuchao |
title |
Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network |
title_short |
Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network |
title_full |
Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network |
title_fullStr |
Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network |
title_full_unstemmed |
Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network |
title_sort |
salient object detection from multi-spectral remote sensing images with deep residual network |
publisher |
Surveying and Mapping Press |
series |
Acta Geodaetica et Cartographica Sinica |
issn |
1001-1595 1001-1595 |
publishDate |
2018-06-01 |
description |
This paper focuses on intelligent photogrammetry deep learning:deep residual method.Salient object detection aims at identifying the visually interesting object regions that are consistent with human perception.Multispectral remote sensing images provide rich radiometric information in revealing the physical properties of the observed objects,therefore promise a great potential in salient object detection tasks.Conventional salient object detection methods often employ handcrafted features to predict saliency by evaluating the pixel-wise or superpixel-wise similarity.With the recent emergence of deep learning based approaches,in particular,fully convolutional neural networks,there has been profound progress in visual saliency detection.However,this success has not been extended to multispectral remote sensing images,and existing multispectral salient object detection methods are still mainly based on handcrafted features,essentially due to the difficulties in image acquisition and labeling.In this paper,we propose a novel deep residual network based on a top-down model,which is trained in an end-to-end manner to tackle the above issues in multispectral salient object detection.Our model effectively exploits the saliency cues at different levels of the deep residual network.To overcome the limited availability of remote sensing images in training of our deep residual network,we also introduce a new spectral image reconstruction model that can generate multispectral images from RGB images.Our extensive experimental evaluations using both multispectral and RGB salient object detection datasets demonstrate a significant performance improvement of more than 10% compared with the state-of-the-art methods. |
topic |
deep residual network salient object detection spectral super-resolution top-down model remote sensing image processing |
url |
http://html.rhhz.net/CHXB/html/2018-6-873.htm |
work_keys_str_mv |
AT daiyuchao salientobjectdetectionfrommultispectralremotesensingimageswithdeepresidualnetwork AT zhangjing salientobjectdetectionfrommultispectralremotesensingimageswithdeepresidualnetwork AT fatihporikli salientobjectdetectionfrommultispectralremotesensingimageswithdeepresidualnetwork AT hemingyi salientobjectdetectionfrommultispectralremotesensingimageswithdeepresidualnetwork |
_version_ |
1725783136526139392 |