The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems
Classifying and mapping natural systems such as wetlands using remote sensing frequently relies on data derived from regions of interest (ROIs), often acquired during field campaigns. ROIs tend to be heterogeneous in complex systems with a variety of land cover classes. However, traditional supervis...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2019-03-01
|
Series: | Remote Sensing |
Subjects: | |
Online Access: | http://www.mdpi.com/2072-4292/11/5/551 |
id |
doaj-d4d0eae757f44eb0bd256baa7f846a86 |
---|---|
record_format |
Article |
spelling |
doaj-d4d0eae757f44eb0bd256baa7f846a862020-11-24T21:29:19ZengMDPI AGRemote Sensing2072-42922019-03-0111555110.3390/rs11050551rs11050551The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland SystemsTedros M. Berhane0Hugo Costa1Charles R. Lane2Oleg A. Anenkhonov3Victor V. Chepinoga4Bradley C. Autrey5Pegasus Technical Services, Inc., c/o U.S. Environmental Protection Agency, Cincinnati, OH 45219, USADireção-Geral do Território, Lisbon 1099-052 , PortugalOffice of Research and Development, U.S. Environmental Protection Agency, Cincinnati, OH 45268, USALaboratory of Floristics and Geobotany, Institute of General and Experimental Biology SB RAS, 670047 Ulan-Ude, RussiaLaboratory of Physical Geography and Biogeography, V.B. Sochava Institute of Geography SB RAS, 664033 Irkutsk, RussiaOffice of Research and Development, U.S. Environmental Protection Agency, Cincinnati, OH 45268, USAClassifying and mapping natural systems such as wetlands using remote sensing frequently relies on data derived from regions of interest (ROIs), often acquired during field campaigns. ROIs tend to be heterogeneous in complex systems with a variety of land cover classes. However, traditional supervised image classification is predicated on pure single-class observations to train a classifier. This ultimately encourages end-users to create single-class ROIs, nudging ROIs away from field-based points or gerrymandering the ROI, which may produce ROIs unrepresentative of the landscape and potentially insert error into the classification. In this study, we explored WorldView-2 images and 228 field-based data points to define ROIs of varying heterogeneity levels in terms of class membership to classify and map 22 discrete classes in a large and complex wetland system. The goal was to include rather than avoid ROI heterogeneity and assess its impact on classification accuracy. Parametric and nonparametric classifiers were tested with ROI heterogeneity that varied from 7% to 100%. Heterogeneity was governed by ROI area, which we increased from the field-sampling frame of ~100 m2 nearly 19-fold to ~2124 m2. In general, overall accuracy (OA) tended downwards with increasing heterogeneity but stayed relatively high until extreme heterogeneity levels were reached. Moreover, the differences in OA were not statistically significant across several small-to-large heterogeneity levels. Per-class user’s and producer’s accuracies behaved similarly. Our findings suggest that ROI heterogeneity did not harm classification accuracy unless heterogeneity became extreme, and thus there are substantial practical advantages to accommodating heterogeneous ROIs in image classification. Rather than attempting to avoid ROI heterogeneity by gerrymandering, classification in wetland environments, as well as analyses of other complex environments, should embrace ROI heterogeneity.http://www.mdpi.com/2072-4292/11/5/551general linear model (GLM)gerrymanderingLake Baikalmethodsmultinomial linear model (MLM)mixed pixelsrandom forest (RF)Selenga river deltasupport vector machine (SVM)Worldview-2 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Tedros M. Berhane Hugo Costa Charles R. Lane Oleg A. Anenkhonov Victor V. Chepinoga Bradley C. Autrey |
spellingShingle |
Tedros M. Berhane Hugo Costa Charles R. Lane Oleg A. Anenkhonov Victor V. Chepinoga Bradley C. Autrey The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems Remote Sensing general linear model (GLM) gerrymandering Lake Baikal methods multinomial linear model (MLM) mixed pixels random forest (RF) Selenga river delta support vector machine (SVM) Worldview-2 |
author_facet |
Tedros M. Berhane Hugo Costa Charles R. Lane Oleg A. Anenkhonov Victor V. Chepinoga Bradley C. Autrey |
author_sort |
Tedros M. Berhane |
title |
The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems |
title_short |
The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems |
title_full |
The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems |
title_fullStr |
The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems |
title_full_unstemmed |
The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems |
title_sort |
influence of region of interest heterogeneity on classification accuracy in wetland systems |
publisher |
MDPI AG |
series |
Remote Sensing |
issn |
2072-4292 |
publishDate |
2019-03-01 |
description |
Classifying and mapping natural systems such as wetlands using remote sensing frequently relies on data derived from regions of interest (ROIs), often acquired during field campaigns. ROIs tend to be heterogeneous in complex systems with a variety of land cover classes. However, traditional supervised image classification is predicated on pure single-class observations to train a classifier. This ultimately encourages end-users to create single-class ROIs, nudging ROIs away from field-based points or gerrymandering the ROI, which may produce ROIs unrepresentative of the landscape and potentially insert error into the classification. In this study, we explored WorldView-2 images and 228 field-based data points to define ROIs of varying heterogeneity levels in terms of class membership to classify and map 22 discrete classes in a large and complex wetland system. The goal was to include rather than avoid ROI heterogeneity and assess its impact on classification accuracy. Parametric and nonparametric classifiers were tested with ROI heterogeneity that varied from 7% to 100%. Heterogeneity was governed by ROI area, which we increased from the field-sampling frame of ~100 m2 nearly 19-fold to ~2124 m2. In general, overall accuracy (OA) tended downwards with increasing heterogeneity but stayed relatively high until extreme heterogeneity levels were reached. Moreover, the differences in OA were not statistically significant across several small-to-large heterogeneity levels. Per-class user’s and producer’s accuracies behaved similarly. Our findings suggest that ROI heterogeneity did not harm classification accuracy unless heterogeneity became extreme, and thus there are substantial practical advantages to accommodating heterogeneous ROIs in image classification. Rather than attempting to avoid ROI heterogeneity by gerrymandering, classification in wetland environments, as well as analyses of other complex environments, should embrace ROI heterogeneity. |
topic |
general linear model (GLM) gerrymandering Lake Baikal methods multinomial linear model (MLM) mixed pixels random forest (RF) Selenga river delta support vector machine (SVM) Worldview-2 |
url |
http://www.mdpi.com/2072-4292/11/5/551 |
work_keys_str_mv |
AT tedrosmberhane theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems AT hugocosta theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems AT charlesrlane theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems AT olegaanenkhonov theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems AT victorvchepinoga theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems AT bradleycautrey theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems AT tedrosmberhane influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems AT hugocosta influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems AT charlesrlane influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems AT olegaanenkhonov influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems AT victorvchepinoga influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems AT bradleycautrey influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems |
_version_ |
1725966174482595840 |