The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems

Classifying and mapping natural systems such as wetlands using remote sensing frequently relies on data derived from regions of interest (ROIs), often acquired during field campaigns. ROIs tend to be heterogeneous in complex systems with a variety of land cover classes. However, traditional supervis...

Full description

Bibliographic Details
Main Authors: Tedros M. Berhane, Hugo Costa, Charles R. Lane, Oleg A. Anenkhonov, Victor V. Chepinoga, Bradley C. Autrey
Format: Article
Language:English
Published: MDPI AG 2019-03-01
Series:Remote Sensing
Subjects:
Online Access:http://www.mdpi.com/2072-4292/11/5/551
id doaj-d4d0eae757f44eb0bd256baa7f846a86
record_format Article
spelling doaj-d4d0eae757f44eb0bd256baa7f846a862020-11-24T21:29:19ZengMDPI AGRemote Sensing2072-42922019-03-0111555110.3390/rs11050551rs11050551The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland SystemsTedros M. Berhane0Hugo Costa1Charles R. Lane2Oleg A. Anenkhonov3Victor V. Chepinoga4Bradley C. Autrey5Pegasus Technical Services, Inc., c/o U.S. Environmental Protection Agency, Cincinnati, OH 45219, USADireção-Geral do Território, Lisbon 1099-052 , PortugalOffice of Research and Development, U.S. Environmental Protection Agency, Cincinnati, OH 45268, USALaboratory of Floristics and Geobotany, Institute of General and Experimental Biology SB RAS, 670047 Ulan-Ude, RussiaLaboratory of Physical Geography and Biogeography, V.B. Sochava Institute of Geography SB RAS, 664033 Irkutsk, RussiaOffice of Research and Development, U.S. Environmental Protection Agency, Cincinnati, OH 45268, USAClassifying and mapping natural systems such as wetlands using remote sensing frequently relies on data derived from regions of interest (ROIs), often acquired during field campaigns. ROIs tend to be heterogeneous in complex systems with a variety of land cover classes. However, traditional supervised image classification is predicated on pure single-class observations to train a classifier. This ultimately encourages end-users to create single-class ROIs, nudging ROIs away from field-based points or gerrymandering the ROI, which may produce ROIs unrepresentative of the landscape and potentially insert error into the classification. In this study, we explored WorldView-2 images and 228 field-based data points to define ROIs of varying heterogeneity levels in terms of class membership to classify and map 22 discrete classes in a large and complex wetland system. The goal was to include rather than avoid ROI heterogeneity and assess its impact on classification accuracy. Parametric and nonparametric classifiers were tested with ROI heterogeneity that varied from 7% to 100%. Heterogeneity was governed by ROI area, which we increased from the field-sampling frame of ~100 m2 nearly 19-fold to ~2124 m2. In general, overall accuracy (OA) tended downwards with increasing heterogeneity but stayed relatively high until extreme heterogeneity levels were reached. Moreover, the differences in OA were not statistically significant across several small-to-large heterogeneity levels. Per-class user’s and producer’s accuracies behaved similarly. Our findings suggest that ROI heterogeneity did not harm classification accuracy unless heterogeneity became extreme, and thus there are substantial practical advantages to accommodating heterogeneous ROIs in image classification. Rather than attempting to avoid ROI heterogeneity by gerrymandering, classification in wetland environments, as well as analyses of other complex environments, should embrace ROI heterogeneity.http://www.mdpi.com/2072-4292/11/5/551general linear model (GLM)gerrymanderingLake Baikalmethodsmultinomial linear model (MLM)mixed pixelsrandom forest (RF)Selenga river deltasupport vector machine (SVM)Worldview-2
collection DOAJ
language English
format Article
sources DOAJ
author Tedros M. Berhane
Hugo Costa
Charles R. Lane
Oleg A. Anenkhonov
Victor V. Chepinoga
Bradley C. Autrey
spellingShingle Tedros M. Berhane
Hugo Costa
Charles R. Lane
Oleg A. Anenkhonov
Victor V. Chepinoga
Bradley C. Autrey
The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems
Remote Sensing
general linear model (GLM)
gerrymandering
Lake Baikal
methods
multinomial linear model (MLM)
mixed pixels
random forest (RF)
Selenga river delta
support vector machine (SVM)
Worldview-2
author_facet Tedros M. Berhane
Hugo Costa
Charles R. Lane
Oleg A. Anenkhonov
Victor V. Chepinoga
Bradley C. Autrey
author_sort Tedros M. Berhane
title The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems
title_short The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems
title_full The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems
title_fullStr The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems
title_full_unstemmed The Influence of Region of Interest Heterogeneity on Classification Accuracy in Wetland Systems
title_sort influence of region of interest heterogeneity on classification accuracy in wetland systems
publisher MDPI AG
series Remote Sensing
issn 2072-4292
publishDate 2019-03-01
description Classifying and mapping natural systems such as wetlands using remote sensing frequently relies on data derived from regions of interest (ROIs), often acquired during field campaigns. ROIs tend to be heterogeneous in complex systems with a variety of land cover classes. However, traditional supervised image classification is predicated on pure single-class observations to train a classifier. This ultimately encourages end-users to create single-class ROIs, nudging ROIs away from field-based points or gerrymandering the ROI, which may produce ROIs unrepresentative of the landscape and potentially insert error into the classification. In this study, we explored WorldView-2 images and 228 field-based data points to define ROIs of varying heterogeneity levels in terms of class membership to classify and map 22 discrete classes in a large and complex wetland system. The goal was to include rather than avoid ROI heterogeneity and assess its impact on classification accuracy. Parametric and nonparametric classifiers were tested with ROI heterogeneity that varied from 7% to 100%. Heterogeneity was governed by ROI area, which we increased from the field-sampling frame of ~100 m2 nearly 19-fold to ~2124 m2. In general, overall accuracy (OA) tended downwards with increasing heterogeneity but stayed relatively high until extreme heterogeneity levels were reached. Moreover, the differences in OA were not statistically significant across several small-to-large heterogeneity levels. Per-class user’s and producer’s accuracies behaved similarly. Our findings suggest that ROI heterogeneity did not harm classification accuracy unless heterogeneity became extreme, and thus there are substantial practical advantages to accommodating heterogeneous ROIs in image classification. Rather than attempting to avoid ROI heterogeneity by gerrymandering, classification in wetland environments, as well as analyses of other complex environments, should embrace ROI heterogeneity.
topic general linear model (GLM)
gerrymandering
Lake Baikal
methods
multinomial linear model (MLM)
mixed pixels
random forest (RF)
Selenga river delta
support vector machine (SVM)
Worldview-2
url http://www.mdpi.com/2072-4292/11/5/551
work_keys_str_mv AT tedrosmberhane theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
AT hugocosta theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
AT charlesrlane theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
AT olegaanenkhonov theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
AT victorvchepinoga theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
AT bradleycautrey theinfluenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
AT tedrosmberhane influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
AT hugocosta influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
AT charlesrlane influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
AT olegaanenkhonov influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
AT victorvchepinoga influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
AT bradleycautrey influenceofregionofinterestheterogeneityonclassificationaccuracyinwetlandsystems
_version_ 1725966174482595840