Feature-Level Fusion of Polarized SAR and Optical Images Based on Random Forest and Conditional Random Fields

• Main Authors: Yingying Kong, Biyuan Yan, Yanjuan Liu, Henry Leung, Xiangyang Peng
• Format: Article
• Language: English
• Published: MDPI AG 2021-03-01
• Series: Remote Sensing
• Subjects: polarized SAR; optical image; random forest; conditional random fields; feature-level fusion
• Online Access: https://www.mdpi.com/2072-4292/13/7/1323

In terms of land cover classification, optical images have been proven to have good classification performance. Synthetic Aperture Radar (SAR) has the characteristics of working all-time and all-weather. It has more significant advantages over optical images for the recognition of some scenes, such as water bodies. One of the current challenges is how to fuse the benefits of both to obtain more powerful classification capabilities. This study proposes a classification model based on random forest with the conditional random fields (CRF) for feature-level fusion classification using features extracted from polarized SAR and optical images. In this paper, feature importance is introduced as a weight in the pairwise potential function of the CRF to improve the correction rate of misclassified points. The results show that the dataset combining the two provides significant improvements in feature identification when compared to the dataset using optical or polarized SAR image features alone. Among the four classification models used, the random forest-importance_ conditional random fields (RF-Im_CRF) model developed in this paper obtained the best overall accuracy (OA) and Kappa coefficient, validating the effectiveness of the method.