A Class Imbalance Loss for Imbalanced Object Recognition

The class imbalance problem exists widely in vision data. In these imbalanced datasets, the majority classes dominate the loss and influence the gradient. Hence, these datasets have a significantly negative impact on the performance of many state-of-the-art methods. In this article, we propose a cla...

Full description

Bibliographic Details
Main Authors: Linbin Zhang, Caiguang Zhang, Sinong Quan, Huaxin Xiao, Gangyao Kuang, Li Liu
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9103243/
id doaj-e80280ff1098445087732755026014e7
record_format Article
spelling doaj-e80280ff1098445087732755026014e72021-06-03T23:02:51ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352020-01-01132778279210.1109/JSTARS.2020.29957039103243A Class Imbalance Loss for Imbalanced Object RecognitionLinbin Zhang0Caiguang Zhang1https://orcid.org/0000-0002-0321-9900Sinong Quan2https://orcid.org/0000-0002-6908-1975Huaxin Xiao3https://orcid.org/0000-0003-4524-2698Gangyao Kuang4Li Liu5https://orcid.org/0000-0002-2011-2873State Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information System, National University of Defense Technology, Changsha, ChinaState Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information System, National University of Defense Technology, Changsha, ChinaState Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information System, National University of Defense Technology, Changsha, ChinaCollege of System Engineering, National University of Defense Technology, Changsha, ChinaState Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information System, National University of Defense Technology, Changsha, ChinaCollege of System Engineering, National University of Defense Technology, Changsha, ChinaThe class imbalance problem exists widely in vision data. In these imbalanced datasets, the majority classes dominate the loss and influence the gradient. Hence, these datasets have a significantly negative impact on the performance of many state-of-the-art methods. In this article, we propose a class imbalance loss (CI loss) to handle this problem. To distinguish imbalanced datasets in accordance with the extent of imbalance, we also define an imbalance degree that works as a decision index factor in the CI loss. Because the minority classes with fewer samples probably lose chances in descending the gradient in the training process, CI loss is introduced to make these minority classes descend further than the majority classes. In view of the imbalanced distribution of data in few-shot learning, a method for generating an imbalanced few-shot learning dataset is presented in this article. We conducted a large number of experiments in the MiniImageNet dataset, which showed the effectiveness of an algorithm for model-agnostic metalearning for rapid adaptation with CI loss. In the problem of detecting 15 ship categories, our loss function is transplanted to a rotational region convolutional neural network detection method and a cascade network architecture and achieves higher mean average precision than focal loss and cross-entropy loss. In addition, the Mixed National Institute of Standards and Technology dataset and the Moving and Stationary Target Acquisition and Recognition dataset are sampled to imbalance datasets to verify the effectiveness of CI loss.https://ieeexplore.ieee.org/document/9103243/Convolutional neural networks (CNNs)few-shot learningimage classificationimbalanced learningloss functionsobject detection
collection DOAJ
language English
format Article
sources DOAJ
author Linbin Zhang
Caiguang Zhang
Sinong Quan
Huaxin Xiao
Gangyao Kuang
Li Liu
spellingShingle Linbin Zhang
Caiguang Zhang
Sinong Quan
Huaxin Xiao
Gangyao Kuang
Li Liu
A Class Imbalance Loss for Imbalanced Object Recognition
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Convolutional neural networks (CNNs)
few-shot learning
image classification
imbalanced learning
loss functions
object detection
author_facet Linbin Zhang
Caiguang Zhang
Sinong Quan
Huaxin Xiao
Gangyao Kuang
Li Liu
author_sort Linbin Zhang
title A Class Imbalance Loss for Imbalanced Object Recognition
title_short A Class Imbalance Loss for Imbalanced Object Recognition
title_full A Class Imbalance Loss for Imbalanced Object Recognition
title_fullStr A Class Imbalance Loss for Imbalanced Object Recognition
title_full_unstemmed A Class Imbalance Loss for Imbalanced Object Recognition
title_sort class imbalance loss for imbalanced object recognition
publisher IEEE
series IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
issn 2151-1535
publishDate 2020-01-01
description The class imbalance problem exists widely in vision data. In these imbalanced datasets, the majority classes dominate the loss and influence the gradient. Hence, these datasets have a significantly negative impact on the performance of many state-of-the-art methods. In this article, we propose a class imbalance loss (CI loss) to handle this problem. To distinguish imbalanced datasets in accordance with the extent of imbalance, we also define an imbalance degree that works as a decision index factor in the CI loss. Because the minority classes with fewer samples probably lose chances in descending the gradient in the training process, CI loss is introduced to make these minority classes descend further than the majority classes. In view of the imbalanced distribution of data in few-shot learning, a method for generating an imbalanced few-shot learning dataset is presented in this article. We conducted a large number of experiments in the MiniImageNet dataset, which showed the effectiveness of an algorithm for model-agnostic metalearning for rapid adaptation with CI loss. In the problem of detecting 15 ship categories, our loss function is transplanted to a rotational region convolutional neural network detection method and a cascade network architecture and achieves higher mean average precision than focal loss and cross-entropy loss. In addition, the Mixed National Institute of Standards and Technology dataset and the Moving and Stationary Target Acquisition and Recognition dataset are sampled to imbalance datasets to verify the effectiveness of CI loss.
topic Convolutional neural networks (CNNs)
few-shot learning
image classification
imbalanced learning
loss functions
object detection
url https://ieeexplore.ieee.org/document/9103243/
work_keys_str_mv AT linbinzhang aclassimbalancelossforimbalancedobjectrecognition
AT caiguangzhang aclassimbalancelossforimbalancedobjectrecognition
AT sinongquan aclassimbalancelossforimbalancedobjectrecognition
AT huaxinxiao aclassimbalancelossforimbalancedobjectrecognition
AT gangyaokuang aclassimbalancelossforimbalancedobjectrecognition
AT liliu aclassimbalancelossforimbalancedobjectrecognition
AT linbinzhang classimbalancelossforimbalancedobjectrecognition
AT caiguangzhang classimbalancelossforimbalancedobjectrecognition
AT sinongquan classimbalancelossforimbalancedobjectrecognition
AT huaxinxiao classimbalancelossforimbalancedobjectrecognition
AT gangyaokuang classimbalancelossforimbalancedobjectrecognition
AT liliu classimbalancelossforimbalancedobjectrecognition
_version_ 1721398843642216448