A Class Imbalance Loss for Imbalanced Object Recognition
The class imbalance problem exists widely in vision data. In these imbalanced datasets, the majority classes dominate the loss and influence the gradient. Hence, these datasets have a significantly negative impact on the performance of many state-of-the-art methods. In this article, we propose a cla...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9103243/ |
id |
doaj-e80280ff1098445087732755026014e7 |
---|---|
record_format |
Article |
spelling |
doaj-e80280ff1098445087732755026014e72021-06-03T23:02:51ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352020-01-01132778279210.1109/JSTARS.2020.29957039103243A Class Imbalance Loss for Imbalanced Object RecognitionLinbin Zhang0Caiguang Zhang1https://orcid.org/0000-0002-0321-9900Sinong Quan2https://orcid.org/0000-0002-6908-1975Huaxin Xiao3https://orcid.org/0000-0003-4524-2698Gangyao Kuang4Li Liu5https://orcid.org/0000-0002-2011-2873State Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information System, National University of Defense Technology, Changsha, ChinaState Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information System, National University of Defense Technology, Changsha, ChinaState Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information System, National University of Defense Technology, Changsha, ChinaCollege of System Engineering, National University of Defense Technology, Changsha, ChinaState Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information System, National University of Defense Technology, Changsha, ChinaCollege of System Engineering, National University of Defense Technology, Changsha, ChinaThe class imbalance problem exists widely in vision data. In these imbalanced datasets, the majority classes dominate the loss and influence the gradient. Hence, these datasets have a significantly negative impact on the performance of many state-of-the-art methods. In this article, we propose a class imbalance loss (CI loss) to handle this problem. To distinguish imbalanced datasets in accordance with the extent of imbalance, we also define an imbalance degree that works as a decision index factor in the CI loss. Because the minority classes with fewer samples probably lose chances in descending the gradient in the training process, CI loss is introduced to make these minority classes descend further than the majority classes. In view of the imbalanced distribution of data in few-shot learning, a method for generating an imbalanced few-shot learning dataset is presented in this article. We conducted a large number of experiments in the MiniImageNet dataset, which showed the effectiveness of an algorithm for model-agnostic metalearning for rapid adaptation with CI loss. In the problem of detecting 15 ship categories, our loss function is transplanted to a rotational region convolutional neural network detection method and a cascade network architecture and achieves higher mean average precision than focal loss and cross-entropy loss. In addition, the Mixed National Institute of Standards and Technology dataset and the Moving and Stationary Target Acquisition and Recognition dataset are sampled to imbalance datasets to verify the effectiveness of CI loss.https://ieeexplore.ieee.org/document/9103243/Convolutional neural networks (CNNs)few-shot learningimage classificationimbalanced learningloss functionsobject detection |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Linbin Zhang Caiguang Zhang Sinong Quan Huaxin Xiao Gangyao Kuang Li Liu |
spellingShingle |
Linbin Zhang Caiguang Zhang Sinong Quan Huaxin Xiao Gangyao Kuang Li Liu A Class Imbalance Loss for Imbalanced Object Recognition IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Convolutional neural networks (CNNs) few-shot learning image classification imbalanced learning loss functions object detection |
author_facet |
Linbin Zhang Caiguang Zhang Sinong Quan Huaxin Xiao Gangyao Kuang Li Liu |
author_sort |
Linbin Zhang |
title |
A Class Imbalance Loss for Imbalanced Object Recognition |
title_short |
A Class Imbalance Loss for Imbalanced Object Recognition |
title_full |
A Class Imbalance Loss for Imbalanced Object Recognition |
title_fullStr |
A Class Imbalance Loss for Imbalanced Object Recognition |
title_full_unstemmed |
A Class Imbalance Loss for Imbalanced Object Recognition |
title_sort |
class imbalance loss for imbalanced object recognition |
publisher |
IEEE |
series |
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
issn |
2151-1535 |
publishDate |
2020-01-01 |
description |
The class imbalance problem exists widely in vision data. In these imbalanced datasets, the majority classes dominate the loss and influence the gradient. Hence, these datasets have a significantly negative impact on the performance of many state-of-the-art methods. In this article, we propose a class imbalance loss (CI loss) to handle this problem. To distinguish imbalanced datasets in accordance with the extent of imbalance, we also define an imbalance degree that works as a decision index factor in the CI loss. Because the minority classes with fewer samples probably lose chances in descending the gradient in the training process, CI loss is introduced to make these minority classes descend further than the majority classes. In view of the imbalanced distribution of data in few-shot learning, a method for generating an imbalanced few-shot learning dataset is presented in this article. We conducted a large number of experiments in the MiniImageNet dataset, which showed the effectiveness of an algorithm for model-agnostic metalearning for rapid adaptation with CI loss. In the problem of detecting 15 ship categories, our loss function is transplanted to a rotational region convolutional neural network detection method and a cascade network architecture and achieves higher mean average precision than focal loss and cross-entropy loss. In addition, the Mixed National Institute of Standards and Technology dataset and the Moving and Stationary Target Acquisition and Recognition dataset are sampled to imbalance datasets to verify the effectiveness of CI loss. |
topic |
Convolutional neural networks (CNNs) few-shot learning image classification imbalanced learning loss functions object detection |
url |
https://ieeexplore.ieee.org/document/9103243/ |
work_keys_str_mv |
AT linbinzhang aclassimbalancelossforimbalancedobjectrecognition AT caiguangzhang aclassimbalancelossforimbalancedobjectrecognition AT sinongquan aclassimbalancelossforimbalancedobjectrecognition AT huaxinxiao aclassimbalancelossforimbalancedobjectrecognition AT gangyaokuang aclassimbalancelossforimbalancedobjectrecognition AT liliu aclassimbalancelossforimbalancedobjectrecognition AT linbinzhang classimbalancelossforimbalancedobjectrecognition AT caiguangzhang classimbalancelossforimbalancedobjectrecognition AT sinongquan classimbalancelossforimbalancedobjectrecognition AT huaxinxiao classimbalancelossforimbalancedobjectrecognition AT gangyaokuang classimbalancelossforimbalancedobjectrecognition AT liliu classimbalancelossforimbalancedobjectrecognition |
_version_ |
1721398843642216448 |