An Efficient Data Augmentation Network for Out-of-Distribution Image Detection
Since deep neural networks may classify out-of-distribution image data into in-distribution classes with high confidence scores, this problem may cause serious or even fatal hazards in certain applications, such as autonomous vehicles and medical diagnosis. Therefore, out-of-distribution detection (...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9363111/ |
id |
doaj-6227593067044b319a088cb3c3fb1677 |
---|---|
record_format |
Article |
spelling |
doaj-6227593067044b319a088cb3c3fb16772021-04-05T17:39:07ZengIEEEIEEE Access2169-35362021-01-019353133532310.1109/ACCESS.2021.30621879363111An Efficient Data Augmentation Network for Out-of-Distribution Image DetectionCheng-Hung Lin0https://orcid.org/0000-0003-0044-3840Cheng-Shian Lin1https://orcid.org/0000-0003-0287-8610Po-Yung Chou2Chen-Chien Hsu3Department of Electrical Engineering, National Taiwan Normal University, Taipei, TaiwanDepartment of Electrical Engineering, National Taiwan Normal University, Taipei, TaiwanDepartment of Electrical Engineering, National Taiwan Normal University, Taipei, TaiwanDepartment of Electrical Engineering, National Taiwan Normal University, Taipei, TaiwanSince deep neural networks may classify out-of-distribution image data into in-distribution classes with high confidence scores, this problem may cause serious or even fatal hazards in certain applications, such as autonomous vehicles and medical diagnosis. Therefore, out-of-distribution detection (also called anomaly detection or outlier detection) of image classification has become a critical issue for the successful development of neural networks. In other words, a successful neural network needs to be able to distinguish anomalous data that is significantly different from the data used in training. In this paper, we propose an efficient data augmentation network to detect out-of-distribution image data by introducing a set of common geometric operations into training and testing images. The output predicted probabilities of the augmented data are combined by an aggregation function to provide a confidence score to distinguish between in-distribution and out-of-distribution image data. Different from other approaches that use out-of-distribution image data for training networks, we only use in-distribution image data in the proposed data augmentation network. This advantage makes our approach more practical than other approaches, and can be easily applied to various neural networks to improve security in practical applications. The experimental results show that the proposed data augmentation network outperforms the state-of-the-art approaches in various datasets. In addition, pre-training techniques can be integrated into the data augmentation network to make substantial improvements to large and complex data sets. The code is available at <uri>https://www.github.com/majic0626/Data-Augmentation-Network.git</uri>.https://ieeexplore.ieee.org/document/9363111/Out-of-distribution detectionimage classificationanomaly detectionoutlier detectiondata augmentationdeep neural networks |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Cheng-Hung Lin Cheng-Shian Lin Po-Yung Chou Chen-Chien Hsu |
spellingShingle |
Cheng-Hung Lin Cheng-Shian Lin Po-Yung Chou Chen-Chien Hsu An Efficient Data Augmentation Network for Out-of-Distribution Image Detection IEEE Access Out-of-distribution detection image classification anomaly detection outlier detection data augmentation deep neural networks |
author_facet |
Cheng-Hung Lin Cheng-Shian Lin Po-Yung Chou Chen-Chien Hsu |
author_sort |
Cheng-Hung Lin |
title |
An Efficient Data Augmentation Network for Out-of-Distribution Image Detection |
title_short |
An Efficient Data Augmentation Network for Out-of-Distribution Image Detection |
title_full |
An Efficient Data Augmentation Network for Out-of-Distribution Image Detection |
title_fullStr |
An Efficient Data Augmentation Network for Out-of-Distribution Image Detection |
title_full_unstemmed |
An Efficient Data Augmentation Network for Out-of-Distribution Image Detection |
title_sort |
efficient data augmentation network for out-of-distribution image detection |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2021-01-01 |
description |
Since deep neural networks may classify out-of-distribution image data into in-distribution classes with high confidence scores, this problem may cause serious or even fatal hazards in certain applications, such as autonomous vehicles and medical diagnosis. Therefore, out-of-distribution detection (also called anomaly detection or outlier detection) of image classification has become a critical issue for the successful development of neural networks. In other words, a successful neural network needs to be able to distinguish anomalous data that is significantly different from the data used in training. In this paper, we propose an efficient data augmentation network to detect out-of-distribution image data by introducing a set of common geometric operations into training and testing images. The output predicted probabilities of the augmented data are combined by an aggregation function to provide a confidence score to distinguish between in-distribution and out-of-distribution image data. Different from other approaches that use out-of-distribution image data for training networks, we only use in-distribution image data in the proposed data augmentation network. This advantage makes our approach more practical than other approaches, and can be easily applied to various neural networks to improve security in practical applications. The experimental results show that the proposed data augmentation network outperforms the state-of-the-art approaches in various datasets. In addition, pre-training techniques can be integrated into the data augmentation network to make substantial improvements to large and complex data sets. The code is available at <uri>https://www.github.com/majic0626/Data-Augmentation-Network.git</uri>. |
topic |
Out-of-distribution detection image classification anomaly detection outlier detection data augmentation deep neural networks |
url |
https://ieeexplore.ieee.org/document/9363111/ |
work_keys_str_mv |
AT chenghunglin anefficientdataaugmentationnetworkforoutofdistributionimagedetection AT chengshianlin anefficientdataaugmentationnetworkforoutofdistributionimagedetection AT poyungchou anefficientdataaugmentationnetworkforoutofdistributionimagedetection AT chenchienhsu anefficientdataaugmentationnetworkforoutofdistributionimagedetection AT chenghunglin efficientdataaugmentationnetworkforoutofdistributionimagedetection AT chengshianlin efficientdataaugmentationnetworkforoutofdistributionimagedetection AT poyungchou efficientdataaugmentationnetworkforoutofdistributionimagedetection AT chenchienhsu efficientdataaugmentationnetworkforoutofdistributionimagedetection |
_version_ |
1721539165961584640 |