An Efficient Data Augmentation Network for Out-of-Distribution Image Detection

Since deep neural networks may classify out-of-distribution image data into in-distribution classes with high confidence scores, this problem may cause serious or even fatal hazards in certain applications, such as autonomous vehicles and medical diagnosis. Therefore, out-of-distribution detection (...

Full description

Bibliographic Details
Main Authors: Cheng-Hung Lin, Cheng-Shian Lin, Po-Yung Chou, Chen-Chien Hsu
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9363111/
id doaj-6227593067044b319a088cb3c3fb1677
record_format Article
spelling doaj-6227593067044b319a088cb3c3fb16772021-04-05T17:39:07ZengIEEEIEEE Access2169-35362021-01-019353133532310.1109/ACCESS.2021.30621879363111An Efficient Data Augmentation Network for Out-of-Distribution Image DetectionCheng-Hung Lin0https://orcid.org/0000-0003-0044-3840Cheng-Shian Lin1https://orcid.org/0000-0003-0287-8610Po-Yung Chou2Chen-Chien Hsu3Department of Electrical Engineering, National Taiwan Normal University, Taipei, TaiwanDepartment of Electrical Engineering, National Taiwan Normal University, Taipei, TaiwanDepartment of Electrical Engineering, National Taiwan Normal University, Taipei, TaiwanDepartment of Electrical Engineering, National Taiwan Normal University, Taipei, TaiwanSince deep neural networks may classify out-of-distribution image data into in-distribution classes with high confidence scores, this problem may cause serious or even fatal hazards in certain applications, such as autonomous vehicles and medical diagnosis. Therefore, out-of-distribution detection (also called anomaly detection or outlier detection) of image classification has become a critical issue for the successful development of neural networks. In other words, a successful neural network needs to be able to distinguish anomalous data that is significantly different from the data used in training. In this paper, we propose an efficient data augmentation network to detect out-of-distribution image data by introducing a set of common geometric operations into training and testing images. The output predicted probabilities of the augmented data are combined by an aggregation function to provide a confidence score to distinguish between in-distribution and out-of-distribution image data. Different from other approaches that use out-of-distribution image data for training networks, we only use in-distribution image data in the proposed data augmentation network. This advantage makes our approach more practical than other approaches, and can be easily applied to various neural networks to improve security in practical applications. The experimental results show that the proposed data augmentation network outperforms the state-of-the-art approaches in various datasets. In addition, pre-training techniques can be integrated into the data augmentation network to make substantial improvements to large and complex data sets. The code is available at <uri>https://www.github.com/majic0626/Data-Augmentation-Network.git</uri>.https://ieeexplore.ieee.org/document/9363111/Out-of-distribution detectionimage classificationanomaly detectionoutlier detectiondata augmentationdeep neural networks
collection DOAJ
language English
format Article
sources DOAJ
author Cheng-Hung Lin
Cheng-Shian Lin
Po-Yung Chou
Chen-Chien Hsu
spellingShingle Cheng-Hung Lin
Cheng-Shian Lin
Po-Yung Chou
Chen-Chien Hsu
An Efficient Data Augmentation Network for Out-of-Distribution Image Detection
IEEE Access
Out-of-distribution detection
image classification
anomaly detection
outlier detection
data augmentation
deep neural networks
author_facet Cheng-Hung Lin
Cheng-Shian Lin
Po-Yung Chou
Chen-Chien Hsu
author_sort Cheng-Hung Lin
title An Efficient Data Augmentation Network for Out-of-Distribution Image Detection
title_short An Efficient Data Augmentation Network for Out-of-Distribution Image Detection
title_full An Efficient Data Augmentation Network for Out-of-Distribution Image Detection
title_fullStr An Efficient Data Augmentation Network for Out-of-Distribution Image Detection
title_full_unstemmed An Efficient Data Augmentation Network for Out-of-Distribution Image Detection
title_sort efficient data augmentation network for out-of-distribution image detection
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description Since deep neural networks may classify out-of-distribution image data into in-distribution classes with high confidence scores, this problem may cause serious or even fatal hazards in certain applications, such as autonomous vehicles and medical diagnosis. Therefore, out-of-distribution detection (also called anomaly detection or outlier detection) of image classification has become a critical issue for the successful development of neural networks. In other words, a successful neural network needs to be able to distinguish anomalous data that is significantly different from the data used in training. In this paper, we propose an efficient data augmentation network to detect out-of-distribution image data by introducing a set of common geometric operations into training and testing images. The output predicted probabilities of the augmented data are combined by an aggregation function to provide a confidence score to distinguish between in-distribution and out-of-distribution image data. Different from other approaches that use out-of-distribution image data for training networks, we only use in-distribution image data in the proposed data augmentation network. This advantage makes our approach more practical than other approaches, and can be easily applied to various neural networks to improve security in practical applications. The experimental results show that the proposed data augmentation network outperforms the state-of-the-art approaches in various datasets. In addition, pre-training techniques can be integrated into the data augmentation network to make substantial improvements to large and complex data sets. The code is available at <uri>https://www.github.com/majic0626/Data-Augmentation-Network.git</uri>.
topic Out-of-distribution detection
image classification
anomaly detection
outlier detection
data augmentation
deep neural networks
url https://ieeexplore.ieee.org/document/9363111/
work_keys_str_mv AT chenghunglin anefficientdataaugmentationnetworkforoutofdistributionimagedetection
AT chengshianlin anefficientdataaugmentationnetworkforoutofdistributionimagedetection
AT poyungchou anefficientdataaugmentationnetworkforoutofdistributionimagedetection
AT chenchienhsu anefficientdataaugmentationnetworkforoutofdistributionimagedetection
AT chenghunglin efficientdataaugmentationnetworkforoutofdistributionimagedetection
AT chengshianlin efficientdataaugmentationnetworkforoutofdistributionimagedetection
AT poyungchou efficientdataaugmentationnetworkforoutofdistributionimagedetection
AT chenchienhsu efficientdataaugmentationnetworkforoutofdistributionimagedetection
_version_ 1721539165961584640