Deep Active Learning Explored Across Diverse Label Spaces
abstract: Deep learning architectures have been widely explored in computer vision and have depicted commendable performance in a variety of applications. A fundamental challenge in training deep networks is the requirement of large amounts of labeled training data. While gathering large quantiti...
Other Authors: | |
---|---|
Format: | Doctoral Thesis |
Language: | English |
Published: |
2018
|
Subjects: | |
Online Access: | http://hdl.handle.net/2286/R.I.49076 |
id |
ndltd-asu.edu-item-49076 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-asu.edu-item-490762018-06-22T03:09:18Z Deep Active Learning Explored Across Diverse Label Spaces abstract: Deep learning architectures have been widely explored in computer vision and have depicted commendable performance in a variety of applications. A fundamental challenge in training deep networks is the requirement of large amounts of labeled training data. While gathering large quantities of unlabeled data is cheap and easy, annotating the data is an expensive process in terms of time, labor and human expertise. Thus, developing algorithms that minimize the human effort in training deep models is of immense practical importance. Active learning algorithms automatically identify salient and exemplar samples from large amounts of unlabeled data and can augment maximal information to supervised learning models, thereby reducing the human annotation effort in training machine learning models. The goal of this dissertation is to fuse ideas from deep learning and active learning and design novel deep active learning algorithms. The proposed learning methodologies explore diverse label spaces to solve different computer vision applications. Three major contributions have emerged from this work; (i) a deep active framework for multi-class image classication, (ii) a deep active model with and without label correlation for multi-label image classi- cation and (iii) a deep active paradigm for regression. Extensive empirical studies on a variety of multi-class, multi-label and regression vision datasets corroborate the potential of the proposed methods for real-world applications. Additional contributions include: (i) a multimodal emotion database consisting of recordings of facial expressions, body gestures, vocal expressions and physiological signals of actors enacting various emotions, (ii) four multimodal deep belief network models and (iii) an in-depth analysis of the effect of transfer of multimodal emotion features between source and target networks on classification accuracy and training time. These related contributions help comprehend the challenges involved in training deep learning models and motivate the main goal of this dissertation. Dissertation/Thesis Ranganathan, Hiranmayi (Author) Sethuraman, Panchanathan (Advisor) Papandreou-Suppappola, Antonia (Committee member) Li, Baoxin (Committee member) Chakraborty, Shayok (Committee member) Arizona State University (Publisher) Electrical engineering Computer science Active Learning Deep Learning Multiclass Multilabel Multimodal Regression eng 247 pages Doctoral Dissertation Electrical Engineering 2018 Doctoral Dissertation http://hdl.handle.net/2286/R.I.49076 http://rightsstatements.org/vocab/InC/1.0/ All Rights Reserved 2018 |
collection |
NDLTD |
language |
English |
format |
Doctoral Thesis |
sources |
NDLTD |
topic |
Electrical engineering Computer science Active Learning Deep Learning Multiclass Multilabel Multimodal Regression |
spellingShingle |
Electrical engineering Computer science Active Learning Deep Learning Multiclass Multilabel Multimodal Regression Deep Active Learning Explored Across Diverse Label Spaces |
description |
abstract: Deep learning architectures have been widely explored in computer vision and have
depicted commendable performance in a variety of applications. A fundamental challenge
in training deep networks is the requirement of large amounts of labeled training
data. While gathering large quantities of unlabeled data is cheap and easy, annotating
the data is an expensive process in terms of time, labor and human expertise.
Thus, developing algorithms that minimize the human effort in training deep models
is of immense practical importance. Active learning algorithms automatically identify
salient and exemplar samples from large amounts of unlabeled data and can augment
maximal information to supervised learning models, thereby reducing the human annotation
effort in training machine learning models. The goal of this dissertation is to
fuse ideas from deep learning and active learning and design novel deep active learning
algorithms. The proposed learning methodologies explore diverse label spaces to
solve different computer vision applications. Three major contributions have emerged
from this work; (i) a deep active framework for multi-class image classication, (ii)
a deep active model with and without label correlation for multi-label image classi-
cation and (iii) a deep active paradigm for regression. Extensive empirical studies
on a variety of multi-class, multi-label and regression vision datasets corroborate the
potential of the proposed methods for real-world applications. Additional contributions
include: (i) a multimodal emotion database consisting of recordings of facial
expressions, body gestures, vocal expressions and physiological signals of actors enacting
various emotions, (ii) four multimodal deep belief network models and (iii)
an in-depth analysis of the effect of transfer of multimodal emotion features between
source and target networks on classification accuracy and training time. These related
contributions help comprehend the challenges involved in training deep learning
models and motivate the main goal of this dissertation. === Dissertation/Thesis === Doctoral Dissertation Electrical Engineering 2018 |
author2 |
Ranganathan, Hiranmayi (Author) |
author_facet |
Ranganathan, Hiranmayi (Author) |
title |
Deep Active Learning Explored Across Diverse Label Spaces |
title_short |
Deep Active Learning Explored Across Diverse Label Spaces |
title_full |
Deep Active Learning Explored Across Diverse Label Spaces |
title_fullStr |
Deep Active Learning Explored Across Diverse Label Spaces |
title_full_unstemmed |
Deep Active Learning Explored Across Diverse Label Spaces |
title_sort |
deep active learning explored across diverse label spaces |
publishDate |
2018 |
url |
http://hdl.handle.net/2286/R.I.49076 |
_version_ |
1718701719692509184 |