Deep Active Learning Explored Across Diverse Label Spaces

abstract: Deep learning architectures have been widely explored in computer vision and have depicted commendable performance in a variety of applications. A fundamental challenge in training deep networks is the requirement of large amounts of labeled training data. While gathering large quantiti...

Full description

Bibliographic Details
Other Authors: Ranganathan, Hiranmayi (Author)
Format: Doctoral Thesis
Language:English
Published: 2018
Subjects:
Online Access:http://hdl.handle.net/2286/R.I.49076
id ndltd-asu.edu-item-49076
record_format oai_dc
spelling ndltd-asu.edu-item-490762018-06-22T03:09:18Z Deep Active Learning Explored Across Diverse Label Spaces abstract: Deep learning architectures have been widely explored in computer vision and have depicted commendable performance in a variety of applications. A fundamental challenge in training deep networks is the requirement of large amounts of labeled training data. While gathering large quantities of unlabeled data is cheap and easy, annotating the data is an expensive process in terms of time, labor and human expertise. Thus, developing algorithms that minimize the human effort in training deep models is of immense practical importance. Active learning algorithms automatically identify salient and exemplar samples from large amounts of unlabeled data and can augment maximal information to supervised learning models, thereby reducing the human annotation effort in training machine learning models. The goal of this dissertation is to fuse ideas from deep learning and active learning and design novel deep active learning algorithms. The proposed learning methodologies explore diverse label spaces to solve different computer vision applications. Three major contributions have emerged from this work; (i) a deep active framework for multi-class image classication, (ii) a deep active model with and without label correlation for multi-label image classi- cation and (iii) a deep active paradigm for regression. Extensive empirical studies on a variety of multi-class, multi-label and regression vision datasets corroborate the potential of the proposed methods for real-world applications. Additional contributions include: (i) a multimodal emotion database consisting of recordings of facial expressions, body gestures, vocal expressions and physiological signals of actors enacting various emotions, (ii) four multimodal deep belief network models and (iii) an in-depth analysis of the effect of transfer of multimodal emotion features between source and target networks on classification accuracy and training time. These related contributions help comprehend the challenges involved in training deep learning models and motivate the main goal of this dissertation. Dissertation/Thesis Ranganathan, Hiranmayi (Author) Sethuraman, Panchanathan (Advisor) Papandreou-Suppappola, Antonia (Committee member) Li, Baoxin (Committee member) Chakraborty, Shayok (Committee member) Arizona State University (Publisher) Electrical engineering Computer science Active Learning Deep Learning Multiclass Multilabel Multimodal Regression eng 247 pages Doctoral Dissertation Electrical Engineering 2018 Doctoral Dissertation http://hdl.handle.net/2286/R.I.49076 http://rightsstatements.org/vocab/InC/1.0/ All Rights Reserved 2018
collection NDLTD
language English
format Doctoral Thesis
sources NDLTD
topic Electrical engineering
Computer science
Active Learning
Deep Learning
Multiclass
Multilabel
Multimodal
Regression
spellingShingle Electrical engineering
Computer science
Active Learning
Deep Learning
Multiclass
Multilabel
Multimodal
Regression
Deep Active Learning Explored Across Diverse Label Spaces
description abstract: Deep learning architectures have been widely explored in computer vision and have depicted commendable performance in a variety of applications. A fundamental challenge in training deep networks is the requirement of large amounts of labeled training data. While gathering large quantities of unlabeled data is cheap and easy, annotating the data is an expensive process in terms of time, labor and human expertise. Thus, developing algorithms that minimize the human effort in training deep models is of immense practical importance. Active learning algorithms automatically identify salient and exemplar samples from large amounts of unlabeled data and can augment maximal information to supervised learning models, thereby reducing the human annotation effort in training machine learning models. The goal of this dissertation is to fuse ideas from deep learning and active learning and design novel deep active learning algorithms. The proposed learning methodologies explore diverse label spaces to solve different computer vision applications. Three major contributions have emerged from this work; (i) a deep active framework for multi-class image classication, (ii) a deep active model with and without label correlation for multi-label image classi- cation and (iii) a deep active paradigm for regression. Extensive empirical studies on a variety of multi-class, multi-label and regression vision datasets corroborate the potential of the proposed methods for real-world applications. Additional contributions include: (i) a multimodal emotion database consisting of recordings of facial expressions, body gestures, vocal expressions and physiological signals of actors enacting various emotions, (ii) four multimodal deep belief network models and (iii) an in-depth analysis of the effect of transfer of multimodal emotion features between source and target networks on classification accuracy and training time. These related contributions help comprehend the challenges involved in training deep learning models and motivate the main goal of this dissertation. === Dissertation/Thesis === Doctoral Dissertation Electrical Engineering 2018
author2 Ranganathan, Hiranmayi (Author)
author_facet Ranganathan, Hiranmayi (Author)
title Deep Active Learning Explored Across Diverse Label Spaces
title_short Deep Active Learning Explored Across Diverse Label Spaces
title_full Deep Active Learning Explored Across Diverse Label Spaces
title_fullStr Deep Active Learning Explored Across Diverse Label Spaces
title_full_unstemmed Deep Active Learning Explored Across Diverse Label Spaces
title_sort deep active learning explored across diverse label spaces
publishDate 2018
url http://hdl.handle.net/2286/R.I.49076
_version_ 1718701719692509184