Endogenous Sparse Recovery

Sparsity has proven to be an essential ingredient in the development of efficient solutions to a number of problems in signal processing and machine learning. In all of these settings, sparse recovery methods are employed to recover signals that admit sparse representations in a pre-specified basis....

Full description

Bibliographic Details
Other Authors: Baraniuk, Richard G.
Format: Others
Language:English
Published: 2013
Subjects:
Online Access:http://hdl.handle.net/1911/70235
id ndltd-RICE-oai-scholarship.rice.edu-1911-70235
record_format oai_dc
spelling ndltd-RICE-oai-scholarship.rice.edu-1911-702352013-05-01T03:47:16ZEndogenous Sparse RecoveryApplied sciencesApplied MathematicsElectrical engineeringSparsity has proven to be an essential ingredient in the development of efficient solutions to a number of problems in signal processing and machine learning. In all of these settings, sparse recovery methods are employed to recover signals that admit sparse representations in a pre-specified basis. Recently, sparse recovery methods have been employed in an entirely new way; instead of finding a sparse representation of a signal in a fixed basis, a sparse representation is formed "from within" the data. In this thesis, we study the utility of this endogenous sparse recovery procedure for learning unions of subspaces from collections of high-dimensional data. We provide new insights into the behavior of endogenous sparse recovery, develop sufficient conditions that describe when greedy methods will reveal local estimates of the subspaces in the ensemble, and introduce new methods to learn unions of overlapping subspaces from local subspace estimates.Baraniuk, Richard G.2013-03-08T00:33:32Z2013-03-08T00:33:32Z2012ThesisText82 p.application/pdfhttp://hdl.handle.net/1911/70235DyerEeng
collection NDLTD
language English
format Others
sources NDLTD
topic Applied sciences
Applied Mathematics
Electrical engineering
spellingShingle Applied sciences
Applied Mathematics
Electrical engineering
Endogenous Sparse Recovery
description Sparsity has proven to be an essential ingredient in the development of efficient solutions to a number of problems in signal processing and machine learning. In all of these settings, sparse recovery methods are employed to recover signals that admit sparse representations in a pre-specified basis. Recently, sparse recovery methods have been employed in an entirely new way; instead of finding a sparse representation of a signal in a fixed basis, a sparse representation is formed "from within" the data. In this thesis, we study the utility of this endogenous sparse recovery procedure for learning unions of subspaces from collections of high-dimensional data. We provide new insights into the behavior of endogenous sparse recovery, develop sufficient conditions that describe when greedy methods will reveal local estimates of the subspaces in the ensemble, and introduce new methods to learn unions of overlapping subspaces from local subspace estimates.
author2 Baraniuk, Richard G.
author_facet Baraniuk, Richard G.
title Endogenous Sparse Recovery
title_short Endogenous Sparse Recovery
title_full Endogenous Sparse Recovery
title_fullStr Endogenous Sparse Recovery
title_full_unstemmed Endogenous Sparse Recovery
title_sort endogenous sparse recovery
publishDate 2013
url http://hdl.handle.net/1911/70235
_version_ 1716585231750791168