Nuclear norm penalized LAD estimator for low rank matrix recovery

Thesis: Ph. D., Massachusetts Institute of Technology, Department of Mathematics, 2015. === Cataloged from PDF version of thesis. === Includes bibliographical references (pages 45-47). === In the thesis we propose a novel method for low rank matrix recovery. We study the framework using absolute dev...

Full description

Bibliographic Details
Main Author: Wei, Wenzhe
Other Authors: Lie Wang.
Format: Others
Language:English
Published: Massachusetts Institute of Technology 2015
Subjects:
Online Access:http://hdl.handle.net/1721.1/99320
id ndltd-MIT-oai-dspace.mit.edu-1721.1-99320
record_format oai_dc
spelling ndltd-MIT-oai-dspace.mit.edu-1721.1-993202019-05-02T15:55:55Z Nuclear norm penalized LAD estimator for low rank matrix recovery Nuclear norm penalized least absolute deviations estimator for low rank matrix recovery Wei, Wenzhe Lie Wang. Massachusetts Institute of Technology. Department of Mathematics. Massachusetts Institute of Technology. Department of Mathematics. Mathematics. Thesis: Ph. D., Massachusetts Institute of Technology, Department of Mathematics, 2015. Cataloged from PDF version of thesis. Includes bibliographical references (pages 45-47). In the thesis we propose a novel method for low rank matrix recovery. We study the framework using absolute deviation loss function and nuclear penalty. While nuclear norm penalty is widely utilized heuristic method for shrinkage to low rank solution, the absolute deviation loss function is rarely studied. We establish an near oracle optimal recovery bound and gave a proof using E-net covering argument under certain restricted isometry and restricted eigenvalue assumptions. The estimator is able to recover the underlying matrix with high probability with limited observations that the number of observation is more than the degree of freedom but less than a power of dimension. Our estimator has two advantages. First the theoretical tuning parameter does not depends on the knowledge of the noise level, and the bound can be derived even when noises have fatter tails than normal distribution. The second advantage is that absolute deviation loss function is robust compared with the popular square loss function. by Wenzhe Wei. Ph. D. 2015-10-14T15:05:29Z 2015-10-14T15:05:29Z 2015 2015 Thesis http://hdl.handle.net/1721.1/99320 923216230 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 47 pages application/pdf Massachusetts Institute of Technology
collection NDLTD
language English
format Others
sources NDLTD
topic Mathematics.
spellingShingle Mathematics.
Wei, Wenzhe
Nuclear norm penalized LAD estimator for low rank matrix recovery
description Thesis: Ph. D., Massachusetts Institute of Technology, Department of Mathematics, 2015. === Cataloged from PDF version of thesis. === Includes bibliographical references (pages 45-47). === In the thesis we propose a novel method for low rank matrix recovery. We study the framework using absolute deviation loss function and nuclear penalty. While nuclear norm penalty is widely utilized heuristic method for shrinkage to low rank solution, the absolute deviation loss function is rarely studied. We establish an near oracle optimal recovery bound and gave a proof using E-net covering argument under certain restricted isometry and restricted eigenvalue assumptions. The estimator is able to recover the underlying matrix with high probability with limited observations that the number of observation is more than the degree of freedom but less than a power of dimension. Our estimator has two advantages. First the theoretical tuning parameter does not depends on the knowledge of the noise level, and the bound can be derived even when noises have fatter tails than normal distribution. The second advantage is that absolute deviation loss function is robust compared with the popular square loss function. === by Wenzhe Wei. === Ph. D.
author2 Lie Wang.
author_facet Lie Wang.
Wei, Wenzhe
author Wei, Wenzhe
author_sort Wei, Wenzhe
title Nuclear norm penalized LAD estimator for low rank matrix recovery
title_short Nuclear norm penalized LAD estimator for low rank matrix recovery
title_full Nuclear norm penalized LAD estimator for low rank matrix recovery
title_fullStr Nuclear norm penalized LAD estimator for low rank matrix recovery
title_full_unstemmed Nuclear norm penalized LAD estimator for low rank matrix recovery
title_sort nuclear norm penalized lad estimator for low rank matrix recovery
publisher Massachusetts Institute of Technology
publishDate 2015
url http://hdl.handle.net/1721.1/99320
work_keys_str_mv AT weiwenzhe nuclearnormpenalizedladestimatorforlowrankmatrixrecovery
AT weiwenzhe nuclearnormpenalizedleastabsolutedeviationsestimatorforlowrankmatrixrecovery
_version_ 1719031587203448832