Nuclear norm penalized LAD estimator for low rank matrix recovery
Thesis: Ph. D., Massachusetts Institute of Technology, Department of Mathematics, 2015. === Cataloged from PDF version of thesis. === Includes bibliographical references (pages 45-47). === In the thesis we propose a novel method for low rank matrix recovery. We study the framework using absolute dev...
Main Author: | |
---|---|
Other Authors: | |
Format: | Others |
Language: | English |
Published: |
Massachusetts Institute of Technology
2015
|
Subjects: | |
Online Access: | http://hdl.handle.net/1721.1/99320 |
id |
ndltd-MIT-oai-dspace.mit.edu-1721.1-99320 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-MIT-oai-dspace.mit.edu-1721.1-993202019-05-02T15:55:55Z Nuclear norm penalized LAD estimator for low rank matrix recovery Nuclear norm penalized least absolute deviations estimator for low rank matrix recovery Wei, Wenzhe Lie Wang. Massachusetts Institute of Technology. Department of Mathematics. Massachusetts Institute of Technology. Department of Mathematics. Mathematics. Thesis: Ph. D., Massachusetts Institute of Technology, Department of Mathematics, 2015. Cataloged from PDF version of thesis. Includes bibliographical references (pages 45-47). In the thesis we propose a novel method for low rank matrix recovery. We study the framework using absolute deviation loss function and nuclear penalty. While nuclear norm penalty is widely utilized heuristic method for shrinkage to low rank solution, the absolute deviation loss function is rarely studied. We establish an near oracle optimal recovery bound and gave a proof using E-net covering argument under certain restricted isometry and restricted eigenvalue assumptions. The estimator is able to recover the underlying matrix with high probability with limited observations that the number of observation is more than the degree of freedom but less than a power of dimension. Our estimator has two advantages. First the theoretical tuning parameter does not depends on the knowledge of the noise level, and the bound can be derived even when noises have fatter tails than normal distribution. The second advantage is that absolute deviation loss function is robust compared with the popular square loss function. by Wenzhe Wei. Ph. D. 2015-10-14T15:05:29Z 2015-10-14T15:05:29Z 2015 2015 Thesis http://hdl.handle.net/1721.1/99320 923216230 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 47 pages application/pdf Massachusetts Institute of Technology |
collection |
NDLTD |
language |
English |
format |
Others
|
sources |
NDLTD |
topic |
Mathematics. |
spellingShingle |
Mathematics. Wei, Wenzhe Nuclear norm penalized LAD estimator for low rank matrix recovery |
description |
Thesis: Ph. D., Massachusetts Institute of Technology, Department of Mathematics, 2015. === Cataloged from PDF version of thesis. === Includes bibliographical references (pages 45-47). === In the thesis we propose a novel method for low rank matrix recovery. We study the framework using absolute deviation loss function and nuclear penalty. While nuclear norm penalty is widely utilized heuristic method for shrinkage to low rank solution, the absolute deviation loss function is rarely studied. We establish an near oracle optimal recovery bound and gave a proof using E-net covering argument under certain restricted isometry and restricted eigenvalue assumptions. The estimator is able to recover the underlying matrix with high probability with limited observations that the number of observation is more than the degree of freedom but less than a power of dimension. Our estimator has two advantages. First the theoretical tuning parameter does not depends on the knowledge of the noise level, and the bound can be derived even when noises have fatter tails than normal distribution. The second advantage is that absolute deviation loss function is robust compared with the popular square loss function. === by Wenzhe Wei. === Ph. D. |
author2 |
Lie Wang. |
author_facet |
Lie Wang. Wei, Wenzhe |
author |
Wei, Wenzhe |
author_sort |
Wei, Wenzhe |
title |
Nuclear norm penalized LAD estimator for low rank matrix recovery |
title_short |
Nuclear norm penalized LAD estimator for low rank matrix recovery |
title_full |
Nuclear norm penalized LAD estimator for low rank matrix recovery |
title_fullStr |
Nuclear norm penalized LAD estimator for low rank matrix recovery |
title_full_unstemmed |
Nuclear norm penalized LAD estimator for low rank matrix recovery |
title_sort |
nuclear norm penalized lad estimator for low rank matrix recovery |
publisher |
Massachusetts Institute of Technology |
publishDate |
2015 |
url |
http://hdl.handle.net/1721.1/99320 |
work_keys_str_mv |
AT weiwenzhe nuclearnormpenalizedladestimatorforlowrankmatrixrecovery AT weiwenzhe nuclearnormpenalizedleastabsolutedeviationsestimatorforlowrankmatrixrecovery |
_version_ |
1719031587203448832 |