Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery

Compressive sensing is a desirable technique to acquire and reconstruct signals at sub-Nyquist rates. Recently, several deep learning-based studies on solving the compressive sensing problem have been carried out, which dramatically reduce the intensive computational complexity of the traditional gr...

Full description

Bibliographic Details
Main Authors: Cong Zou, Fang Yang
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8663363/
id doaj-7eb7a8bf675a46849f2b1b0a47dd7467
record_format Article
spelling doaj-7eb7a8bf675a46849f2b1b0a47dd74672021-03-29T22:58:20ZengIEEEIEEE Access2169-35362019-01-017347533476110.1109/ACCESS.2019.29039068663363Deep Learning Approach Based on Tensor-Train for Sparse Signal RecoveryCong Zou0Fang Yang1https://orcid.org/0000-0003-3575-5086Department of Electronic Engineering, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, ChinaDepartment of Electronic Engineering, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, ChinaCompressive sensing is a desirable technique to acquire and reconstruct signals at sub-Nyquist rates. Recently, several deep learning-based studies on solving the compressive sensing problem have been carried out, which dramatically reduce the intensive computational complexity of the traditional greedy or convex recovery algorithms and even improve the signal recovery performance. However, as the signal size increases, most of these methods recover signals block by block due to the large computational complexity and memory consumption, which usually imposes block effect on the recovered signals. To deal with this issue, in this paper, we apply a tensor decomposition method named Tensor-Train (TT) on the neural network, by which the number of parameters is reduced by a tremendous factor and the computational complexity is further decreased so that the large signals can be recovered as a whole. In particular, the TT-decomposition is jointly applied on a stacked denoising autoencoder (SDA) network called TT-SDA in this paper. The experiments indicate that the proposed TT-SDA network can preserve the reconstruction performance of the conventional SDA network and outperform the traditional methods, especially with low measurement rates. Meanwhile, it can also significantly reduce the computational complexity and occupied memory space, which becomes a time and memory efficient method in compressive sensing problem.https://ieeexplore.ieee.org/document/8663363/Compressive sensingdeep learningTensor-Trainstacked denoising autoencoder
collection DOAJ
language English
format Article
sources DOAJ
author Cong Zou
Fang Yang
spellingShingle Cong Zou
Fang Yang
Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery
IEEE Access
Compressive sensing
deep learning
Tensor-Train
stacked denoising autoencoder
author_facet Cong Zou
Fang Yang
author_sort Cong Zou
title Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery
title_short Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery
title_full Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery
title_fullStr Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery
title_full_unstemmed Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery
title_sort deep learning approach based on tensor-train for sparse signal recovery
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2019-01-01
description Compressive sensing is a desirable technique to acquire and reconstruct signals at sub-Nyquist rates. Recently, several deep learning-based studies on solving the compressive sensing problem have been carried out, which dramatically reduce the intensive computational complexity of the traditional greedy or convex recovery algorithms and even improve the signal recovery performance. However, as the signal size increases, most of these methods recover signals block by block due to the large computational complexity and memory consumption, which usually imposes block effect on the recovered signals. To deal with this issue, in this paper, we apply a tensor decomposition method named Tensor-Train (TT) on the neural network, by which the number of parameters is reduced by a tremendous factor and the computational complexity is further decreased so that the large signals can be recovered as a whole. In particular, the TT-decomposition is jointly applied on a stacked denoising autoencoder (SDA) network called TT-SDA in this paper. The experiments indicate that the proposed TT-SDA network can preserve the reconstruction performance of the conventional SDA network and outperform the traditional methods, especially with low measurement rates. Meanwhile, it can also significantly reduce the computational complexity and occupied memory space, which becomes a time and memory efficient method in compressive sensing problem.
topic Compressive sensing
deep learning
Tensor-Train
stacked denoising autoencoder
url https://ieeexplore.ieee.org/document/8663363/
work_keys_str_mv AT congzou deeplearningapproachbasedontensortrainforsparsesignalrecovery
AT fangyang deeplearningapproachbasedontensortrainforsparsesignalrecovery
_version_ 1724190442013065216