Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery
Compressive sensing is a desirable technique to acquire and reconstruct signals at sub-Nyquist rates. Recently, several deep learning-based studies on solving the compressive sensing problem have been carried out, which dramatically reduce the intensive computational complexity of the traditional gr...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2019-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/8663363/ |
id |
doaj-7eb7a8bf675a46849f2b1b0a47dd7467 |
---|---|
record_format |
Article |
spelling |
doaj-7eb7a8bf675a46849f2b1b0a47dd74672021-03-29T22:58:20ZengIEEEIEEE Access2169-35362019-01-017347533476110.1109/ACCESS.2019.29039068663363Deep Learning Approach Based on Tensor-Train for Sparse Signal RecoveryCong Zou0Fang Yang1https://orcid.org/0000-0003-3575-5086Department of Electronic Engineering, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, ChinaDepartment of Electronic Engineering, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, ChinaCompressive sensing is a desirable technique to acquire and reconstruct signals at sub-Nyquist rates. Recently, several deep learning-based studies on solving the compressive sensing problem have been carried out, which dramatically reduce the intensive computational complexity of the traditional greedy or convex recovery algorithms and even improve the signal recovery performance. However, as the signal size increases, most of these methods recover signals block by block due to the large computational complexity and memory consumption, which usually imposes block effect on the recovered signals. To deal with this issue, in this paper, we apply a tensor decomposition method named Tensor-Train (TT) on the neural network, by which the number of parameters is reduced by a tremendous factor and the computational complexity is further decreased so that the large signals can be recovered as a whole. In particular, the TT-decomposition is jointly applied on a stacked denoising autoencoder (SDA) network called TT-SDA in this paper. The experiments indicate that the proposed TT-SDA network can preserve the reconstruction performance of the conventional SDA network and outperform the traditional methods, especially with low measurement rates. Meanwhile, it can also significantly reduce the computational complexity and occupied memory space, which becomes a time and memory efficient method in compressive sensing problem.https://ieeexplore.ieee.org/document/8663363/Compressive sensingdeep learningTensor-Trainstacked denoising autoencoder |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Cong Zou Fang Yang |
spellingShingle |
Cong Zou Fang Yang Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery IEEE Access Compressive sensing deep learning Tensor-Train stacked denoising autoencoder |
author_facet |
Cong Zou Fang Yang |
author_sort |
Cong Zou |
title |
Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery |
title_short |
Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery |
title_full |
Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery |
title_fullStr |
Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery |
title_full_unstemmed |
Deep Learning Approach Based on Tensor-Train for Sparse Signal Recovery |
title_sort |
deep learning approach based on tensor-train for sparse signal recovery |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2019-01-01 |
description |
Compressive sensing is a desirable technique to acquire and reconstruct signals at sub-Nyquist rates. Recently, several deep learning-based studies on solving the compressive sensing problem have been carried out, which dramatically reduce the intensive computational complexity of the traditional greedy or convex recovery algorithms and even improve the signal recovery performance. However, as the signal size increases, most of these methods recover signals block by block due to the large computational complexity and memory consumption, which usually imposes block effect on the recovered signals. To deal with this issue, in this paper, we apply a tensor decomposition method named Tensor-Train (TT) on the neural network, by which the number of parameters is reduced by a tremendous factor and the computational complexity is further decreased so that the large signals can be recovered as a whole. In particular, the TT-decomposition is jointly applied on a stacked denoising autoencoder (SDA) network called TT-SDA in this paper. The experiments indicate that the proposed TT-SDA network can preserve the reconstruction performance of the conventional SDA network and outperform the traditional methods, especially with low measurement rates. Meanwhile, it can also significantly reduce the computational complexity and occupied memory space, which becomes a time and memory efficient method in compressive sensing problem. |
topic |
Compressive sensing deep learning Tensor-Train stacked denoising autoencoder |
url |
https://ieeexplore.ieee.org/document/8663363/ |
work_keys_str_mv |
AT congzou deeplearningapproachbasedontensortrainforsparsesignalrecovery AT fangyang deeplearningapproachbasedontensortrainforsparsesignalrecovery |
_version_ |
1724190442013065216 |