Adaptive Block Compressive Sensing: Toward a Real-Time and Low-Complexity Implementation

Adaptive block-based compressive sensing (ABCS) algorithms are studied in the context of the practical realisation of compressive sensing on resource-constrained image and video sensing platforms that use single-pixel cameras, multi-pixel cameras or focal plane processing sensors. In this paper, we...

Full description

Bibliographic Details
Main Authors: Joseph Zammit, Ian J. Wassell
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9133085/
id doaj-b7802a714836409d86f23463ece3ef7d
record_format Article
spelling doaj-b7802a714836409d86f23463ece3ef7d2021-03-30T02:35:39ZengIEEEIEEE Access2169-35362020-01-01812099912101310.1109/ACCESS.2020.30068619133085Adaptive Block Compressive Sensing: Toward a Real-Time and Low-Complexity ImplementationJoseph Zammit0https://orcid.org/0000-0002-2339-2022Ian J. Wassell1Computer Laboratory, University of Cambridge, Cambridge, U.K.Computer Laboratory, University of Cambridge, Cambridge, U.K.Adaptive block-based compressive sensing (ABCS) algorithms are studied in the context of the practical realisation of compressive sensing on resource-constrained image and video sensing platforms that use single-pixel cameras, multi-pixel cameras or focal plane processing sensors. In this paper, we introduce two novel ABCS algorithms that are suitable for compressively sensing images or intra-coded video frames. Both use deterministic 2D-DCT dictionaries when sensing the images instead of random dictionaries. The first uses a low number of compressive measurements to compute the block boundary variation (BBV) around each image block, from which it estimates the number of 2D-DCT transform coefficients to measure from each block. The second uses a low number of DCT domain (DD) measurements to estimate the total number of transform coefficients to capture from each block. The two algorithms permit reconstruction in real time, averaging 8 ms and 26 ms for 256 × 256 and 512 × 512 greyscale images, respectively, using a simple inverse 2D-DCT operation without requiring GPU acceleration. Furthermore, we show that an iterative compressive sensing reconstruction algorithm (IDA), inspired by the denoising-based approximate message passing algorithm, can be used as a post-processing, quality enhancement technique. IDA trades off real-time operation to yield performance improvement over state-of-the-art GPU-assisted algorithms of 1.31 dB and 0.0152 in terms of PSNR and SSIM, respectively. It also exceeds the PSNR performance of a state-of-the-art deep neural network by 0.4 dB and SSIM by 0.0126.https://ieeexplore.ieee.org/document/9133085/Adaptive block compressive imagingadaptive block compressive sensingcompressed sensingdeterministic sensing matricesiterative reconstruction
collection DOAJ
language English
format Article
sources DOAJ
author Joseph Zammit
Ian J. Wassell
spellingShingle Joseph Zammit
Ian J. Wassell
Adaptive Block Compressive Sensing: Toward a Real-Time and Low-Complexity Implementation
IEEE Access
Adaptive block compressive imaging
adaptive block compressive sensing
compressed sensing
deterministic sensing matrices
iterative reconstruction
author_facet Joseph Zammit
Ian J. Wassell
author_sort Joseph Zammit
title Adaptive Block Compressive Sensing: Toward a Real-Time and Low-Complexity Implementation
title_short Adaptive Block Compressive Sensing: Toward a Real-Time and Low-Complexity Implementation
title_full Adaptive Block Compressive Sensing: Toward a Real-Time and Low-Complexity Implementation
title_fullStr Adaptive Block Compressive Sensing: Toward a Real-Time and Low-Complexity Implementation
title_full_unstemmed Adaptive Block Compressive Sensing: Toward a Real-Time and Low-Complexity Implementation
title_sort adaptive block compressive sensing: toward a real-time and low-complexity implementation
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Adaptive block-based compressive sensing (ABCS) algorithms are studied in the context of the practical realisation of compressive sensing on resource-constrained image and video sensing platforms that use single-pixel cameras, multi-pixel cameras or focal plane processing sensors. In this paper, we introduce two novel ABCS algorithms that are suitable for compressively sensing images or intra-coded video frames. Both use deterministic 2D-DCT dictionaries when sensing the images instead of random dictionaries. The first uses a low number of compressive measurements to compute the block boundary variation (BBV) around each image block, from which it estimates the number of 2D-DCT transform coefficients to measure from each block. The second uses a low number of DCT domain (DD) measurements to estimate the total number of transform coefficients to capture from each block. The two algorithms permit reconstruction in real time, averaging 8 ms and 26 ms for 256 × 256 and 512 × 512 greyscale images, respectively, using a simple inverse 2D-DCT operation without requiring GPU acceleration. Furthermore, we show that an iterative compressive sensing reconstruction algorithm (IDA), inspired by the denoising-based approximate message passing algorithm, can be used as a post-processing, quality enhancement technique. IDA trades off real-time operation to yield performance improvement over state-of-the-art GPU-assisted algorithms of 1.31 dB and 0.0152 in terms of PSNR and SSIM, respectively. It also exceeds the PSNR performance of a state-of-the-art deep neural network by 0.4 dB and SSIM by 0.0126.
topic Adaptive block compressive imaging
adaptive block compressive sensing
compressed sensing
deterministic sensing matrices
iterative reconstruction
url https://ieeexplore.ieee.org/document/9133085/
work_keys_str_mv AT josephzammit adaptiveblockcompressivesensingtowardarealtimeandlowcomplexityimplementation
AT ianjwassell adaptiveblockcompressivesensingtowardarealtimeandlowcomplexityimplementation
_version_ 1724184884172292096