Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding

3D-HEVC (The 3D Extension of High Efficiency Video Coding), the latest international standard for 3D video coding, supports multiview plus depth 3D video format to enrich multimedia applications. For the texture coding, 3D-HEVC utilizes not only the information of temporal and spatial domains but al...

Full description

Bibliographic Details
Main Authors: Jie-Ru Lin, Mei-Juan Chen, Yi-Sheng Ciou, Chia-Hung Yeh, Min-Hui Lin, Lih-Jen Kau, Chuan-Yu Chang
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9469736/
id doaj-ddd92cb7706d48219f264a8e352230b3
record_format Article
spelling doaj-ddd92cb7706d48219f264a8e352230b32021-07-20T23:00:20ZengIEEEIEEE Access2169-35362021-01-01910008110009510.1109/ACCESS.2021.30939509469736Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video CodingJie-Ru Lin0https://orcid.org/0000-0002-0270-0620Mei-Juan Chen1https://orcid.org/0000-0003-3382-8296Yi-Sheng Ciou2Chia-Hung Yeh3https://orcid.org/0000-0003-1097-9411Min-Hui Lin4https://orcid.org/0000-0001-8357-5413Lih-Jen Kau5https://orcid.org/0000-0001-8115-3751Chuan-Yu Chang6https://orcid.org/0000-0001-9476-8130Department of Electrical Engineering, National Dong Hwa University, Hualien, TaiwanDepartment of Electrical Engineering, National Dong Hwa University, Hualien, TaiwanDepartment of Electrical Engineering, National Dong Hwa University, Hualien, TaiwanDepartment of Electrical Engineering, National Taiwan Normal University, Taipei, TaiwanDepartment of Electrical Engineering, National Sun Yat-sen University, Kaohsiung, TaiwanDepartment of Electronic Engineering, National Taipei University of Technology, Taipei, TaiwanDepartment of Computer Science and Information Engineering, National Yunlin University of Science and Technology, Yunlin, Taiwan3D-HEVC (The 3D Extension of High Efficiency Video Coding), the latest international standard for 3D video coding, supports multiview plus depth 3D video format to enrich multimedia applications. For the texture coding, 3D-HEVC utilizes not only the information of temporal and spatial domains but also that of inter-view domain. However, the time consumption and complexity of 3D-HEVC also increase significantly. In this paper, fast texture coding algorithm for 3D-HEVC is proposed. We individually calculate the Pearson correlation coefficients by the rate-distortion costs (RD-costs) of coding tree units (CTUs) in the temporal, spatial and inter-view domains to analyze the correlations for independent view and dependent view. The proposed coding algorithm is based on the coding information of CTUs with higher correlations. The fast algorithm predicts and dynamically adjusts the depth range of the coding unit (CU). The prediction unit (PU) mode decision is proposed according to the complexity and partition direction of the best PU modes obtained from the highly correlated CTUs. The search range is adaptively adjusted for motion estimation. In addition, the RD-cost threshold is estimated to early terminate the CU split. Experimental results show that the proposed fast texture coding algorithm reduces the texture coding time significantly and outperforms numerous previous works.https://ieeexplore.ieee.org/document/9469736/3D-HEVCtexture codingCU early terminationfast PU decisionsearch range adjustment
collection DOAJ
language English
format Article
sources DOAJ
author Jie-Ru Lin
Mei-Juan Chen
Yi-Sheng Ciou
Chia-Hung Yeh
Min-Hui Lin
Lih-Jen Kau
Chuan-Yu Chang
spellingShingle Jie-Ru Lin
Mei-Juan Chen
Yi-Sheng Ciou
Chia-Hung Yeh
Min-Hui Lin
Lih-Jen Kau
Chuan-Yu Chang
Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding
IEEE Access
3D-HEVC
texture coding
CU early termination
fast PU decision
search range adjustment
author_facet Jie-Ru Lin
Mei-Juan Chen
Yi-Sheng Ciou
Chia-Hung Yeh
Min-Hui Lin
Lih-Jen Kau
Chuan-Yu Chang
author_sort Jie-Ru Lin
title Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding
title_short Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding
title_full Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding
title_fullStr Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding
title_full_unstemmed Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding
title_sort fast texture coding based on spatial, temporal and inter-view correlations for 3d video coding
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description 3D-HEVC (The 3D Extension of High Efficiency Video Coding), the latest international standard for 3D video coding, supports multiview plus depth 3D video format to enrich multimedia applications. For the texture coding, 3D-HEVC utilizes not only the information of temporal and spatial domains but also that of inter-view domain. However, the time consumption and complexity of 3D-HEVC also increase significantly. In this paper, fast texture coding algorithm for 3D-HEVC is proposed. We individually calculate the Pearson correlation coefficients by the rate-distortion costs (RD-costs) of coding tree units (CTUs) in the temporal, spatial and inter-view domains to analyze the correlations for independent view and dependent view. The proposed coding algorithm is based on the coding information of CTUs with higher correlations. The fast algorithm predicts and dynamically adjusts the depth range of the coding unit (CU). The prediction unit (PU) mode decision is proposed according to the complexity and partition direction of the best PU modes obtained from the highly correlated CTUs. The search range is adaptively adjusted for motion estimation. In addition, the RD-cost threshold is estimated to early terminate the CU split. Experimental results show that the proposed fast texture coding algorithm reduces the texture coding time significantly and outperforms numerous previous works.
topic 3D-HEVC
texture coding
CU early termination
fast PU decision
search range adjustment
url https://ieeexplore.ieee.org/document/9469736/
work_keys_str_mv AT jierulin fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding
AT meijuanchen fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding
AT yishengciou fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding
AT chiahungyeh fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding
AT minhuilin fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding
AT lihjenkau fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding
AT chuanyuchang fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding
_version_ 1721293283028631552