Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding
3D-HEVC (The 3D Extension of High Efficiency Video Coding), the latest international standard for 3D video coding, supports multiview plus depth 3D video format to enrich multimedia applications. For the texture coding, 3D-HEVC utilizes not only the information of temporal and spatial domains but al...
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9469736/ |
id |
doaj-ddd92cb7706d48219f264a8e352230b3 |
---|---|
record_format |
Article |
spelling |
doaj-ddd92cb7706d48219f264a8e352230b32021-07-20T23:00:20ZengIEEEIEEE Access2169-35362021-01-01910008110009510.1109/ACCESS.2021.30939509469736Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video CodingJie-Ru Lin0https://orcid.org/0000-0002-0270-0620Mei-Juan Chen1https://orcid.org/0000-0003-3382-8296Yi-Sheng Ciou2Chia-Hung Yeh3https://orcid.org/0000-0003-1097-9411Min-Hui Lin4https://orcid.org/0000-0001-8357-5413Lih-Jen Kau5https://orcid.org/0000-0001-8115-3751Chuan-Yu Chang6https://orcid.org/0000-0001-9476-8130Department of Electrical Engineering, National Dong Hwa University, Hualien, TaiwanDepartment of Electrical Engineering, National Dong Hwa University, Hualien, TaiwanDepartment of Electrical Engineering, National Dong Hwa University, Hualien, TaiwanDepartment of Electrical Engineering, National Taiwan Normal University, Taipei, TaiwanDepartment of Electrical Engineering, National Sun Yat-sen University, Kaohsiung, TaiwanDepartment of Electronic Engineering, National Taipei University of Technology, Taipei, TaiwanDepartment of Computer Science and Information Engineering, National Yunlin University of Science and Technology, Yunlin, Taiwan3D-HEVC (The 3D Extension of High Efficiency Video Coding), the latest international standard for 3D video coding, supports multiview plus depth 3D video format to enrich multimedia applications. For the texture coding, 3D-HEVC utilizes not only the information of temporal and spatial domains but also that of inter-view domain. However, the time consumption and complexity of 3D-HEVC also increase significantly. In this paper, fast texture coding algorithm for 3D-HEVC is proposed. We individually calculate the Pearson correlation coefficients by the rate-distortion costs (RD-costs) of coding tree units (CTUs) in the temporal, spatial and inter-view domains to analyze the correlations for independent view and dependent view. The proposed coding algorithm is based on the coding information of CTUs with higher correlations. The fast algorithm predicts and dynamically adjusts the depth range of the coding unit (CU). The prediction unit (PU) mode decision is proposed according to the complexity and partition direction of the best PU modes obtained from the highly correlated CTUs. The search range is adaptively adjusted for motion estimation. In addition, the RD-cost threshold is estimated to early terminate the CU split. Experimental results show that the proposed fast texture coding algorithm reduces the texture coding time significantly and outperforms numerous previous works.https://ieeexplore.ieee.org/document/9469736/3D-HEVCtexture codingCU early terminationfast PU decisionsearch range adjustment |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Jie-Ru Lin Mei-Juan Chen Yi-Sheng Ciou Chia-Hung Yeh Min-Hui Lin Lih-Jen Kau Chuan-Yu Chang |
spellingShingle |
Jie-Ru Lin Mei-Juan Chen Yi-Sheng Ciou Chia-Hung Yeh Min-Hui Lin Lih-Jen Kau Chuan-Yu Chang Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding IEEE Access 3D-HEVC texture coding CU early termination fast PU decision search range adjustment |
author_facet |
Jie-Ru Lin Mei-Juan Chen Yi-Sheng Ciou Chia-Hung Yeh Min-Hui Lin Lih-Jen Kau Chuan-Yu Chang |
author_sort |
Jie-Ru Lin |
title |
Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding |
title_short |
Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding |
title_full |
Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding |
title_fullStr |
Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding |
title_full_unstemmed |
Fast Texture Coding Based on Spatial, Temporal and Inter-View Correlations for 3D Video Coding |
title_sort |
fast texture coding based on spatial, temporal and inter-view correlations for 3d video coding |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2021-01-01 |
description |
3D-HEVC (The 3D Extension of High Efficiency Video Coding), the latest international standard for 3D video coding, supports multiview plus depth 3D video format to enrich multimedia applications. For the texture coding, 3D-HEVC utilizes not only the information of temporal and spatial domains but also that of inter-view domain. However, the time consumption and complexity of 3D-HEVC also increase significantly. In this paper, fast texture coding algorithm for 3D-HEVC is proposed. We individually calculate the Pearson correlation coefficients by the rate-distortion costs (RD-costs) of coding tree units (CTUs) in the temporal, spatial and inter-view domains to analyze the correlations for independent view and dependent view. The proposed coding algorithm is based on the coding information of CTUs with higher correlations. The fast algorithm predicts and dynamically adjusts the depth range of the coding unit (CU). The prediction unit (PU) mode decision is proposed according to the complexity and partition direction of the best PU modes obtained from the highly correlated CTUs. The search range is adaptively adjusted for motion estimation. In addition, the RD-cost threshold is estimated to early terminate the CU split. Experimental results show that the proposed fast texture coding algorithm reduces the texture coding time significantly and outperforms numerous previous works. |
topic |
3D-HEVC texture coding CU early termination fast PU decision search range adjustment |
url |
https://ieeexplore.ieee.org/document/9469736/ |
work_keys_str_mv |
AT jierulin fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding AT meijuanchen fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding AT yishengciou fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding AT chiahungyeh fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding AT minhuilin fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding AT lihjenkau fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding AT chuanyuchang fasttexturecodingbasedonspatialtemporalandinterviewcorrelationsfor3dvideocoding |
_version_ |
1721293283028631552 |