Blind Quality Evaluation for Screen Content Images Based on Regionalized Structural Features

• Main Authors: Wu Dong, Hongxia Bie, Likun Lu, Yeli Li
• Format: Article
• Language: English
• Published: MDPI AG 2020-10-01
• Series: Algorithms
• Subjects: screen content image; blind quality evaluation; regionalized structural features; improved histogram of oriented gradient; local derivative pattern; shearlet local binary pattern
• Online Access: https://www.mdpi.com/1999-4893/13/10/257

Currently, screen content images (SCIs) are widely used in our modern society. However, since SCIs have distinctly different properties compared to natural images, traditional quality assessment methods of natural images cannot precisely evaluate the quality of SCIs. Thus, we propose a blind quality evaluation method for SCIs based on regionalized structural features that are closely relevant to the intrinsic quality of SCIs. Firstly, the features of textual and pictorial regions of SCIs are extracted separately. For textual regions, since they contain noticeable structural information, we propose improved histograms of oriented gradients extracted from multi-order derivatives as structural features. For pictorial regions, since human vision is sensitive to texture information and luminance variation, we adopt texture as the structural feature; meanwhile, luminance is used as the auxiliary feature. The local derivative pattern and the shearlet local binary pattern are used to extract texture in the spatial and shearlet domains, respectively. Secondly, to derive the quality of textual and pictorial regions, two mapping functions are respectively trained from their features to subjective values. Finally, an activity weighting strategy is proposed to combine the quality of textual and pictorial regions. Experimental results show that the proposed method achieves better performance than the state-of-the-art methods.