Loughborough University
Browse
information sciences-2018.pdf (3.62 MB)

Blind assessment for stereo images considering binocular characteristics and deep perception map based on deep belief network

Download (3.62 MB)
journal contribution
posted on 2018-11-13, 11:11 authored by Jiachen Yang, Yang Zhao, Yinghao Zhu, Huifang Xu, Wen Lu, Qinggang MengQinggang Meng
© 2018 Elsevier Inc. In recent years, blind image quality assessment in the field of 2D image/video has gained the popularity, but its applications in 3D image/video are to be generalized. In this paper, we propose an effective blind metric evaluating stereo images via deep belief network (DBN). This method is based on wavelet transform with both 2D features from monocular images respectively as image content description and 3D features from a novel depth perception map (DPM) as depth perception description. In particular, the DPM is introduced to quantify longitudinal depth information to align with human stereo visual perception. More specifically, the 2D features are local histogram of oriented gradient (HoG) features from high frequency wavelet coefficients and global statistical features including magnitude, variance and entropy. Meanwhile, the global statistical features from the DPM are characterized as 3D features. Subsequently, considering binocular characteristics, an effective binocular weight model based on multiscale energy estimation of the left and right images is adopted to obtain the content quality. In the training and testing stages, three DBN models for the three types features separately are used to get the final score. Experimental results demonstrate that the proposed stereo image quality evaluation model has high superiority over existing methods and achieve higher consistency with subjective quality assessments.

History

School

  • Science

Department

  • Computer Science

Published in

Information Sciences

Volume

474

Pages

1 - 17

Citation

YANG, J. ... et al., 2019. Blind assessment for stereo images considering binocular characteristics and deep perception map based on deep belief network. Information Sciences, 474, pp. 1-17.

Publisher

© Elsevier

Version

  • AM (Accepted Manuscript)

Publisher statement

This paper was accepted for publication in the journal Information Sciences and the definitive published version is available at https://doi.org/10.1016/j.ins.2018.08.066.

Publication date

2019

ISSN

0020-0255

Language

  • en