View selection strategy for photo-consistency refinement

• Main Authors: ZHU Yan, YAN Qingsong, QU Yingjie, CHEN Xin, DENG Fei
• Format: Article
• Language: zho
• Published: Surveying and Mapping Press 2020-11-01
• Series: Acta Geodaetica et Cartographica Sinica
• Subjects: view selection; photo-consistency; variational refinement; 3d reconstruction
• Online Access: http://xb.sinomaps.com/article/2020/1001-1595/2020-11-1463.htm

In 3D reconstruction, mesh refinement is generally applied to deal with noise and lack of details in triangular mesh built from dense point cloud. The existing variational refinement methods optimize the photo-consistency of the initial mesh by utilizing all the image data, but ignore the redundancy of image information and the impact of view quality on mesh refinement to some extent. In this regard, this paper proposes the strategies of master view selection and slave view selection, so as to improve the efficiency and quality of mesh refinement. Firstly, Markov random field is constructed by combining image gradient magnitude and contour detection to select master view for each triangular facet, and then slave view is selected according to the corresponding observation condition for each master view. Afterwards, we calculate the norm-weighted photo-consistency between master view and slave view, and finally surface energy function is minimized by using gradient decent method to obtain the refined mesh. The experiments show that the proposed method can recover more fine-scale details, meanwhile shorten time and increase accuracy of refinement, which confirms the validity of the proposed method qualitatively and quantitatively.