Parallel K Nearest Neighbor Matching for 3D Reconstruction

In recent years, a 3D reconstruction based on structure from motion (SFM) has attracted much attention from the communities of computer vision and graphics. It is well known that the speed and quality of SFM systems largely depend on the technique of feature tracking. If a big volume of image data i...

Full description

Bibliographic Details
Main Authors: Ming-Wei Cao, Lin Li, Wen-Jun Xie, Wei Jia, Zhi-Han Lv, Li-Ping Zheng, Xiao-Ping Liu
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8703749/
id doaj-6767aac3ffa64737a37a3439ff9290a8
record_format Article
spelling doaj-6767aac3ffa64737a37a3439ff9290a82021-03-29T22:36:41ZengIEEEIEEE Access2169-35362019-01-017552485526010.1109/ACCESS.2019.29126478703749Parallel K Nearest Neighbor Matching for 3D ReconstructionMing-Wei Cao0Lin Li1Wen-Jun Xie2https://orcid.org/0000-0002-4032-8049Wei Jia3https://orcid.org/0000-0001-5628-6237Zhi-Han Lv4https://orcid.org/0000-0003-2525-3074Li-Ping Zheng5Xiao-Ping Liu6School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, ChinaSchool of Computer Science and Information Engineering, Hefei University of Technology, Hefei, ChinaSchool of Computer Science and Information Engineering, Hefei University of Technology, Hefei, ChinaSchool of Computer Science and Information Engineering, Hefei University of Technology, Hefei, ChinaSchool of Data Science and Software Engineering, Qingdao University, Qingdao, ChinaSchool of Computer Science and Information Engineering, Hefei University of Technology, Hefei, ChinaSchool of Computer Science and Information Engineering, Hefei University of Technology, Hefei, ChinaIn recent years, a 3D reconstruction based on structure from motion (SFM) has attracted much attention from the communities of computer vision and graphics. It is well known that the speed and quality of SFM systems largely depend on the technique of feature tracking. If a big volume of image data is inputted for SFM, the speed of this SFM system would become very slow. And, this problem becomes severer for large-scale scenes, which typically needs to capture several thousands of images to recover the point-cloud model of the scene. However, none of the existing methods fully addresses the problem of fast feature tracking. Brute force matching is capable of producing correspondences for small-scale scenes but often getting stuck in repeated features. Hashing matching can only deal with middle-scale scenes and is not capable of large-scale scenes. In this paper, we propose a new feature tacking method working in a parallel manner rather than in a single thread scheme. Our method consists of steps of keypoint detection, descriptor computing, descriptor matching by parallel k -nearest neighbor (Parallel-KNN) search, and outlier rejecting. This method is able to rapidly match a big volume of keypoints and avoids to consume high computation time, then yielding a set of correct correspondences. We demonstrate and evaluate the proposed method on several challenging benchmark datasets, including those with highly repeated features, and compare to the state-of-the-art methods. The experimental results indicate that our method outperforms the compared methods in both efficiency and effectiveness.https://ieeexplore.ieee.org/document/8703749/3D reconstructionK nearest neighborfeature matchingstructure from motionparallel computing
collection DOAJ
language English
format Article
sources DOAJ
author Ming-Wei Cao
Lin Li
Wen-Jun Xie
Wei Jia
Zhi-Han Lv
Li-Ping Zheng
Xiao-Ping Liu
spellingShingle Ming-Wei Cao
Lin Li
Wen-Jun Xie
Wei Jia
Zhi-Han Lv
Li-Ping Zheng
Xiao-Ping Liu
Parallel K Nearest Neighbor Matching for 3D Reconstruction
IEEE Access
3D reconstruction
K nearest neighbor
feature matching
structure from motion
parallel computing
author_facet Ming-Wei Cao
Lin Li
Wen-Jun Xie
Wei Jia
Zhi-Han Lv
Li-Ping Zheng
Xiao-Ping Liu
author_sort Ming-Wei Cao
title Parallel K Nearest Neighbor Matching for 3D Reconstruction
title_short Parallel K Nearest Neighbor Matching for 3D Reconstruction
title_full Parallel K Nearest Neighbor Matching for 3D Reconstruction
title_fullStr Parallel K Nearest Neighbor Matching for 3D Reconstruction
title_full_unstemmed Parallel K Nearest Neighbor Matching for 3D Reconstruction
title_sort parallel k nearest neighbor matching for 3d reconstruction
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2019-01-01
description In recent years, a 3D reconstruction based on structure from motion (SFM) has attracted much attention from the communities of computer vision and graphics. It is well known that the speed and quality of SFM systems largely depend on the technique of feature tracking. If a big volume of image data is inputted for SFM, the speed of this SFM system would become very slow. And, this problem becomes severer for large-scale scenes, which typically needs to capture several thousands of images to recover the point-cloud model of the scene. However, none of the existing methods fully addresses the problem of fast feature tracking. Brute force matching is capable of producing correspondences for small-scale scenes but often getting stuck in repeated features. Hashing matching can only deal with middle-scale scenes and is not capable of large-scale scenes. In this paper, we propose a new feature tacking method working in a parallel manner rather than in a single thread scheme. Our method consists of steps of keypoint detection, descriptor computing, descriptor matching by parallel k -nearest neighbor (Parallel-KNN) search, and outlier rejecting. This method is able to rapidly match a big volume of keypoints and avoids to consume high computation time, then yielding a set of correct correspondences. We demonstrate and evaluate the proposed method on several challenging benchmark datasets, including those with highly repeated features, and compare to the state-of-the-art methods. The experimental results indicate that our method outperforms the compared methods in both efficiency and effectiveness.
topic 3D reconstruction
K nearest neighbor
feature matching
structure from motion
parallel computing
url https://ieeexplore.ieee.org/document/8703749/
work_keys_str_mv AT mingweicao parallelknearestneighbormatchingfor3dreconstruction
AT linli parallelknearestneighbormatchingfor3dreconstruction
AT wenjunxie parallelknearestneighbormatchingfor3dreconstruction
AT weijia parallelknearestneighbormatchingfor3dreconstruction
AT zhihanlv parallelknearestneighbormatchingfor3dreconstruction
AT lipingzheng parallelknearestneighbormatchingfor3dreconstruction
AT xiaopingliu parallelknearestneighbormatchingfor3dreconstruction
_version_ 1724191269029150720