An Improved Estimation Algorithm of Space Targets Pose Based on Multi-Modal Feature Fusion

• Main Authors: Jiang Hua, Tonglin Hao, Liangcai Zeng, Gui Yu
• Format: Article
• Language: English
• Published: MDPI AG 2021-08-01
• Series: Mathematics
• Subjects: space targets pose; deep neural networks; feature fusion; fast pose estimation; strong stability
• Online Access: https://www.mdpi.com/2227-7390/9/17/2085

The traditional estimation methods of space targets pose are based on artificial features to match the transformation relationship between the image and the object model. With the explosion of deep learning technology, the approach based on deep neural networks (DNN) has significantly improved the performance of pose estimation. However, the current methods still have problems such as complex calculation, low accuracy, and poor real-time performance. Therefore, a new pose estimation algorithm is proposed in this paper. Firstly, the mask image of the target is obtained by the instance segmentation algorithm, and its point cloud image is obtained based on a depth map combined with camera parameters. Finally, the correlation among points is established to realize the prediction of pose based on multi-modal feature fusion. Experimental results in the YCB-Video dataset show that the proposed algorithm can recognize complex images at a speed of about 24 images per second with an accuracy of more than 80%. In conclusion, the proposed algorithm can realize fast pose estimation for complex stacked objects and has strong stability for different objects.