WatchPose: A View-Aware Approach for Camera Pose Data Collection in Industrial Environments

Collecting correlated scene images and camera poses is an essential step towards learning absolute camera pose regression models. While the acquisition of such data in living environments is relatively easy by following regular roads and paths, it is still a challenging task in constricted industria...

Full description

Bibliographic Details
Main Authors: Cong Yang, Gilles Simon, John See, Marie-Odile Berger, Wenyong Wang
Format: Article
Language:English
Published: MDPI AG 2020-05-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/11/3045
id doaj-41d47f4ca5d14de2b10387df5f3a95dc
record_format Article
spelling doaj-41d47f4ca5d14de2b10387df5f3a95dc2020-11-25T03:07:28ZengMDPI AGSensors1424-82202020-05-01203045304510.3390/s20113045WatchPose: A View-Aware Approach for Camera Pose Data Collection in Industrial EnvironmentsCong Yang0Gilles Simon1John See2Marie-Odile Berger3Wenyong Wang4MAGRIT Team, INRIA/LORIA, 54600 Nancy, FranceMAGRIT Team, INRIA/LORIA, 54600 Nancy, FranceFaculty of Computing and Informatics, Multimedia University, 63100 Cyberjaya, Selangor, MalaysiaMAGRIT Team, INRIA/LORIA, 54600 Nancy, FranceSchool of Information Science and Technology, Northeast Normal University, 130000 Changchun, Jilin, ChinaCollecting correlated scene images and camera poses is an essential step towards learning absolute camera pose regression models. While the acquisition of such data in living environments is relatively easy by following regular roads and paths, it is still a challenging task in constricted industrial environments. This is because industrial objects have varied sizes and inspections are usually carried out with non-constant motions. As a result, regression models are more sensitive to scene images with respect to viewpoints and distances. Motivated by this, we present a simple but efficient camera pose data collection method, WatchPose, to improve the generalization and robustness of camera pose regression models. Specifically, WatchPose tracks nested markers and visualizes viewpoints in an Augmented Reality- (AR) based manner to properly guide users to collect training data from broader camera-object distances and more diverse views around the objects. Experiments show that WatchPose can effectively improve the accuracy of existing camera pose regression models compared to the traditional data acquisition method. We also introduce a new dataset, Industrial10, to encourage the community to adapt camera pose regression methods for more complex environments.https://www.mdpi.com/1424-8220/20/11/3045data acquisitionaugmented realitypose estimationdeep learningindustrial environments
collection DOAJ
language English
format Article
sources DOAJ
author Cong Yang
Gilles Simon
John See
Marie-Odile Berger
Wenyong Wang
spellingShingle Cong Yang
Gilles Simon
John See
Marie-Odile Berger
Wenyong Wang
WatchPose: A View-Aware Approach for Camera Pose Data Collection in Industrial Environments
Sensors
data acquisition
augmented reality
pose estimation
deep learning
industrial environments
author_facet Cong Yang
Gilles Simon
John See
Marie-Odile Berger
Wenyong Wang
author_sort Cong Yang
title WatchPose: A View-Aware Approach for Camera Pose Data Collection in Industrial Environments
title_short WatchPose: A View-Aware Approach for Camera Pose Data Collection in Industrial Environments
title_full WatchPose: A View-Aware Approach for Camera Pose Data Collection in Industrial Environments
title_fullStr WatchPose: A View-Aware Approach for Camera Pose Data Collection in Industrial Environments
title_full_unstemmed WatchPose: A View-Aware Approach for Camera Pose Data Collection in Industrial Environments
title_sort watchpose: a view-aware approach for camera pose data collection in industrial environments
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2020-05-01
description Collecting correlated scene images and camera poses is an essential step towards learning absolute camera pose regression models. While the acquisition of such data in living environments is relatively easy by following regular roads and paths, it is still a challenging task in constricted industrial environments. This is because industrial objects have varied sizes and inspections are usually carried out with non-constant motions. As a result, regression models are more sensitive to scene images with respect to viewpoints and distances. Motivated by this, we present a simple but efficient camera pose data collection method, WatchPose, to improve the generalization and robustness of camera pose regression models. Specifically, WatchPose tracks nested markers and visualizes viewpoints in an Augmented Reality- (AR) based manner to properly guide users to collect training data from broader camera-object distances and more diverse views around the objects. Experiments show that WatchPose can effectively improve the accuracy of existing camera pose regression models compared to the traditional data acquisition method. We also introduce a new dataset, Industrial10, to encourage the community to adapt camera pose regression methods for more complex environments.
topic data acquisition
augmented reality
pose estimation
deep learning
industrial environments
url https://www.mdpi.com/1424-8220/20/11/3045
work_keys_str_mv AT congyang watchposeaviewawareapproachforcameraposedatacollectioninindustrialenvironments
AT gillessimon watchposeaviewawareapproachforcameraposedatacollectioninindustrialenvironments
AT johnsee watchposeaviewawareapproachforcameraposedatacollectioninindustrialenvironments
AT marieodileberger watchposeaviewawareapproachforcameraposedatacollectioninindustrialenvironments
AT wenyongwang watchposeaviewawareapproachforcameraposedatacollectioninindustrialenvironments
_version_ 1724670257658855424