Precise 3D Baseball Pitching Trajectory Estimation Using Multiple Unsynchronized Cameras

We developed a method for the precise estimation of the 3D trajectory of a baseball by modeling the movement of the baseball and estimating the capture delay, using multiple unsynchronized cameras. To develop the proposed algorithm, we mimicked the real-world process of capturing a baseball in simul...

Full description

Bibliographic Details
Main Authors: Joongsik Kim, Moonsoo Ra, Hongjun Lee, Jeyeon Kim, Whoi-Yul Kim
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8897547/
id doaj-87d7d068b6e148888c3ef99502b10c9c
record_format Article
spelling doaj-87d7d068b6e148888c3ef99502b10c9c2021-03-30T00:36:52ZengIEEEIEEE Access2169-35362019-01-01716646316647510.1109/ACCESS.2019.29533408897547Precise 3D Baseball Pitching Trajectory Estimation Using Multiple Unsynchronized CamerasJoongsik Kim0https://orcid.org/0000-0002-2554-558XMoonsoo Ra1Hongjun Lee2Jeyeon Kim3Whoi-Yul Kim4Department of Electronics and Computer Engineering, Hanyang University, Seoul, South KoreaDepartment of Electronics and Computer Engineering, Hanyang University, Seoul, South KoreaDepartment of Electronics and Computer Engineering, Hanyang University, Seoul, South KoreaDepartment of Electronics and Computer Engineering, Hanyang University, Seoul, South KoreaDepartment of Electronics and Computer Engineering, Hanyang University, Seoul, South KoreaWe developed a method for the precise estimation of the 3D trajectory of a baseball by modeling the movement of the baseball and estimating the capture delay, using multiple unsynchronized cameras. To develop the proposed algorithm, we mimicked the real-world process of capturing a baseball in simulation space, and analyzed the capture process using a multiple unsynchronized camera system. We represented the movement of the baseball using a piece-wise spline model, and predicted the position of the baseball in the subframes in a manner which is robust to position error and change in direction of movement of the baseball. This method accurately predicts the baseball position over time by modeling the movement of the baseball in a real baseball game environment, and improves the accuracy of the reconstructed 3D baseball trajectories. We defined an objective function to estimate the capture delay, and estimate the optimal capture delay parameter using non-linear optimization method. In addition, we evaluated the performance of the proposed method in simulation space and in a real-world situation. The experimental results show that the proposed method can estimate a 3D baseball trajectory precisely using a multiple unsynchronized camera system and is robust to variations in capture delay, both in the simulation space and in real-world situations.https://ieeexplore.ieee.org/document/8897547/Stereo vision3D pitching trajectorymultiple unsynchronized camerascamera calibration
collection DOAJ
language English
format Article
sources DOAJ
author Joongsik Kim
Moonsoo Ra
Hongjun Lee
Jeyeon Kim
Whoi-Yul Kim
spellingShingle Joongsik Kim
Moonsoo Ra
Hongjun Lee
Jeyeon Kim
Whoi-Yul Kim
Precise 3D Baseball Pitching Trajectory Estimation Using Multiple Unsynchronized Cameras
IEEE Access
Stereo vision
3D pitching trajectory
multiple unsynchronized cameras
camera calibration
author_facet Joongsik Kim
Moonsoo Ra
Hongjun Lee
Jeyeon Kim
Whoi-Yul Kim
author_sort Joongsik Kim
title Precise 3D Baseball Pitching Trajectory Estimation Using Multiple Unsynchronized Cameras
title_short Precise 3D Baseball Pitching Trajectory Estimation Using Multiple Unsynchronized Cameras
title_full Precise 3D Baseball Pitching Trajectory Estimation Using Multiple Unsynchronized Cameras
title_fullStr Precise 3D Baseball Pitching Trajectory Estimation Using Multiple Unsynchronized Cameras
title_full_unstemmed Precise 3D Baseball Pitching Trajectory Estimation Using Multiple Unsynchronized Cameras
title_sort precise 3d baseball pitching trajectory estimation using multiple unsynchronized cameras
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2019-01-01
description We developed a method for the precise estimation of the 3D trajectory of a baseball by modeling the movement of the baseball and estimating the capture delay, using multiple unsynchronized cameras. To develop the proposed algorithm, we mimicked the real-world process of capturing a baseball in simulation space, and analyzed the capture process using a multiple unsynchronized camera system. We represented the movement of the baseball using a piece-wise spline model, and predicted the position of the baseball in the subframes in a manner which is robust to position error and change in direction of movement of the baseball. This method accurately predicts the baseball position over time by modeling the movement of the baseball in a real baseball game environment, and improves the accuracy of the reconstructed 3D baseball trajectories. We defined an objective function to estimate the capture delay, and estimate the optimal capture delay parameter using non-linear optimization method. In addition, we evaluated the performance of the proposed method in simulation space and in a real-world situation. The experimental results show that the proposed method can estimate a 3D baseball trajectory precisely using a multiple unsynchronized camera system and is robust to variations in capture delay, both in the simulation space and in real-world situations.
topic Stereo vision
3D pitching trajectory
multiple unsynchronized cameras
camera calibration
url https://ieeexplore.ieee.org/document/8897547/
work_keys_str_mv AT joongsikkim precise3dbaseballpitchingtrajectoryestimationusingmultipleunsynchronizedcameras
AT moonsoora precise3dbaseballpitchingtrajectoryestimationusingmultipleunsynchronizedcameras
AT hongjunlee precise3dbaseballpitchingtrajectoryestimationusingmultipleunsynchronizedcameras
AT jeyeonkim precise3dbaseballpitchingtrajectoryestimationusingmultipleunsynchronizedcameras
AT whoiyulkim precise3dbaseballpitchingtrajectoryestimationusingmultipleunsynchronizedcameras
_version_ 1724188136103215104