Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics

Background: In neurosurgery, it is important to inspect the spatial correspondence between the preoperative medical image (virtual space), and the intraoperative findings (real space) to improve the safety of the surgery. Navigation systems and related modalities have been reported as methods for ma...

Full description

Bibliographic Details
Main Authors: Tsukasa Koike, Taichi Kin, Shota Tanaka, Yasuhiro Takeda, Hiroki Uchikawa, Taketo Shiode, Toki Saito, Hirokazu Takami, Shunsaku Takayanagi, Akitake Mukasa, Hiroshi Oyama, Nobuhito Saito
Format: Article
Language:English
Published: Elsevier 2021-07-01
Series:World Neurosurgery: X
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2590139721000053
id doaj-310da6f7d98a4494a208767a0f2e9d61
record_format Article
spelling doaj-310da6f7d98a4494a208767a0f2e9d612021-06-13T04:39:35ZengElsevierWorld Neurosurgery: X2590-13972021-07-0111100102Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer GraphicsTsukasa Koike0Taichi Kin1Shota Tanaka2Yasuhiro Takeda3Hiroki Uchikawa4Taketo Shiode5Toki Saito6Hirokazu Takami7Shunsaku Takayanagi8Akitake Mukasa9Hiroshi Oyama10Nobuhito Saito11Department of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan; To whom correspondence should be addressed: Taichi Kin, M.D.Department of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Clinical Information Engineering, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medical Sciences, Kumamoto University, Kumamoto, JapanDepartment of Clinical Information Engineering, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanDepartment of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo, JapanBackground: In neurosurgery, it is important to inspect the spatial correspondence between the preoperative medical image (virtual space), and the intraoperative findings (real space) to improve the safety of the surgery. Navigation systems and related modalities have been reported as methods for matching this correspondence. However, because of the influence of the brain shift accompanying craniotomy, registration accuracy is reduced. In the present study, to overcome these issues, we developed a spatially accurate registration method of medical fusion 3-dimensional computer graphics and the intraoperative brain surface photograph, and its registration accuracy was measured. Methods: The subjects included 16 patients with glioma. Nonrigid registration using the landmarks and thin-plate spline methods was performed for the fusion 3-dimensional computer graphics and the intraoperative brain surface photograph, termed mixed-reality computer graphics. Regarding the registration accuracy measurement, the target registration error was measured by two neurosurgeons, with 10 points for each case at the midpoint of the landmarks. Results: The number of target registration error measurement points was 160 in the 16 cases. The target registration error was 0.72 ± 0.04 mm. Aligning the intraoperative brain surface photograph and the fusion 3-dimensional computer graphics required ∼10 minutes on average. The average number of landmarks used for alignment was 24.6. Conclusions: Mixed-reality computer graphics enabled highly precise spatial alignment between the real space and virtual space. Mixed-reality computer graphics have the potential to improve the safety of the surgery by allowing complementary observation of brain surface photographs and fusion 3-dimensional computer graphics.http://www.sciencedirect.com/science/article/pii/S2590139721000053Brain shiftComputer graphicsGliomaLandmarkMixed-realityTarget registration error
collection DOAJ
language English
format Article
sources DOAJ
author Tsukasa Koike
Taichi Kin
Shota Tanaka
Yasuhiro Takeda
Hiroki Uchikawa
Taketo Shiode
Toki Saito
Hirokazu Takami
Shunsaku Takayanagi
Akitake Mukasa
Hiroshi Oyama
Nobuhito Saito
spellingShingle Tsukasa Koike
Taichi Kin
Shota Tanaka
Yasuhiro Takeda
Hiroki Uchikawa
Taketo Shiode
Toki Saito
Hirokazu Takami
Shunsaku Takayanagi
Akitake Mukasa
Hiroshi Oyama
Nobuhito Saito
Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics
World Neurosurgery: X
Brain shift
Computer graphics
Glioma
Landmark
Mixed-reality
Target registration error
author_facet Tsukasa Koike
Taichi Kin
Shota Tanaka
Yasuhiro Takeda
Hiroki Uchikawa
Taketo Shiode
Toki Saito
Hirokazu Takami
Shunsaku Takayanagi
Akitake Mukasa
Hiroshi Oyama
Nobuhito Saito
author_sort Tsukasa Koike
title Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics
title_short Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics
title_full Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics
title_fullStr Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics
title_full_unstemmed Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics
title_sort development of innovative neurosurgical operation support method using mixed-reality computer graphics
publisher Elsevier
series World Neurosurgery: X
issn 2590-1397
publishDate 2021-07-01
description Background: In neurosurgery, it is important to inspect the spatial correspondence between the preoperative medical image (virtual space), and the intraoperative findings (real space) to improve the safety of the surgery. Navigation systems and related modalities have been reported as methods for matching this correspondence. However, because of the influence of the brain shift accompanying craniotomy, registration accuracy is reduced. In the present study, to overcome these issues, we developed a spatially accurate registration method of medical fusion 3-dimensional computer graphics and the intraoperative brain surface photograph, and its registration accuracy was measured. Methods: The subjects included 16 patients with glioma. Nonrigid registration using the landmarks and thin-plate spline methods was performed for the fusion 3-dimensional computer graphics and the intraoperative brain surface photograph, termed mixed-reality computer graphics. Regarding the registration accuracy measurement, the target registration error was measured by two neurosurgeons, with 10 points for each case at the midpoint of the landmarks. Results: The number of target registration error measurement points was 160 in the 16 cases. The target registration error was 0.72 ± 0.04 mm. Aligning the intraoperative brain surface photograph and the fusion 3-dimensional computer graphics required ∼10 minutes on average. The average number of landmarks used for alignment was 24.6. Conclusions: Mixed-reality computer graphics enabled highly precise spatial alignment between the real space and virtual space. Mixed-reality computer graphics have the potential to improve the safety of the surgery by allowing complementary observation of brain surface photographs and fusion 3-dimensional computer graphics.
topic Brain shift
Computer graphics
Glioma
Landmark
Mixed-reality
Target registration error
url http://www.sciencedirect.com/science/article/pii/S2590139721000053
work_keys_str_mv AT tsukasakoike developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
AT taichikin developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
AT shotatanaka developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
AT yasuhirotakeda developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
AT hirokiuchikawa developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
AT taketoshiode developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
AT tokisaito developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
AT hirokazutakami developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
AT shunsakutakayanagi developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
AT akitakemukasa developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
AT hiroshioyama developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
AT nobuhitosaito developmentofinnovativeneurosurgicaloperationsupportmethodusingmixedrealitycomputergraphics
_version_ 1721380353623457792