Large-Field-of-View Visualization with Small Blind Spots Utilizing Tilted Micro-Camera Array for Laparoscopic Surgery

Existing laparoscopic surgery systems use a single laparoscope to visualize the surgical area with a limited field of view (FoV), necessitating maneuvering the laparoscope to search a target region. In some cases, the laparoscope needs to be moved from one surgical port to another one to detect targ...

Full description

Bibliographic Details
Main Authors: Alex J. Watras, Jae-Jun Kim, Jianwei Ke, Hewei Liu, Jacob A. Greenberg, Charles P. Heise, Yu Hen Hu, Hongrui Jiang
Format: Article
Language:English
Published: MDPI AG 2020-05-01
Series:Micromachines
Subjects:
Online Access:https://www.mdpi.com/2072-666X/11/5/488
id doaj-55f1bb8b9c9640e8b8b309fc343c753f
record_format Article
spelling doaj-55f1bb8b9c9640e8b8b309fc343c753f2020-11-25T02:11:14ZengMDPI AGMicromachines2072-666X2020-05-011148848810.3390/mi11050488Large-Field-of-View Visualization with Small Blind Spots Utilizing Tilted Micro-Camera Array for Laparoscopic SurgeryAlex J. Watras0Jae-Jun Kim1Jianwei Ke2Hewei Liu3Jacob A. Greenberg4Charles P. Heise5Yu Hen Hu6Hongrui Jiang7Department of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI 53706, USADepartment of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI 53706, USADepartment of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI 53706, USADepartment of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI 53706, USADepartment of Surgery, University of Wisconsin School of Medicine and Public Health, Madison, WI 53792, USADepartment of Surgery, University of Wisconsin School of Medicine and Public Health, Madison, WI 53792, USADepartment of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI 53706, USADepartment of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI 53706, USAExisting laparoscopic surgery systems use a single laparoscope to visualize the surgical area with a limited field of view (FoV), necessitating maneuvering the laparoscope to search a target region. In some cases, the laparoscope needs to be moved from one surgical port to another one to detect target organs. These maneuvers would cause longer surgical time and degrade the efficiency of operation. We hypothesize that if an array of cameras can be deployed to provide a stitched video with an expanded FoV and small blind spots, the time required to perform multiple tasks at different sites can be significantly reduced. We developed a micro-camera array that can enlarge the FoV and reduce blind spots between the cameras by optimizing the angle of cameras. The video stream of this micro-camera array was designed to be processed in real-time to provide a stitched video with the expanded FoV. We mounted this micro-camera array to a Fundamentals of Laparoscopic Surgery (FLS) laparoscopic trainer box and designed an experiment to validate the hypothesis above. Surgeons, residents, and a medical student were recruited to perform a modified bean drop task, and the completion time was compared against that measured using a traditional single-camera laparoscope. It was observed that utilizing the micro-camera array, the completion time of the modified bean drop task was <inline-formula> <math display="inline"> <semantics> <mrow> <mn>203</mn> <mo>±</mo> <mn>55</mn> </mrow> </semantics> </math> </inline-formula> s while using the laparoscope, the completion time was <inline-formula> <math display="inline"> <semantics> <mrow> <mn>245</mn> <mo>±</mo> <mn>114</mn> </mrow> </semantics> </math> </inline-formula> s, with a <i>p</i>-value of 0.00097. It is also observed that the benefit of using an FoV-expanded camera array does not diminish for subjects who are more experienced. This test provides convincing evidence and validates the hypothesis that expanded FoV with small blind spots can reduce the operation time for laparoscopic surgical tasks.https://www.mdpi.com/2072-666X/11/5/488large field of viewsmall blind spotsminiaturized cameraslaparoscopybean drop task
collection DOAJ
language English
format Article
sources DOAJ
author Alex J. Watras
Jae-Jun Kim
Jianwei Ke
Hewei Liu
Jacob A. Greenberg
Charles P. Heise
Yu Hen Hu
Hongrui Jiang
spellingShingle Alex J. Watras
Jae-Jun Kim
Jianwei Ke
Hewei Liu
Jacob A. Greenberg
Charles P. Heise
Yu Hen Hu
Hongrui Jiang
Large-Field-of-View Visualization with Small Blind Spots Utilizing Tilted Micro-Camera Array for Laparoscopic Surgery
Micromachines
large field of view
small blind spots
miniaturized cameras
laparoscopy
bean drop task
author_facet Alex J. Watras
Jae-Jun Kim
Jianwei Ke
Hewei Liu
Jacob A. Greenberg
Charles P. Heise
Yu Hen Hu
Hongrui Jiang
author_sort Alex J. Watras
title Large-Field-of-View Visualization with Small Blind Spots Utilizing Tilted Micro-Camera Array for Laparoscopic Surgery
title_short Large-Field-of-View Visualization with Small Blind Spots Utilizing Tilted Micro-Camera Array for Laparoscopic Surgery
title_full Large-Field-of-View Visualization with Small Blind Spots Utilizing Tilted Micro-Camera Array for Laparoscopic Surgery
title_fullStr Large-Field-of-View Visualization with Small Blind Spots Utilizing Tilted Micro-Camera Array for Laparoscopic Surgery
title_full_unstemmed Large-Field-of-View Visualization with Small Blind Spots Utilizing Tilted Micro-Camera Array for Laparoscopic Surgery
title_sort large-field-of-view visualization with small blind spots utilizing tilted micro-camera array for laparoscopic surgery
publisher MDPI AG
series Micromachines
issn 2072-666X
publishDate 2020-05-01
description Existing laparoscopic surgery systems use a single laparoscope to visualize the surgical area with a limited field of view (FoV), necessitating maneuvering the laparoscope to search a target region. In some cases, the laparoscope needs to be moved from one surgical port to another one to detect target organs. These maneuvers would cause longer surgical time and degrade the efficiency of operation. We hypothesize that if an array of cameras can be deployed to provide a stitched video with an expanded FoV and small blind spots, the time required to perform multiple tasks at different sites can be significantly reduced. We developed a micro-camera array that can enlarge the FoV and reduce blind spots between the cameras by optimizing the angle of cameras. The video stream of this micro-camera array was designed to be processed in real-time to provide a stitched video with the expanded FoV. We mounted this micro-camera array to a Fundamentals of Laparoscopic Surgery (FLS) laparoscopic trainer box and designed an experiment to validate the hypothesis above. Surgeons, residents, and a medical student were recruited to perform a modified bean drop task, and the completion time was compared against that measured using a traditional single-camera laparoscope. It was observed that utilizing the micro-camera array, the completion time of the modified bean drop task was <inline-formula> <math display="inline"> <semantics> <mrow> <mn>203</mn> <mo>±</mo> <mn>55</mn> </mrow> </semantics> </math> </inline-formula> s while using the laparoscope, the completion time was <inline-formula> <math display="inline"> <semantics> <mrow> <mn>245</mn> <mo>±</mo> <mn>114</mn> </mrow> </semantics> </math> </inline-formula> s, with a <i>p</i>-value of 0.00097. It is also observed that the benefit of using an FoV-expanded camera array does not diminish for subjects who are more experienced. This test provides convincing evidence and validates the hypothesis that expanded FoV with small blind spots can reduce the operation time for laparoscopic surgical tasks.
topic large field of view
small blind spots
miniaturized cameras
laparoscopy
bean drop task
url https://www.mdpi.com/2072-666X/11/5/488
work_keys_str_mv AT alexjwatras largefieldofviewvisualizationwithsmallblindspotsutilizingtiltedmicrocameraarrayforlaparoscopicsurgery
AT jaejunkim largefieldofviewvisualizationwithsmallblindspotsutilizingtiltedmicrocameraarrayforlaparoscopicsurgery
AT jianweike largefieldofviewvisualizationwithsmallblindspotsutilizingtiltedmicrocameraarrayforlaparoscopicsurgery
AT heweiliu largefieldofviewvisualizationwithsmallblindspotsutilizingtiltedmicrocameraarrayforlaparoscopicsurgery
AT jacobagreenberg largefieldofviewvisualizationwithsmallblindspotsutilizingtiltedmicrocameraarrayforlaparoscopicsurgery
AT charlespheise largefieldofviewvisualizationwithsmallblindspotsutilizingtiltedmicrocameraarrayforlaparoscopicsurgery
AT yuhenhu largefieldofviewvisualizationwithsmallblindspotsutilizingtiltedmicrocameraarrayforlaparoscopicsurgery
AT hongruijiang largefieldofviewvisualizationwithsmallblindspotsutilizingtiltedmicrocameraarrayforlaparoscopicsurgery
_version_ 1724915466229514240