Automated pipette failure monitoring using image processing for point-of-care testing devices

Abstract Background The accuracy and precision of liquid handling can be altered by several causes including wearing or failure of parts, and human error. The last cause is crucial since point-of-care testing (POCT) devices can be used by non-experienced users or patients themselves. Therefore it is...

Full description

Bibliographic Details
Main Authors: Chan-Young Park, Jun Yeon, Hye-Jeong Song, Yu-Seop Kim, Ki-Bong Nahm, Jong-Dae Kim
Format: Article
Language:English
Published: BMC 2018-11-01
Series:BioMedical Engineering OnLine
Subjects:
Online Access:http://link.springer.com/article/10.1186/s12938-018-0578-1
id doaj-c9c37b04e2d044c5b71b8751e6307344
record_format Article
spelling doaj-c9c37b04e2d044c5b71b8751e63073442020-11-24T21:33:39ZengBMCBioMedical Engineering OnLine1475-925X2018-11-0117S211110.1186/s12938-018-0578-1Automated pipette failure monitoring using image processing for point-of-care testing devicesChan-Young Park0Jun Yeon1Hye-Jeong Song2Yu-Seop Kim3Ki-Bong Nahm4Jong-Dae Kim5Department of Convergence Software, Hallym UniversityDepartment of Convergence Software, Hallym UniversityDepartment of Convergence Software, Hallym UniversityDepartment of Convergence Software, Hallym UniversityDepartment of Electron Physics, Hallym UniversityDepartment of Convergence Software, Hallym UniversityAbstract Background The accuracy and precision of liquid handling can be altered by several causes including wearing or failure of parts, and human error. The last cause is crucial since point-of-care testing (POCT) devices can be used by non-experienced users or patients themselves. Therefore it is important to improve the method of informing the users of POCT device malfunctions due to damage of parts or human error. Methods In this paper, image-based failure monitoring of the automated pipetting was introduced for POCT devices. An inexpensive, high-performance camera for smartphones was employed in our previous work to resolve various malfunctions such as incorrect insertion of the tip, false positioning of the tip and pump, and improper operation of the pump. The image acquired from the camera was analyzed to detect the malfunctions. In this paper, the reagent volume in the tip was estimated from the image processing to verify the pump operation. First, the color component corresponding to the reagent intrinsic color was extracted to identify the reagent area in the tip before applying the binary image processing. The extracted reagent area was projected horizontally and the support length of the projection image was calculated. As the support length was related to the reagent volume, it was referred to the volume length. The relationship between the measured volume length and the previously measured solution mass was investigated. If we can predict the mass of the solution by the volume length, we will be able to detect the pump malfunction. Results The cube of the volume length obtained by the proposed image processing method showed a very linear relationship with the reagent mass in the tip injected by the pumping operation (R2 = 0.996), indicating that the volume length could be utilized to estimate the reagent volume to monitor the accuracy and precision of the pumping operation. Conclusions An inexpensive smartphone camera was enough to detect various malfunctions of a POCT device with pumping operation. The proposed image processing could monitor the level of inaccuracy of pumping volume in limited range. The simple image processing such as a fixed threshold and projections was employed for the cost optimization and system robustness. However it delivered the promising results because the imaging condition was highly controllable in the devices.http://link.springer.com/article/10.1186/s12938-018-0578-1Automated liquid handlerImage processingPipetting failureProjection
collection DOAJ
language English
format Article
sources DOAJ
author Chan-Young Park
Jun Yeon
Hye-Jeong Song
Yu-Seop Kim
Ki-Bong Nahm
Jong-Dae Kim
spellingShingle Chan-Young Park
Jun Yeon
Hye-Jeong Song
Yu-Seop Kim
Ki-Bong Nahm
Jong-Dae Kim
Automated pipette failure monitoring using image processing for point-of-care testing devices
BioMedical Engineering OnLine
Automated liquid handler
Image processing
Pipetting failure
Projection
author_facet Chan-Young Park
Jun Yeon
Hye-Jeong Song
Yu-Seop Kim
Ki-Bong Nahm
Jong-Dae Kim
author_sort Chan-Young Park
title Automated pipette failure monitoring using image processing for point-of-care testing devices
title_short Automated pipette failure monitoring using image processing for point-of-care testing devices
title_full Automated pipette failure monitoring using image processing for point-of-care testing devices
title_fullStr Automated pipette failure monitoring using image processing for point-of-care testing devices
title_full_unstemmed Automated pipette failure monitoring using image processing for point-of-care testing devices
title_sort automated pipette failure monitoring using image processing for point-of-care testing devices
publisher BMC
series BioMedical Engineering OnLine
issn 1475-925X
publishDate 2018-11-01
description Abstract Background The accuracy and precision of liquid handling can be altered by several causes including wearing or failure of parts, and human error. The last cause is crucial since point-of-care testing (POCT) devices can be used by non-experienced users or patients themselves. Therefore it is important to improve the method of informing the users of POCT device malfunctions due to damage of parts or human error. Methods In this paper, image-based failure monitoring of the automated pipetting was introduced for POCT devices. An inexpensive, high-performance camera for smartphones was employed in our previous work to resolve various malfunctions such as incorrect insertion of the tip, false positioning of the tip and pump, and improper operation of the pump. The image acquired from the camera was analyzed to detect the malfunctions. In this paper, the reagent volume in the tip was estimated from the image processing to verify the pump operation. First, the color component corresponding to the reagent intrinsic color was extracted to identify the reagent area in the tip before applying the binary image processing. The extracted reagent area was projected horizontally and the support length of the projection image was calculated. As the support length was related to the reagent volume, it was referred to the volume length. The relationship between the measured volume length and the previously measured solution mass was investigated. If we can predict the mass of the solution by the volume length, we will be able to detect the pump malfunction. Results The cube of the volume length obtained by the proposed image processing method showed a very linear relationship with the reagent mass in the tip injected by the pumping operation (R2 = 0.996), indicating that the volume length could be utilized to estimate the reagent volume to monitor the accuracy and precision of the pumping operation. Conclusions An inexpensive smartphone camera was enough to detect various malfunctions of a POCT device with pumping operation. The proposed image processing could monitor the level of inaccuracy of pumping volume in limited range. The simple image processing such as a fixed threshold and projections was employed for the cost optimization and system robustness. However it delivered the promising results because the imaging condition was highly controllable in the devices.
topic Automated liquid handler
Image processing
Pipetting failure
Projection
url http://link.springer.com/article/10.1186/s12938-018-0578-1
work_keys_str_mv AT chanyoungpark automatedpipettefailuremonitoringusingimageprocessingforpointofcaretestingdevices
AT junyeon automatedpipettefailuremonitoringusingimageprocessingforpointofcaretestingdevices
AT hyejeongsong automatedpipettefailuremonitoringusingimageprocessingforpointofcaretestingdevices
AT yuseopkim automatedpipettefailuremonitoringusingimageprocessingforpointofcaretestingdevices
AT kibongnahm automatedpipettefailuremonitoringusingimageprocessingforpointofcaretestingdevices
AT jongdaekim automatedpipettefailuremonitoringusingimageprocessingforpointofcaretestingdevices
_version_ 1725952727017586688