The Construct Validity and Reliability of an Assessment Tool for Competency in Cochlear Implant Surgery

Introduction. We introduce a rating tool that objectively evaluates the skills of surgical trainees performing cochlear implant surgery. Methods. Seven residents and seven experts performed cochlear implant surgery sessions from mastoidectomy to cochleostomy on a standardized virtual reality tempora...

Full description

Bibliographic Details
Main Authors: Patorn Piromchai, Pornthep Kasemsiri, Sudanthi Wijewickrema, Ioanna Ioannou, Gregor Kennedy, Stephen O'Leary
Format: Article
Language:English
Published: Hindawi Limited 2014-01-01
Series:BioMed Research International
Online Access:http://dx.doi.org/10.1155/2014/192741
id doaj-d4257b28c4cd4c899857f8df2e566de2
record_format Article
spelling doaj-d4257b28c4cd4c899857f8df2e566de22020-11-24T23:21:17ZengHindawi LimitedBioMed Research International2314-61332314-61412014-01-01201410.1155/2014/192741192741The Construct Validity and Reliability of an Assessment Tool for Competency in Cochlear Implant SurgeryPatorn Piromchai0Pornthep Kasemsiri1Sudanthi Wijewickrema2Ioanna Ioannou3Gregor Kennedy4Stephen O'Leary5Department of Otolaryngology, Royal Victorian Eye and Ear Hospital, University of Melbourne, East Melbourne, VIC 3002, AustraliaDepartment of Otorhinolaryngology, Faculty of Medicine, Khon Kaen University, Khon Kaen 40002, ThailandDepartment of Otolaryngology, Royal Victorian Eye and Ear Hospital, University of Melbourne, East Melbourne, VIC 3002, AustraliaDepartment of Otolaryngology, Royal Victorian Eye and Ear Hospital, University of Melbourne, East Melbourne, VIC 3002, AustraliaCentre for the Study of Higher Education, University of Melbourne, Parkville, VIC 3052, AustraliaDepartment of Otolaryngology, Royal Victorian Eye and Ear Hospital, University of Melbourne, East Melbourne, VIC 3002, AustraliaIntroduction. We introduce a rating tool that objectively evaluates the skills of surgical trainees performing cochlear implant surgery. Methods. Seven residents and seven experts performed cochlear implant surgery sessions from mastoidectomy to cochleostomy on a standardized virtual reality temporal bone. A total of twenty-eight assessment videos were recorded and two consultant otolaryngologists evaluated the performance of each participant using these videos. Results. Interrater reliability was calculated using the intraclass correlation coefficient for both the global and checklist components of the assessment instrument. The overall agreement was high. The construct validity of this instrument was strongly supported by the significantly higher scores in the expert group for both components. Conclusion. Our results indicate that the proposed assessment tool for cochlear implant surgery is reliable, accurate, and easy to use. This instrument can thus be used to provide objective feedback on overall and task-specific competency in cochlear implantation.http://dx.doi.org/10.1155/2014/192741
collection DOAJ
language English
format Article
sources DOAJ
author Patorn Piromchai
Pornthep Kasemsiri
Sudanthi Wijewickrema
Ioanna Ioannou
Gregor Kennedy
Stephen O'Leary
spellingShingle Patorn Piromchai
Pornthep Kasemsiri
Sudanthi Wijewickrema
Ioanna Ioannou
Gregor Kennedy
Stephen O'Leary
The Construct Validity and Reliability of an Assessment Tool for Competency in Cochlear Implant Surgery
BioMed Research International
author_facet Patorn Piromchai
Pornthep Kasemsiri
Sudanthi Wijewickrema
Ioanna Ioannou
Gregor Kennedy
Stephen O'Leary
author_sort Patorn Piromchai
title The Construct Validity and Reliability of an Assessment Tool for Competency in Cochlear Implant Surgery
title_short The Construct Validity and Reliability of an Assessment Tool for Competency in Cochlear Implant Surgery
title_full The Construct Validity and Reliability of an Assessment Tool for Competency in Cochlear Implant Surgery
title_fullStr The Construct Validity and Reliability of an Assessment Tool for Competency in Cochlear Implant Surgery
title_full_unstemmed The Construct Validity and Reliability of an Assessment Tool for Competency in Cochlear Implant Surgery
title_sort construct validity and reliability of an assessment tool for competency in cochlear implant surgery
publisher Hindawi Limited
series BioMed Research International
issn 2314-6133
2314-6141
publishDate 2014-01-01
description Introduction. We introduce a rating tool that objectively evaluates the skills of surgical trainees performing cochlear implant surgery. Methods. Seven residents and seven experts performed cochlear implant surgery sessions from mastoidectomy to cochleostomy on a standardized virtual reality temporal bone. A total of twenty-eight assessment videos were recorded and two consultant otolaryngologists evaluated the performance of each participant using these videos. Results. Interrater reliability was calculated using the intraclass correlation coefficient for both the global and checklist components of the assessment instrument. The overall agreement was high. The construct validity of this instrument was strongly supported by the significantly higher scores in the expert group for both components. Conclusion. Our results indicate that the proposed assessment tool for cochlear implant surgery is reliable, accurate, and easy to use. This instrument can thus be used to provide objective feedback on overall and task-specific competency in cochlear implantation.
url http://dx.doi.org/10.1155/2014/192741
work_keys_str_mv AT patornpiromchai theconstructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
AT pornthepkasemsiri theconstructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
AT sudanthiwijewickrema theconstructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
AT ioannaioannou theconstructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
AT gregorkennedy theconstructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
AT stephenoleary theconstructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
AT patornpiromchai constructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
AT pornthepkasemsiri constructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
AT sudanthiwijewickrema constructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
AT ioannaioannou constructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
AT gregorkennedy constructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
AT stephenoleary constructvalidityandreliabilityofanassessmenttoolforcompetencyincochlearimplantsurgery
_version_ 1725571962975027200