User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis

Objectives There is a need in clinical genomics for systems that assist in clinical diagnosis, analysis of genomic information and periodic reanalysis of results, and can use information from the electronic health record to do so. Such systems should be built using the concepts of human-centred desi...

Full description

Bibliographic Details
Main Authors: Conner Jenkins, Troy Jenkins, Thomas N Person, Peter N Robinson, Alanna Kulchak Rahm, Nephi A Walton, Lynn K Feldman, Joeseph Peterson, Jonathon C Reynolds, Makenzie A Woltz, Marc S Williams, Michael M Segal
Format: Article
Language:English
Published: BMJ Publishing Group 2021-07-01
Series:BMJ Health & Care Informatics
Online Access:https://informatics.bmj.com/content/28/1/e100331.full
id doaj-6f81dbb812864747af76481cc3b38917
record_format Article
spelling doaj-6f81dbb812864747af76481cc3b389172021-07-31T09:30:30ZengBMJ Publishing GroupBMJ Health & Care Informatics2632-10092021-07-0128110.1136/bmjhci-2021-100331User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosisConner Jenkins0Troy Jenkins1Thomas N Person2Peter N Robinson3Alanna Kulchak Rahm4Nephi A Walton5Lynn K Feldman6Joeseph Peterson7Jonathon C Reynolds8Makenzie A Woltz9Marc S Williams10Michael M Segal11University of Utah, Salt Lake City, Utah, USAUniversity of Utah, Salt Lake City, Utah, USAGenomic Medicine Institute, Geisinger Health System, Danville, Pennsylvania, USAJackson Laboratory for Genomic Medicine, Farmington, Connecticut, USAGenomic Medicine Institute, Geisinger Health System, Danville, Pennsylvania, USAIntermountain Precision Genomics, Intermountain Healthcare, St. George, Utah, USASimulConsult, Inc, Chestnut Hill, Massachusetts, USAUniversity of Utah, Salt Lake City, Utah, USAGenomic Medicine Institute, Geisinger Health System, Danville, Pennsylvania, USAGenomic Medicine Institute, Geisinger Health System, Danville, Pennsylvania, USAGenomic Medicine Institute, Geisinger Health System, Danville, Pennsylvania, USASimulConsult, Inc, Chestnut Hill, Massachusetts, USAObjectives There is a need in clinical genomics for systems that assist in clinical diagnosis, analysis of genomic information and periodic reanalysis of results, and can use information from the electronic health record to do so. Such systems should be built using the concepts of human-centred design, fit within clinical workflows and provide solutions to priority problems.Methods We adapted a commercially available diagnostic decision support system (DDSS) to use extracted findings from a patient record and combine them with genomic variant information in the DDSS interface. Three representative patient cases were created in a simulated clinical environment for user testing. A semistructured interview guide was created to illuminate factors relevant to human factors in CDS design and organisational implementation.Results Six individuals completed the user testing process. Tester responses were positive and noted good fit with real-world clinical genetics workflow. Technical issues related to interface, interaction and design were minor and fixable. Testers suggested solving issues related to terminology and usability through training and infobuttons. Time savings was estimated at 30%–50% and additional uses such as in-house clinical variant analysis were suggested for increase fit with workflow and to further address priority problems.Conclusion This study provides preliminary evidence for usability, workflow fit, acceptability and implementation potential of a modified DDSS that includes machine-assisted chart review. Continued development and testing using principles from human-centred design and implementation science are necessary to improve technical functionality and acceptability for multiple stakeholders and organisational implementation potential to improve the genomic diagnosis process.https://informatics.bmj.com/content/28/1/e100331.full
collection DOAJ
language English
format Article
sources DOAJ
author Conner Jenkins
Troy Jenkins
Thomas N Person
Peter N Robinson
Alanna Kulchak Rahm
Nephi A Walton
Lynn K Feldman
Joeseph Peterson
Jonathon C Reynolds
Makenzie A Woltz
Marc S Williams
Michael M Segal
spellingShingle Conner Jenkins
Troy Jenkins
Thomas N Person
Peter N Robinson
Alanna Kulchak Rahm
Nephi A Walton
Lynn K Feldman
Joeseph Peterson
Jonathon C Reynolds
Makenzie A Woltz
Marc S Williams
Michael M Segal
User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis
BMJ Health & Care Informatics
author_facet Conner Jenkins
Troy Jenkins
Thomas N Person
Peter N Robinson
Alanna Kulchak Rahm
Nephi A Walton
Lynn K Feldman
Joeseph Peterson
Jonathon C Reynolds
Makenzie A Woltz
Marc S Williams
Michael M Segal
author_sort Conner Jenkins
title User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis
title_short User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis
title_full User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis
title_fullStr User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis
title_full_unstemmed User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis
title_sort user testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis
publisher BMJ Publishing Group
series BMJ Health & Care Informatics
issn 2632-1009
publishDate 2021-07-01
description Objectives There is a need in clinical genomics for systems that assist in clinical diagnosis, analysis of genomic information and periodic reanalysis of results, and can use information from the electronic health record to do so. Such systems should be built using the concepts of human-centred design, fit within clinical workflows and provide solutions to priority problems.Methods We adapted a commercially available diagnostic decision support system (DDSS) to use extracted findings from a patient record and combine them with genomic variant information in the DDSS interface. Three representative patient cases were created in a simulated clinical environment for user testing. A semistructured interview guide was created to illuminate factors relevant to human factors in CDS design and organisational implementation.Results Six individuals completed the user testing process. Tester responses were positive and noted good fit with real-world clinical genetics workflow. Technical issues related to interface, interaction and design were minor and fixable. Testers suggested solving issues related to terminology and usability through training and infobuttons. Time savings was estimated at 30%–50% and additional uses such as in-house clinical variant analysis were suggested for increase fit with workflow and to further address priority problems.Conclusion This study provides preliminary evidence for usability, workflow fit, acceptability and implementation potential of a modified DDSS that includes machine-assisted chart review. Continued development and testing using principles from human-centred design and implementation science are necessary to improve technical functionality and acceptability for multiple stakeholders and organisational implementation potential to improve the genomic diagnosis process.
url https://informatics.bmj.com/content/28/1/e100331.full
work_keys_str_mv AT connerjenkins usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
AT troyjenkins usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
AT thomasnperson usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
AT peternrobinson usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
AT alannakulchakrahm usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
AT nephiawalton usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
AT lynnkfeldman usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
AT joesephpeterson usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
AT jonathoncreynolds usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
AT makenzieawoltz usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
AT marcswilliams usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
AT michaelmsegal usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis
_version_ 1721246937701679104