User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis
Objectives There is a need in clinical genomics for systems that assist in clinical diagnosis, analysis of genomic information and periodic reanalysis of results, and can use information from the electronic health record to do so. Such systems should be built using the concepts of human-centred desi...
Main Authors: | , , , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
BMJ Publishing Group
2021-07-01
|
Series: | BMJ Health & Care Informatics |
Online Access: | https://informatics.bmj.com/content/28/1/e100331.full |
id |
doaj-6f81dbb812864747af76481cc3b38917 |
---|---|
record_format |
Article |
spelling |
doaj-6f81dbb812864747af76481cc3b389172021-07-31T09:30:30ZengBMJ Publishing GroupBMJ Health & Care Informatics2632-10092021-07-0128110.1136/bmjhci-2021-100331User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosisConner Jenkins0Troy Jenkins1Thomas N Person2Peter N Robinson3Alanna Kulchak Rahm4Nephi A Walton5Lynn K Feldman6Joeseph Peterson7Jonathon C Reynolds8Makenzie A Woltz9Marc S Williams10Michael M Segal11University of Utah, Salt Lake City, Utah, USAUniversity of Utah, Salt Lake City, Utah, USAGenomic Medicine Institute, Geisinger Health System, Danville, Pennsylvania, USAJackson Laboratory for Genomic Medicine, Farmington, Connecticut, USAGenomic Medicine Institute, Geisinger Health System, Danville, Pennsylvania, USAIntermountain Precision Genomics, Intermountain Healthcare, St. George, Utah, USASimulConsult, Inc, Chestnut Hill, Massachusetts, USAUniversity of Utah, Salt Lake City, Utah, USAGenomic Medicine Institute, Geisinger Health System, Danville, Pennsylvania, USAGenomic Medicine Institute, Geisinger Health System, Danville, Pennsylvania, USAGenomic Medicine Institute, Geisinger Health System, Danville, Pennsylvania, USASimulConsult, Inc, Chestnut Hill, Massachusetts, USAObjectives There is a need in clinical genomics for systems that assist in clinical diagnosis, analysis of genomic information and periodic reanalysis of results, and can use information from the electronic health record to do so. Such systems should be built using the concepts of human-centred design, fit within clinical workflows and provide solutions to priority problems.Methods We adapted a commercially available diagnostic decision support system (DDSS) to use extracted findings from a patient record and combine them with genomic variant information in the DDSS interface. Three representative patient cases were created in a simulated clinical environment for user testing. A semistructured interview guide was created to illuminate factors relevant to human factors in CDS design and organisational implementation.Results Six individuals completed the user testing process. Tester responses were positive and noted good fit with real-world clinical genetics workflow. Technical issues related to interface, interaction and design were minor and fixable. Testers suggested solving issues related to terminology and usability through training and infobuttons. Time savings was estimated at 30%–50% and additional uses such as in-house clinical variant analysis were suggested for increase fit with workflow and to further address priority problems.Conclusion This study provides preliminary evidence for usability, workflow fit, acceptability and implementation potential of a modified DDSS that includes machine-assisted chart review. Continued development and testing using principles from human-centred design and implementation science are necessary to improve technical functionality and acceptability for multiple stakeholders and organisational implementation potential to improve the genomic diagnosis process.https://informatics.bmj.com/content/28/1/e100331.full |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Conner Jenkins Troy Jenkins Thomas N Person Peter N Robinson Alanna Kulchak Rahm Nephi A Walton Lynn K Feldman Joeseph Peterson Jonathon C Reynolds Makenzie A Woltz Marc S Williams Michael M Segal |
spellingShingle |
Conner Jenkins Troy Jenkins Thomas N Person Peter N Robinson Alanna Kulchak Rahm Nephi A Walton Lynn K Feldman Joeseph Peterson Jonathon C Reynolds Makenzie A Woltz Marc S Williams Michael M Segal User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis BMJ Health & Care Informatics |
author_facet |
Conner Jenkins Troy Jenkins Thomas N Person Peter N Robinson Alanna Kulchak Rahm Nephi A Walton Lynn K Feldman Joeseph Peterson Jonathon C Reynolds Makenzie A Woltz Marc S Williams Michael M Segal |
author_sort |
Conner Jenkins |
title |
User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis |
title_short |
User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis |
title_full |
User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis |
title_fullStr |
User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis |
title_full_unstemmed |
User testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis |
title_sort |
user testing of a diagnostic decision support system with machine-assisted chart review to facilitate clinical genomic diagnosis |
publisher |
BMJ Publishing Group |
series |
BMJ Health & Care Informatics |
issn |
2632-1009 |
publishDate |
2021-07-01 |
description |
Objectives There is a need in clinical genomics for systems that assist in clinical diagnosis, analysis of genomic information and periodic reanalysis of results, and can use information from the electronic health record to do so. Such systems should be built using the concepts of human-centred design, fit within clinical workflows and provide solutions to priority problems.Methods We adapted a commercially available diagnostic decision support system (DDSS) to use extracted findings from a patient record and combine them with genomic variant information in the DDSS interface. Three representative patient cases were created in a simulated clinical environment for user testing. A semistructured interview guide was created to illuminate factors relevant to human factors in CDS design and organisational implementation.Results Six individuals completed the user testing process. Tester responses were positive and noted good fit with real-world clinical genetics workflow. Technical issues related to interface, interaction and design were minor and fixable. Testers suggested solving issues related to terminology and usability through training and infobuttons. Time savings was estimated at 30%–50% and additional uses such as in-house clinical variant analysis were suggested for increase fit with workflow and to further address priority problems.Conclusion This study provides preliminary evidence for usability, workflow fit, acceptability and implementation potential of a modified DDSS that includes machine-assisted chart review. Continued development and testing using principles from human-centred design and implementation science are necessary to improve technical functionality and acceptability for multiple stakeholders and organisational implementation potential to improve the genomic diagnosis process. |
url |
https://informatics.bmj.com/content/28/1/e100331.full |
work_keys_str_mv |
AT connerjenkins usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis AT troyjenkins usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis AT thomasnperson usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis AT peternrobinson usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis AT alannakulchakrahm usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis AT nephiawalton usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis AT lynnkfeldman usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis AT joesephpeterson usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis AT jonathoncreynolds usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis AT makenzieawoltz usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis AT marcswilliams usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis AT michaelmsegal usertestingofadiagnosticdecisionsupportsystemwithmachineassistedchartreviewtofacilitateclinicalgenomicdiagnosis |
_version_ |
1721246937701679104 |