Contextual property detection in Dutch diagnosis descriptions for uncertainty, laterality and temporality

Abstract Background Accurate, coded problem lists are valuable for data reuse, including clinical decision support and research. However, healthcare providers frequently modify coded diagnoses by including or removing common contextual properties in free-text diagnosis descriptions: uncertainty (sus...

Full description

Bibliographic Details
Main Authors: Eva S. Klappe, Florentien J. P. van Putten, Nicolette F. de Keizer, Ronald Cornet
Format: Article
Language:English
Published: BMC 2021-04-01
Series:BMC Medical Informatics and Decision Making
Subjects:
Online Access:https://doi.org/10.1186/s12911-021-01477-y
id doaj-5e1c1ba7701044a891a9cfcec3314f59
record_format Article
spelling doaj-5e1c1ba7701044a891a9cfcec3314f592021-04-11T11:38:09ZengBMCBMC Medical Informatics and Decision Making1472-69472021-04-0121111710.1186/s12911-021-01477-yContextual property detection in Dutch diagnosis descriptions for uncertainty, laterality and temporalityEva S. Klappe0Florentien J. P. van Putten1Nicolette F. de Keizer2Ronald Cornet3Department of Medical Informatics, Amsterdam Public Health Research Institute, Amsterdam UMC, University of AmsterdamDepartment of Medical Informatics, Amsterdam Public Health Research Institute, Amsterdam UMC, University of AmsterdamDepartment of Medical Informatics, Amsterdam Public Health Research Institute, Amsterdam UMC, University of AmsterdamDepartment of Medical Informatics, Amsterdam Public Health Research Institute, Amsterdam UMC, University of AmsterdamAbstract Background Accurate, coded problem lists are valuable for data reuse, including clinical decision support and research. However, healthcare providers frequently modify coded diagnoses by including or removing common contextual properties in free-text diagnosis descriptions: uncertainty (suspected glaucoma), laterality (left glaucoma) and temporality (glaucoma 2002). These contextual properties could cause a difference in meaning between underlying diagnosis codes and modified descriptions, inhibiting data reuse. We therefore aimed to develop and evaluate an algorithm to identify these contextual properties. Methods A rule-based algorithm called UnLaTem (Uncertainty, Laterality, Temporality) was developed using a single-center dataset, including 288,935 diagnosis descriptions, of which 73,280 (25.4%) were modified by healthcare providers. Internal validation of the algorithm was conducted with an independent sample of 980 unique records. A second validation of the algorithm was conducted with 996 records from a Dutch multicenter dataset including 175,210 modified descriptions of five hospitals. Two researchers independently annotated the two validation samples. Performance of the algorithm was determined using means of the recall and precision of the validation samples. The algorithm was applied to the multicenter dataset to determine the actual prevalence of the contextual properties within the modified descriptions per specialty. Results For the single-center dataset recall (and precision) for removal of uncertainty, uncertainty, laterality and temporality respectively were 100 (60.0), 99.1 (89.9), 100 (97.3) and 97.6 (97.6). For the multicenter dataset for removal of uncertainty, uncertainty, laterality and temporality it was 57.1 (88.9), 86.3 (88.9), 99.7 (93.5) and 96.8 (90.1). Within the modified descriptions of the multicenter dataset, 1.3% contained removal of uncertainty, 9.9% uncertainty, 31.4% laterality and 9.8% temporality. Conclusions We successfully developed a rule-based algorithm named UnLaTem to identify contextual properties in Dutch modified diagnosis descriptions. UnLaTem could be extended with more trigger terms, new rules and the recognition of term order to increase the performance even further. The algorithm’s rules are available as additional file 2. Implementing UnLaTem in Dutch hospital systems can improve precision of information retrieval and extraction from diagnosis descriptions, which can be used for data reuse purposes such as decision support and research.https://doi.org/10.1186/s12911-021-01477-yElectronic health recordProblem listProblem-oriented medical recordRule-based algorithm developmentSingle-center and multicenter validationReuse of clinical data
collection DOAJ
language English
format Article
sources DOAJ
author Eva S. Klappe
Florentien J. P. van Putten
Nicolette F. de Keizer
Ronald Cornet
spellingShingle Eva S. Klappe
Florentien J. P. van Putten
Nicolette F. de Keizer
Ronald Cornet
Contextual property detection in Dutch diagnosis descriptions for uncertainty, laterality and temporality
BMC Medical Informatics and Decision Making
Electronic health record
Problem list
Problem-oriented medical record
Rule-based algorithm development
Single-center and multicenter validation
Reuse of clinical data
author_facet Eva S. Klappe
Florentien J. P. van Putten
Nicolette F. de Keizer
Ronald Cornet
author_sort Eva S. Klappe
title Contextual property detection in Dutch diagnosis descriptions for uncertainty, laterality and temporality
title_short Contextual property detection in Dutch diagnosis descriptions for uncertainty, laterality and temporality
title_full Contextual property detection in Dutch diagnosis descriptions for uncertainty, laterality and temporality
title_fullStr Contextual property detection in Dutch diagnosis descriptions for uncertainty, laterality and temporality
title_full_unstemmed Contextual property detection in Dutch diagnosis descriptions for uncertainty, laterality and temporality
title_sort contextual property detection in dutch diagnosis descriptions for uncertainty, laterality and temporality
publisher BMC
series BMC Medical Informatics and Decision Making
issn 1472-6947
publishDate 2021-04-01
description Abstract Background Accurate, coded problem lists are valuable for data reuse, including clinical decision support and research. However, healthcare providers frequently modify coded diagnoses by including or removing common contextual properties in free-text diagnosis descriptions: uncertainty (suspected glaucoma), laterality (left glaucoma) and temporality (glaucoma 2002). These contextual properties could cause a difference in meaning between underlying diagnosis codes and modified descriptions, inhibiting data reuse. We therefore aimed to develop and evaluate an algorithm to identify these contextual properties. Methods A rule-based algorithm called UnLaTem (Uncertainty, Laterality, Temporality) was developed using a single-center dataset, including 288,935 diagnosis descriptions, of which 73,280 (25.4%) were modified by healthcare providers. Internal validation of the algorithm was conducted with an independent sample of 980 unique records. A second validation of the algorithm was conducted with 996 records from a Dutch multicenter dataset including 175,210 modified descriptions of five hospitals. Two researchers independently annotated the two validation samples. Performance of the algorithm was determined using means of the recall and precision of the validation samples. The algorithm was applied to the multicenter dataset to determine the actual prevalence of the contextual properties within the modified descriptions per specialty. Results For the single-center dataset recall (and precision) for removal of uncertainty, uncertainty, laterality and temporality respectively were 100 (60.0), 99.1 (89.9), 100 (97.3) and 97.6 (97.6). For the multicenter dataset for removal of uncertainty, uncertainty, laterality and temporality it was 57.1 (88.9), 86.3 (88.9), 99.7 (93.5) and 96.8 (90.1). Within the modified descriptions of the multicenter dataset, 1.3% contained removal of uncertainty, 9.9% uncertainty, 31.4% laterality and 9.8% temporality. Conclusions We successfully developed a rule-based algorithm named UnLaTem to identify contextual properties in Dutch modified diagnosis descriptions. UnLaTem could be extended with more trigger terms, new rules and the recognition of term order to increase the performance even further. The algorithm’s rules are available as additional file 2. Implementing UnLaTem in Dutch hospital systems can improve precision of information retrieval and extraction from diagnosis descriptions, which can be used for data reuse purposes such as decision support and research.
topic Electronic health record
Problem list
Problem-oriented medical record
Rule-based algorithm development
Single-center and multicenter validation
Reuse of clinical data
url https://doi.org/10.1186/s12911-021-01477-y
work_keys_str_mv AT evasklappe contextualpropertydetectionindutchdiagnosisdescriptionsforuncertaintylateralityandtemporality
AT florentienjpvanputten contextualpropertydetectionindutchdiagnosisdescriptionsforuncertaintylateralityandtemporality
AT nicolettefdekeizer contextualpropertydetectionindutchdiagnosisdescriptionsforuncertaintylateralityandtemporality
AT ronaldcornet contextualpropertydetectionindutchdiagnosisdescriptionsforuncertaintylateralityandtemporality
_version_ 1721530803144359936