The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases
For newborn screening (NBS) of lysosomal storage diseases, programs measure enzymatic activities in dried blood spots (DBS) and, in most cases, act on samples where the measurement is below a specific cutoff value. The rate of false positives and negatives in any NBS program is of critical importanc...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2019-03-01
|
Series: | International Journal of Neonatal Screening |
Subjects: | |
Online Access: | https://www.mdpi.com/2409-515X/5/2/17 |
id |
doaj-ea8ed0f716bb4e218d43c1ebbf56aa83 |
---|---|
record_format |
Article |
spelling |
doaj-ea8ed0f716bb4e218d43c1ebbf56aa832020-11-25T00:35:37ZengMDPI AGInternational Journal of Neonatal Screening2409-515X2019-03-01521710.3390/ijns5020017ijns5020017The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage DiseasesBruce H. Robinson0Michael H. Gelb1Department of Chemistry, University of Washington, Seattle, WA 98195, USADepartment of Chemistry, University of Washington, Seattle, WA 98195, USAFor newborn screening (NBS) of lysosomal storage diseases, programs measure enzymatic activities in dried blood spots (DBS) and, in most cases, act on samples where the measurement is below a specific cutoff value. The rate of false positives and negatives in any NBS program is of critical importance. The measured values across a population of newborns are governed by many factors, and in this article we focus on assay imprecision. Assay parameters including the Analytical Range and the Z-Factor have been discussed as a way to compare assay performance for NBS of lysosomal storage diseases. Here we show that these parameters are not rigorously connected to the rate of false positives and negatives. Rather, it is the assay imprecision near the screen cutoff that is the most important parameter that determines the rate of false positives and negatives. We develop the theoretical treatment of assay imprecision and how it is linked to screen performance. What emerges is a useful type of parametric plot that allows for rigorous assessment of the effect of assay imprecision on the rate of false positives and false negatives that is independent of the choice of screen cutoff value. Such plots are useful in choosing cutoff values. They also show that a high assay imprecision cannot be overcome by changing the cutoff value or by use of postanalysis, statistical tools. Given the importance of assay imprecision near the cutoff, we propose that quality control DBS are most useful if they span a range of analyte values near the cutoff. Our treatment is also appropriate for comparing the performance of multiple assay platforms that each measure the same quantity (i.e., the enzymatic activity in DBS). The analysis shows that it is always best to use the assay platform that gives the lowest imprecision near the cutoff.https://www.mdpi.com/2409-515X/5/2/17newborn screeningcutoff valuesassay imprecisionfalse positivesfalse negativesscreening assays |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Bruce H. Robinson Michael H. Gelb |
spellingShingle |
Bruce H. Robinson Michael H. Gelb The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases International Journal of Neonatal Screening newborn screening cutoff values assay imprecision false positives false negatives screening assays |
author_facet |
Bruce H. Robinson Michael H. Gelb |
author_sort |
Bruce H. Robinson |
title |
The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases |
title_short |
The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases |
title_full |
The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases |
title_fullStr |
The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases |
title_full_unstemmed |
The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases |
title_sort |
importance of assay imprecision near the screen cutoff for newborn screening of lysosomal storage diseases |
publisher |
MDPI AG |
series |
International Journal of Neonatal Screening |
issn |
2409-515X |
publishDate |
2019-03-01 |
description |
For newborn screening (NBS) of lysosomal storage diseases, programs measure enzymatic activities in dried blood spots (DBS) and, in most cases, act on samples where the measurement is below a specific cutoff value. The rate of false positives and negatives in any NBS program is of critical importance. The measured values across a population of newborns are governed by many factors, and in this article we focus on assay imprecision. Assay parameters including the Analytical Range and the Z-Factor have been discussed as a way to compare assay performance for NBS of lysosomal storage diseases. Here we show that these parameters are not rigorously connected to the rate of false positives and negatives. Rather, it is the assay imprecision near the screen cutoff that is the most important parameter that determines the rate of false positives and negatives. We develop the theoretical treatment of assay imprecision and how it is linked to screen performance. What emerges is a useful type of parametric plot that allows for rigorous assessment of the effect of assay imprecision on the rate of false positives and false negatives that is independent of the choice of screen cutoff value. Such plots are useful in choosing cutoff values. They also show that a high assay imprecision cannot be overcome by changing the cutoff value or by use of postanalysis, statistical tools. Given the importance of assay imprecision near the cutoff, we propose that quality control DBS are most useful if they span a range of analyte values near the cutoff. Our treatment is also appropriate for comparing the performance of multiple assay platforms that each measure the same quantity (i.e., the enzymatic activity in DBS). The analysis shows that it is always best to use the assay platform that gives the lowest imprecision near the cutoff. |
topic |
newborn screening cutoff values assay imprecision false positives false negatives screening assays |
url |
https://www.mdpi.com/2409-515X/5/2/17 |
work_keys_str_mv |
AT brucehrobinson theimportanceofassayimprecisionnearthescreencutofffornewbornscreeningoflysosomalstoragediseases AT michaelhgelb theimportanceofassayimprecisionnearthescreencutofffornewbornscreeningoflysosomalstoragediseases AT brucehrobinson importanceofassayimprecisionnearthescreencutofffornewbornscreeningoflysosomalstoragediseases AT michaelhgelb importanceofassayimprecisionnearthescreencutofffornewbornscreeningoflysosomalstoragediseases |
_version_ |
1725308520633466880 |