The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases

For newborn screening (NBS) of lysosomal storage diseases, programs measure enzymatic activities in dried blood spots (DBS) and, in most cases, act on samples where the measurement is below a specific cutoff value. The rate of false positives and negatives in any NBS program is of critical importanc...

Full description

Bibliographic Details
Main Authors: Bruce H. Robinson, Michael H. Gelb
Format: Article
Language:English
Published: MDPI AG 2019-03-01
Series:International Journal of Neonatal Screening
Subjects:
Online Access:https://www.mdpi.com/2409-515X/5/2/17
id doaj-ea8ed0f716bb4e218d43c1ebbf56aa83
record_format Article
spelling doaj-ea8ed0f716bb4e218d43c1ebbf56aa832020-11-25T00:35:37ZengMDPI AGInternational Journal of Neonatal Screening2409-515X2019-03-01521710.3390/ijns5020017ijns5020017The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage DiseasesBruce H. Robinson0Michael H. Gelb1Department of Chemistry, University of Washington, Seattle, WA 98195, USADepartment of Chemistry, University of Washington, Seattle, WA 98195, USAFor newborn screening (NBS) of lysosomal storage diseases, programs measure enzymatic activities in dried blood spots (DBS) and, in most cases, act on samples where the measurement is below a specific cutoff value. The rate of false positives and negatives in any NBS program is of critical importance. The measured values across a population of newborns are governed by many factors, and in this article we focus on assay imprecision. Assay parameters including the Analytical Range and the Z-Factor have been discussed as a way to compare assay performance for NBS of lysosomal storage diseases. Here we show that these parameters are not rigorously connected to the rate of false positives and negatives. Rather, it is the assay imprecision near the screen cutoff that is the most important parameter that determines the rate of false positives and negatives. We develop the theoretical treatment of assay imprecision and how it is linked to screen performance. What emerges is a useful type of parametric plot that allows for rigorous assessment of the effect of assay imprecision on the rate of false positives and false negatives that is independent of the choice of screen cutoff value. Such plots are useful in choosing cutoff values. They also show that a high assay imprecision cannot be overcome by changing the cutoff value or by use of postanalysis, statistical tools. Given the importance of assay imprecision near the cutoff, we propose that quality control DBS are most useful if they span a range of analyte values near the cutoff. Our treatment is also appropriate for comparing the performance of multiple assay platforms that each measure the same quantity (i.e., the enzymatic activity in DBS). The analysis shows that it is always best to use the assay platform that gives the lowest imprecision near the cutoff.https://www.mdpi.com/2409-515X/5/2/17newborn screeningcutoff valuesassay imprecisionfalse positivesfalse negativesscreening assays
collection DOAJ
language English
format Article
sources DOAJ
author Bruce H. Robinson
Michael H. Gelb
spellingShingle Bruce H. Robinson
Michael H. Gelb
The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases
International Journal of Neonatal Screening
newborn screening
cutoff values
assay imprecision
false positives
false negatives
screening assays
author_facet Bruce H. Robinson
Michael H. Gelb
author_sort Bruce H. Robinson
title The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases
title_short The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases
title_full The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases
title_fullStr The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases
title_full_unstemmed The Importance of Assay Imprecision near the Screen Cutoff for Newborn Screening of Lysosomal Storage Diseases
title_sort importance of assay imprecision near the screen cutoff for newborn screening of lysosomal storage diseases
publisher MDPI AG
series International Journal of Neonatal Screening
issn 2409-515X
publishDate 2019-03-01
description For newborn screening (NBS) of lysosomal storage diseases, programs measure enzymatic activities in dried blood spots (DBS) and, in most cases, act on samples where the measurement is below a specific cutoff value. The rate of false positives and negatives in any NBS program is of critical importance. The measured values across a population of newborns are governed by many factors, and in this article we focus on assay imprecision. Assay parameters including the Analytical Range and the Z-Factor have been discussed as a way to compare assay performance for NBS of lysosomal storage diseases. Here we show that these parameters are not rigorously connected to the rate of false positives and negatives. Rather, it is the assay imprecision near the screen cutoff that is the most important parameter that determines the rate of false positives and negatives. We develop the theoretical treatment of assay imprecision and how it is linked to screen performance. What emerges is a useful type of parametric plot that allows for rigorous assessment of the effect of assay imprecision on the rate of false positives and false negatives that is independent of the choice of screen cutoff value. Such plots are useful in choosing cutoff values. They also show that a high assay imprecision cannot be overcome by changing the cutoff value or by use of postanalysis, statistical tools. Given the importance of assay imprecision near the cutoff, we propose that quality control DBS are most useful if they span a range of analyte values near the cutoff. Our treatment is also appropriate for comparing the performance of multiple assay platforms that each measure the same quantity (i.e., the enzymatic activity in DBS). The analysis shows that it is always best to use the assay platform that gives the lowest imprecision near the cutoff.
topic newborn screening
cutoff values
assay imprecision
false positives
false negatives
screening assays
url https://www.mdpi.com/2409-515X/5/2/17
work_keys_str_mv AT brucehrobinson theimportanceofassayimprecisionnearthescreencutofffornewbornscreeningoflysosomalstoragediseases
AT michaelhgelb theimportanceofassayimprecisionnearthescreencutofffornewbornscreeningoflysosomalstoragediseases
AT brucehrobinson importanceofassayimprecisionnearthescreencutofffornewbornscreeningoflysosomalstoragediseases
AT michaelhgelb importanceofassayimprecisionnearthescreencutofffornewbornscreeningoflysosomalstoragediseases
_version_ 1725308520633466880