Unstable Inferences? An Examination of Complex Survey Sample Design Adjustments Using the Current Population Survey for Health Services Research
Statistical analysis of the Current Population Survey's Annual Social and Economic Supplement is used widely in health services research. However, the statistical evidence cited from the Current Population Survey (CPS) is not always consistent because researchers use a variety of methods to pro...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
SAGE Publishing
2006-08-01
|
Series: | Inquiry: The Journal of Health Care Organization, Provision, and Financing |
Online Access: | https://doi.org/10.5034/inquiryjrnl_43.3.283 |
id |
doaj-4d4f7d90160c4278a548cfa52389f304 |
---|---|
record_format |
Article |
spelling |
doaj-4d4f7d90160c4278a548cfa52389f3042020-11-25T03:16:17ZengSAGE PublishingInquiry: The Journal of Health Care Organization, Provision, and Financing0046-95802006-08-014310.5034/inquiryjrnl_43.3.283Unstable Inferences? An Examination of Complex Survey Sample Design Adjustments Using the Current Population Survey for Health Services ResearchMichael DavernArthur JonesJames LepkowskiGestur DavidsonLynn A. BlewettStatistical analysis of the Current Population Survey's Annual Social and Economic Supplement is used widely in health services research. However, the statistical evidence cited from the Current Population Survey (CPS) is not always consistent because researchers use a variety of methods to produce standard errors that are fundamental to significance tests. This analysis examines the 2002 Annual Social and Economic Supplement's (ASEC) estimates of national and state average income, national and state poverty rates, and national and state health insurance coverage rates. Findings show that the standard error estimates derived from the public use CPS data perform poorly compared with the survey design-based estimates derived from restricted internal data, and that the generalized variance parameters currently used by the U.S. Census Bureau in its ASEC reports and funding formula inputs perform erratically. Because the majority of published research (both by academics and Census Bureau analysts) does not make use of the survey design-based information available only on the internal ASEC data file, we argue that the Census Bureau ought to use alternative methods for its official ASEC reports. We also argue that for public use data the Census Bureau should produce a set of replicate weights for the ASEC or release a set of sample design variables that incorporate statistical “noise” to maintain respondent confidentiality (e.g., pseudo-primary sampling units) as other federal government surveys do. This is essential to make appropriate inferences using the ASEC data regarding statistical significance and estimate variance for health policy analysis.https://doi.org/10.5034/inquiryjrnl_43.3.283 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Michael Davern Arthur Jones James Lepkowski Gestur Davidson Lynn A. Blewett |
spellingShingle |
Michael Davern Arthur Jones James Lepkowski Gestur Davidson Lynn A. Blewett Unstable Inferences? An Examination of Complex Survey Sample Design Adjustments Using the Current Population Survey for Health Services Research Inquiry: The Journal of Health Care Organization, Provision, and Financing |
author_facet |
Michael Davern Arthur Jones James Lepkowski Gestur Davidson Lynn A. Blewett |
author_sort |
Michael Davern |
title |
Unstable Inferences? An Examination of Complex Survey Sample Design Adjustments Using the Current Population Survey for Health Services Research |
title_short |
Unstable Inferences? An Examination of Complex Survey Sample Design Adjustments Using the Current Population Survey for Health Services Research |
title_full |
Unstable Inferences? An Examination of Complex Survey Sample Design Adjustments Using the Current Population Survey for Health Services Research |
title_fullStr |
Unstable Inferences? An Examination of Complex Survey Sample Design Adjustments Using the Current Population Survey for Health Services Research |
title_full_unstemmed |
Unstable Inferences? An Examination of Complex Survey Sample Design Adjustments Using the Current Population Survey for Health Services Research |
title_sort |
unstable inferences? an examination of complex survey sample design adjustments using the current population survey for health services research |
publisher |
SAGE Publishing |
series |
Inquiry: The Journal of Health Care Organization, Provision, and Financing |
issn |
0046-9580 |
publishDate |
2006-08-01 |
description |
Statistical analysis of the Current Population Survey's Annual Social and Economic Supplement is used widely in health services research. However, the statistical evidence cited from the Current Population Survey (CPS) is not always consistent because researchers use a variety of methods to produce standard errors that are fundamental to significance tests. This analysis examines the 2002 Annual Social and Economic Supplement's (ASEC) estimates of national and state average income, national and state poverty rates, and national and state health insurance coverage rates. Findings show that the standard error estimates derived from the public use CPS data perform poorly compared with the survey design-based estimates derived from restricted internal data, and that the generalized variance parameters currently used by the U.S. Census Bureau in its ASEC reports and funding formula inputs perform erratically. Because the majority of published research (both by academics and Census Bureau analysts) does not make use of the survey design-based information available only on the internal ASEC data file, we argue that the Census Bureau ought to use alternative methods for its official ASEC reports. We also argue that for public use data the Census Bureau should produce a set of replicate weights for the ASEC or release a set of sample design variables that incorporate statistical “noise” to maintain respondent confidentiality (e.g., pseudo-primary sampling units) as other federal government surveys do. This is essential to make appropriate inferences using the ASEC data regarding statistical significance and estimate variance for health policy analysis. |
url |
https://doi.org/10.5034/inquiryjrnl_43.3.283 |
work_keys_str_mv |
AT michaeldavern unstableinferencesanexaminationofcomplexsurveysampledesignadjustmentsusingthecurrentpopulationsurveyforhealthservicesresearch AT arthurjones unstableinferencesanexaminationofcomplexsurveysampledesignadjustmentsusingthecurrentpopulationsurveyforhealthservicesresearch AT jameslepkowski unstableinferencesanexaminationofcomplexsurveysampledesignadjustmentsusingthecurrentpopulationsurveyforhealthservicesresearch AT gesturdavidson unstableinferencesanexaminationofcomplexsurveysampledesignadjustmentsusingthecurrentpopulationsurveyforhealthservicesresearch AT lynnablewett unstableinferencesanexaminationofcomplexsurveysampledesignadjustmentsusingthecurrentpopulationsurveyforhealthservicesresearch |
_version_ |
1724637112351850496 |