Probability-Sampling Approach to Editing

Editing for measurement errors is always part of data processing. In traditional editing, all data records are checked for errors and inconsistencies. In a new way of editing, only the subset with the most important erroneous responses is considered for editing. This approach is applied in selective...

Full description

Bibliographic Details
Main Authors: Maiki Ilves, Thomas Laitila
Format: Article
Language:English
Published: Austrian Statistical Society 2016-04-01
Series:Austrian Journal of Statistics
Online Access:http://www.ajs.or.at/index.php/ajs/article/view/270
id doaj-73ecd3756d16417db9ebb850bb99cfea
record_format Article
spelling doaj-73ecd3756d16417db9ebb850bb99cfea2021-04-22T12:34:18ZengAustrian Statistical SocietyAustrian Journal of Statistics1026-597X2016-04-0138310.17713/ajs.v38i3.270Probability-Sampling Approach to EditingMaiki Ilves0Thomas Laitila1Department of Statistics, Örebro University, SwedenDepartment of Statistics, Örebro University, Sweden Research and Development Department, Statistics SwedenEditing for measurement errors is always part of data processing. In traditional editing, all data records are checked for errors and inconsistencies. In a new way of editing, only the subset with the most important erroneous responses is considered for editing. This approach is applied in selective editing procedures, which have been shown to save resources considerably. However, selective editing lacks a probabilistic basis and the properties of estimators cannot be established using standard methods. In particular, bias properties of the estimator are unknown except for level estimates based on historical data. This paper proposes combining selective editing with an editing procedure based on the traditional probability-sampling framework. The variance of a bias-corrected Horvitz-Thompson estimator is derived and a variance estimator is proposed. The results of a simulation study support the use of the combined editing procedure.http://www.ajs.or.at/index.php/ajs/article/view/270
collection DOAJ
language English
format Article
sources DOAJ
author Maiki Ilves
Thomas Laitila
spellingShingle Maiki Ilves
Thomas Laitila
Probability-Sampling Approach to Editing
Austrian Journal of Statistics
author_facet Maiki Ilves
Thomas Laitila
author_sort Maiki Ilves
title Probability-Sampling Approach to Editing
title_short Probability-Sampling Approach to Editing
title_full Probability-Sampling Approach to Editing
title_fullStr Probability-Sampling Approach to Editing
title_full_unstemmed Probability-Sampling Approach to Editing
title_sort probability-sampling approach to editing
publisher Austrian Statistical Society
series Austrian Journal of Statistics
issn 1026-597X
publishDate 2016-04-01
description Editing for measurement errors is always part of data processing. In traditional editing, all data records are checked for errors and inconsistencies. In a new way of editing, only the subset with the most important erroneous responses is considered for editing. This approach is applied in selective editing procedures, which have been shown to save resources considerably. However, selective editing lacks a probabilistic basis and the properties of estimators cannot be established using standard methods. In particular, bias properties of the estimator are unknown except for level estimates based on historical data. This paper proposes combining selective editing with an editing procedure based on the traditional probability-sampling framework. The variance of a bias-corrected Horvitz-Thompson estimator is derived and a variance estimator is proposed. The results of a simulation study support the use of the combined editing procedure.
url http://www.ajs.or.at/index.php/ajs/article/view/270
work_keys_str_mv AT maikiilves probabilitysamplingapproachtoediting
AT thomaslaitila probabilitysamplingapproachtoediting
_version_ 1721514461115711488