A cross-validation of R-indicators as a measure of the risk of bias using data from a non-response follow-up survey

Details

Serval ID
serval:BIB_EA0D21AB221D
Type
Article: article from journal or magazin.
Collection
Publications
Institution
Title
A cross-validation of R-indicators as a measure of the risk of bias using data from a non-response follow-up survey
Journal
Journal of Official Statistics
Author(s)
Roberts C., Vandenplas C., Herzing J. M. E.
Publication state
Published
Issued date
28/07/2020
Peer-reviewed
Oui
Volume
36
Number
3
Pages
675–701
Language
english
Abstract
R-indicators are increasingly used as nonresponse bias indicators. However, their
effectiveness depends on the auxiliary data used in their estimation. Because of this, it is
not always clear for practitioners what the magnitude of the R-indicator implies for bias in
other survey variables, or how adjustment on auxiliary variables will affect it. In this article,
we investigate these potential limitations of R-indicators in a case study using data from the
Swiss European Social Survey (ESS5), which included a nonresponse follow-up (NRFU)
survey. First, we analyse correlations between estimated response propensities based on
auxiliary data from the register-based sampling frame, and responses to survey questions also
included in the NRFU. We then examine how these relate to bias detected by the NRFU,
before and after adjustment, and to predictions of the risk of bias provided by the R-indicator.
While the results lend support for the utility of R-indicators as summary statistics of bias risk,
they suggest a need for caution in their interpretation. Even where auxiliary variables are
correlated with target variables, more bias in the former (resulting in a larger R-indicator)
does not automatically imply more bias in the latter, nor does adjustment on the former
necessarily reduce bias in the latter.
Keywords
Nonresponse, R-indicator, propensity score weighting, nonresponse survey
Create date
17/12/2014 11:57
Last modification date
29/07/2020 6:22
Usage data