Validity of Survey Response Propensity Indicators: A Behavior Genetics Approach

Published

Validity of Survey Response Propensity Indicators: A Behavior Genetics Approach
Levente Littvay, Sebastian Adrian Popa and Zoltán Fazekas

Social Science Quarterly
Volume 94, Issue 2, pages 569–589, June 2013

DOI: 10.1111/j.1540-6237.2012.00938.x (Article first published online: 13 December 2012)

Abstract:
Objectives - This study explains how behavior genetic analysis using a twin design can help us assess the validity of our measures.
Methods - We test multiple indicators of response propensity, a measure used by survey researchers to better understand the similarities and differences between survey respondents and nonrespondents. The response propensity indicators evaluated include response to follow-up surveys and subsequent waves of a panel and the completion of a sensitive recontact information sheet to aid subsequent recontact efforts.
Results - A classical and the newly proposed method of validation all point to insufficient validity of our response propensity measures. Construct validation using data from the National Survey of Midlife Development in the United States exhibited little correlation between indicators. Genetic analysis suggests that the success of subsequent data-collection efforts is predominantly driven by additive genetic effects, while nonresponse to inquiries for recontact information is influenced predominantly by familial environmental predictors.
Conclusion - Our results indicate that different underlying constructs drive the response propensity indicators, suggesting that nonresponse is, at minimum, multidimensional.