Volume 43 - Article 50 | Pages 1461–1494
Evaluating interviewer manipulation in the new round of the Generations and Gender Survey
Date received: | 21 Aug 2019 |
Date published: | 04 Dec 2020 |
Word count: | 8480 |
Keywords: | data quality, Generations and Gender Survey (GGS), interviewer effects, retrospective histories, survey methods |
DOI: | 10.4054/DemRes.2020.43.50 |
Abstract
Background: Past research has criticized the quality of the Generations and Gender Survey retrospective fertility and partnership histories. For example, fatigue and learning effects were deemed responsible for distortions in the Generations and Gender Survey in Germany.
Objective: We assess the quality of the Generations and Gender Survey for Belarus (GGS-BL) in 2017 to assess whether the new centralized fieldwork system and monitoring procedures are effective in preventing distortions in life history data.
Methods: We conduct a range of analyses to find evidence of fatigue and learning effects on the part of both interviewers and respondents. Multilevel models, comparison of crucial indicators with other sources, and descriptive analysis of item-nonresponse are used.
Results: In a preliminary analysis, we find no evidence of severe distortions. An in-depth analysis into interviewer and respondent effects reveals some small signs of possible manipulation. However, when assessing the impact of anomalous interviewers on the indicators more likely to be affected, we find no evidence of harm to data quality.
Conclusions: The new data collection procedure adopted by the Generations and Gender Survey seems to be effective in preventing detectable manipulation and fabrication. Furthermore, we dismiss the hypothesis that fatigue and learning effects are a source of bias in the collection of life history data.
Contribution: This paper delivers three key messages: (1) the Generations and Gender Survey for Belarus is a reliable source for retrospective histories, (2) in-field checks are an effective tool to prevent fabrication, and (3) extensive use of inexperienced interviewers does not seem to harm data quality when adequate monitoring and monitoring is in place.
Author's Affiliation
Eugenio Paglino - University of Pennsylvania, United States of America
Tom Emery - Erasmus Universiteit Rotterdam, the Netherlands
Other articles by the same author/authors in Demographic Research
»
Generations and Gender Programme Wave 1 data collection: An overview and assessment of sampling and fieldwork methods, weighting procedures, and cross-sectional representativeness
Volume 34 - Article 18
»
Measuring intergenerational financial support: Analysis of two cross-national surveys
Volume 33 - Article 33
»
Intergenerational transfers and European families: Does the number of siblings matter?
Volume 29 - Article 10
Most recent similar articles in Demographic Research
»
Interviewer effects on patterns of nonresponse: Evaluating the impact on the reasons for contraceptive nonuse in the Indonesia and the Philippines DHS
Volume 39 - Article 14 | Keywords: data quality, interviewer effects
»
Quality of demographic data in GGS Wave 1
Volume 32 - Article 24 | Keywords: data quality, Generations and Gender Survey (GGS)
»
The Malawi Diffusion and Ideational Change Project 2004-06: Data collection, data quality, and analysis of attrition
Volume 20 - Article 21 | Keywords: data quality, interviewer effects
»
An Assessment of the KDICP and MDICP Data Quality: Interviewer Effects, Question Reliability and Sample Attrition
Special Collection 1 - Article 2 | Keywords: data quality, interviewer effects
»
Mexican mortality 1990‒2016: Comparison of unadjusted and adjusted estimates
Volume 44 - Article 30 | Keywords: data quality
Articles
Citations
Cited References: 30
»View the references of this article
Download to Citation Manager
Similar Articles
PubMed
Google Scholar