Volume 43 - Article 50 | Pages 1461–1494  

Evaluating interviewer manipulation in the new round of the Generations and Gender Survey

By Eugenio Paglino, Tom Emery

Abstract

Background: Past research has criticized the quality of the Generations and Gender Survey retrospective fertility and partnership histories. For example, fatigue and learning effects were deemed responsible for distortions in the Generations and Gender Survey in Germany.

Objective: We assess the quality of the Generations and Gender Survey for Belarus (GGS-BL) in 2017 to assess whether the new centralized fieldwork system and monitoring procedures are effective in preventing distortions in life history data.

Methods: We conduct a range of analyses to find evidence of fatigue and learning effects on the part of both interviewers and respondents. Multilevel models, comparison of crucial indicators with other sources, and descriptive analysis of item-nonresponse are used.

Results: In a preliminary analysis, we find no evidence of severe distortions. An in-depth analysis into interviewer and respondent effects reveals some small signs of possible manipulation. However, when assessing the impact of anomalous interviewers on the indicators more likely to be affected, we find no evidence of harm to data quality.

Conclusions: The new data collection procedure adopted by the Generations and Gender Survey seems to be effective in preventing detectable manipulation and fabrication. Furthermore, we dismiss the hypothesis that fatigue and learning effects are a source of bias in the collection of life history data.

Contribution: This paper delivers three key messages: (1) the Generations and Gender Survey for Belarus is a reliable source for retrospective histories, (2) in-field checks are an effective tool to prevent fabrication, and (3) extensive use of inexperienced interviewers does not seem to harm data quality when adequate monitoring and monitoring is in place.

Author’s Affiliation

• Eugenio Paglino - Helsingin Yliopisto (University of Helsinki), Finland EMAIL
• Tom Emery - Erasmus Universiteit Rotterdam, the Netherlands EMAIL

Other articles by the same author/authors in Demographic Research

Immigrant mortality advantage in the United States during the first year of the COVID-19 pandemic
Volume 50 - Article 7

Generations and Gender Programme Wave 1 data collection: An overview and assessment of sampling and fieldwork methods, weighting procedures, and cross-sectional representativeness
Volume 34 - Article 18

Measuring intergenerational financial support: Analysis of two cross-national surveys
Volume 33 - Article 33

Intergenerational transfers and European families: Does the number of siblings matter?
Volume 29 - Article 10

Most recent similar articles in Demographic Research

The use of mobile phone surveys for rapid mortality monitoring: A national study in Burkina Faso
Volume 52 - Article 16    | Keywords: age-specific mortality patterns, data quality, Demographic Health Surveys, direct estimation, health and security crises, low-and-middle-income countries, mobile phones, mortality, sample selection, surveys, under-five mortality

Studying multiple causes of death through verbal autopsies: Contribution of an index of similarity
Volume 52 - Article 8    | Keywords: causes of death, data quality, LMICs, multimorbidity, multiple causes of death, verbal autopsies

Using online genealogical data for demographic research: An empirical examination of the FamiLinx database
Volume 51 - Article 41    | Keywords: completeness, data quality, digital data, FamiLinx, genealogies, kinship network

Using household death questions from surveys to assess adult mortality in periods of health crisis: An application for Peru, 2018–2022
Volume 51 - Article 8    | Keywords: adult mortality, data quality, household surveys, Peru

Gone and forgotten? Predictors of birth history omissions in India
Volume 50 - Article 32    | Keywords: fertility history, interviewer effects, interviewer observations, measurement error, missing data, panel data, survey methodology