Volume 48 - Article 22 | Pages 609–640  

Better to ask online when it concerns intimate relationships? Survey mode differences in the assessment of relationship quality

By Almut Schumann, Detlev Lück

Abstract

Background: The assessment of relationship quality is a key construct in family research and relies on several indicators. As answer behavior for sensitive and subjective questions can be biased by the interview situation, the emerging switch from face-to-face mode to web or mixed mode in surveys challenges the comparability of measurements.

Objective: This study investigates the impact of two modes of data collection – face-to-face mode and web mode – on central measurements of relationship quality in quantitative family research.

Methods: In a German experimental pilot study (2018) within the Generations and Gender Programme, target persons were randomly assigned to face-to-face or online interviews. Mode differences are assessed by comparing distributions for various indicators of relationship quality. To adjust for confounders, post-stratification weighting and multivariate regression analysis are applied.

Results: Findings reveal consistent mode effects for almost all indicators of relationship quality even after adjusting for confounders. Respondents in web mode assess their relationship quality substantially lower than respondents in face-to-face mode, thinking more often about breaking up and reporting lower satisfaction and more conflicts.

Conclusions: Web mode seems to support less socially desirable reflections on respondents’ relationships compared to face-to-face mode. Family researchers should consider survey design decisions when evaluating intimate relationships, particularly in longitudinal and cross-national studies.

Contribution: Findings on the assessment of relationships in family research based on self-administered modes, such as web mode, can be considered more reliable than those based on interviewer-administered modes.

Author’s Affiliation

• Almut Schumann - Bundesinstitut für Bevölkerungsforschung (BiB), Germany EMAIL
• Detlev Lück - Bundesinstitut für Bevölkerungsforschung (BiB), Germany EMAIL

Most recent similar articles in Demographic Research

Sample selection bias in adult mortality estimates from mobile phone surveys: Evidence from 25 low- and middle-income countries
Volume 51 - Article 37    | Keywords: adult mortality, data collection, mobile phones, selection bias, sibling survival histories

International completeness of death registration
Volume 50 - Article 38    | Keywords: data collection, death, mortality, statistics, sustainable development goals, vital registration

Religion and contraceptive use in Kazakhstan: A study of mediating mechanisms
Volume 50 - Article 21    | Keywords: contraceptive use, Generations and Gender Programme (GGP), Kazakhstan, mediation, religion, religiosity

Measuring short-term mobility patterns in North America using Facebook advertising data, with an application to adjusting COVID-19 mortality rates
Volume 50 - Article 10    | Keywords: COVID-19, data collection, Facebook, mortality, North America, short-term mobility

Use of standard verbal autopsies to improve the mortality data capacity of civil registration and vital statistics systems in low- and middle-income countries: Analysis of key issues
Volume 49 - Article 10    | Keywords: CRVS systems, data collection, LMICs, mortality data, Nigeria, verbal autopsies