Volume 48 - Article 22 | Pages 609–640
Better to ask online when it concerns intimate relationships? Survey mode differences in the assessment of relationship quality
By Almut Schumann, Detlev Lück
References
AAPOR (2016). The American Association for Public Opinion Research Survey Outcome Rate Calculator 4.1 [electronic resource].
Aquilino, W.S. (1991). Telephone versus face-to-face interviewing for household drug use surveys. International Journal of the Addictions 27(1): 71‒91.
Arránz-Becker, O. (2013). Effects of similarity of life goals, values, and personality on relationship satisfaction and stability: Findings from a two-wave panel study. Personal Relationships 20: 443‒461.
Atkeson, L., Adams, A., and Alvarez, R. (2014). Nonresponse and mode effects in self- and interviewer-administered surveys. Political Analysis 22(3): 304‒320.
Bethlehem, J. and Biffignandi, S. (2012). Handbook of web surveys. Hoboken: Wiley.
Bethlehem, J. and Stoop, I. (eds.) (2007). Online panels – A paradigm theft? Berkeley: Association for Survey Computing (Proceedings of the Fifth ASC International Conference. University of Southampton, 12‒14 September 2007).
Beullens, K., Loosveldt, G., Vandenplas, C., and Stoop, I. (2018). Response rates in the European Social Survey: Increasing, decreasing, or a matter of fieldwork efforts? Survey Methods: Insights from the Field.
Bradbury, T.N., Fincham, F.D., and Beach, S.R.H. (2000). Research on the nature and determinants of marital satisfaction: A decade in review. Journal of Marriage and the Family 62(4): 964‒980.
Braekman, E., Charafeddine, R., Demarest, S., Drieskens, S., Berete, F., Gisle, L., Heyden, J., and Van Hal, G. (2020). Comparing web-based versus face-to-face and paper-and-pencil questionnaire data collected through two Belgian health surveys. International Journal of Public Health 65: 5‒16.
Burkill, S., Copas, A., Couper, M.P., Clifton, S., Prah, P., Datta, J., Conrad, F., Wellings, K., Johnson, A.M., and Erens, B. (2016). Using the web to collect data on sensitive behaviours: A study looking at mode effects on the British National Survey of Sexual Attitudes and Lifestyles. PLoS ONE 11(2): 1‒12.
Callegaro, M. (2008). Social desirability. In: Lavrakas, P.J. (ed.). Encyclopedia of survey research methods. Thousand Oaks: Sage: 825‒826.
Chang, L. and Krosnick, J.A. (2010). Comparing oral interviewing with self-administered computerized questionnaires: An experiment. Public Opinion Quarterly 74(1): 154‒167.
Christensen, A.I., Ekholm, O., Glümer, C., and Juel, K. (2013). Effect of survey mode on response patterns: Comparison of face-to-face and self-administered modes in health surveys. European Journal of Public Health 24(2): 327‒332.
Couper, M.P. (2011). The future of modes of data collection. Public Opinion Quarterly 75(5): 889‒908.
Couper, M.P., Antoun, C., and Mavletova, A. (2017). Mobile web surveys. In: Biemer, P.P., De Leeuw, E.D., Eckman, S., Edwards, B., Kreuter, F., Lyberg, L.E., Tucker, N.C., and West, B.T. (eds.). Total survey error in practice. New Jersey: Wiley: 133-150.
Daikeler, J., Bošnjak, M., and Manfreda, K.L. (2020). Web versus other survey modes: An updated and extended meta-analysis comparing response rates. Journal of Survey Statistics and Methodology 8(3): 513–539.
Davis, R.E., Couper, M.P., Janz, N.K., Caldwell, C.H., and Resnicow, K. (2010). Interviewer effects in public health surveys. Health Education Research 25(1): 14–26.
De Leeuw, E.D., Hox, J., and Dillman, D. (2008). International handbook of survey methodology. New York: Psychology Press.
DeMaio, T.J. (1984). Social desirability and survey measurement: A review. In: Turner, C.F. and Martin, E. (eds.). Surveying subjective phenomena 2. New York: Russel Sage Foundation: 257‒282.
Emery, T., Cabaço, S., Lugtig, P., Toepoel, V., Lück, D., Naderi, R., Bujard, M., and Schumann, A. (2018). The Generations and Gender Programme: Evaluate, plan, initiate. Deliverable 2.1: GGP Technical Case and E-Needs.
Fincham, F.D. and Beach, S.R.H. (2006). Relationship satisfaction. In: Vangelisti, A.L. and Perlman, D. (eds.). The Cambridge handbook of personal relationships. Cambridge: Cambridge University Press: 579‒594.
Fu, H., Darroch, J.E., Henshaw, S.K., and Kolb, E. (1998). Measuring the extent of abortion underreporting in the 1995 National Survey of Family Growth. Family Planning Perspectives 30(3): 128‒138.
Gauthier, A.H., Cabaço, S.L.F., and Emery, T. (2018). Generations and Gender Survey study profile. Longitudinal and Life Course Studies 9(4): 456‒465.
Groves, R.M., Fowler, F.J., Couper, M.P., Lepkowski, J.M., Singer, E., and Tourangeau, R. (2004). Survey methodology. New Jersey: Wiley.
Gummer, T., Höhne, J.K., Rettig, T., Roßmann, J., and Kummerow, M. (2023). Is there a growing use of mobile devices in web surveys? Evidence from 128 web surveys in Germany. Quality and Quantity .
Gummer, T., Schmiedeberg, C., Bujard, M., Christmann, P., Hank, K., Kunz, T., Lück, D., and Neyer, F.J. (2020). The impact of COVID-19 on fieldwork efforts and planning in pairfam and FReDA-GGS. Survey, Research, Methods 14(2): 223‒227.
Gustavson, K., Nilsen, W., Ørstavik, R., and Røysamb, E. (2013). Relationship quality, divorce, and well-being: Findings from a three-year longitudinal study. The Journal of Positive Psychology 9(2): 163‒174.
Heerwegh, D. (2009). Mode differences between face-to-face and web-surveys: An experimental investigation of data quality and social desirability effects. International Journal of Public Opinion Research 21(1): 111‒121.
Heerwegh, D. and Loosfeldt, G. (2008). Face-to-face versus web surveying in a high-internet-coverage population: Differences in response quality. Public Opinion Quarterly 72(5): 836‒846.
Holbrook, A.L., Green, M.C., and Krosnick, J.A. (2003). Telephone versus face-to-face interviewing of national probability samples with long questionnaires. Public Opinion Quarterly 67(1): 79‒125.
Huß, B. and Pollmann-Schult, M. (2020). Relationship satisfaction across the transition to parenthood: The impact of conflict behavior. Journal of Family Issues 41(3): 383‒411.
Kalmijn, M. (2021). Are national family surveys biased toward the happy family? A multi-actor analysis of selective survey nonresponse. Sociological Methods and Research online first .
Kantar Public (2018). Beziehungen und Familienleben in Deutschland (pairfam). Kantar Public, Methodenbericht Welle 10(2017/2018).
Karney, B.R. and Bradbury, T.N. (2020). Research on marital satisfaction and stability in the 2010s: Challenging conventional wisdom. Journal of Marriage and Family 82(1): 100‒116.
Karney, B.R. and Bradbury, T.N. (1995). The longitudinal course of marital quality and stability. Psychological Bulletin 118(1): 3‒34.
Kelly, C.A., Soler-Hampejsek, E., Mensch, B.S., and Hewett, P.C. (2013). Social desirability bias in sexual behavior reporting: Evidence from an interview mode experiment in rural Malawi. International Perspectives on Sexual and Reproductive Health 39(1): 14‒21.
Kluwer, E.S. and Johnson, M.D. (2007). Conflict frequency and relationship quality across the transition to parenthood. Journal of Marriage and Family 69(5): 1089‒1106.
Kreuter, F., Presser, S., and Tourangeau, R. (2008). Social desirability bias in CATI, IVR, and web surveys. The effects of mode and question sensitivity. Public Opinion Quarterly 72(5): 847‒865.
Krumpal, I. (2013). Determinants of social desirability bias in sensitive surveys: A literature review. Quality Quantity 47: 2025‒2047.
Lee, R.M. and Renzetti, C.M. (1990). The problems of researching sensitive topics: An overview and introduction. American Behavioral Scientist 33(5): 510‒528.
Lewis, R.A. and Spanier, G.B. (1979). Theorizing about the quality and stability of marriage. In: Burr, W.R., Hill, R.F., Nye, I., and Reiss, I.L. (eds.). Contemporary theories about the family. New York: Free Press: 268‒293.
Liu, M. (2017). Data collection mode differences between national face-to-face and web surveys on gender inequality and discrimination questions. Women’s Studies International Forum 60: 11‒16.
Liu, M. and Stainback, K. (2013). Interviewer gender effects on survey responses to marriage-related questions. Public Opinion Quarterly 77(2): 606‒618.
Liu, M. and Wang, Y. (2016). Comparison of face-to- face and web surveys on the topic of homosexual rights. Journal of Homosexuality 63(6): 838‒854.
Lugtig, P., Toepoel, V., Emery, T., Cabaço, S.L.F., Bujard, M., Naderi, R., Schumann, A., and Lück, D. (2022). Can we successfully move a cross-national survey online? Results from a large three-country experiment in the Gender and Generations Programme Survey. SocArXiv.
Medway, R. (2012). Beyond response rates: The effect of prepaid incentives on measurement error. Maryland: University of Maryland.
Rijken, A.J. and Liefbroer, A.C. (2009). The influence of partner relationship quality on fertility. European Journal of Population 25: 27–44.
Robertson, R.E., Tran, F.W., Lewark, L.N., and Epstein, R. (2018). Estimates of non-heterosexual prevalence: The roles of anonymity and privacy in survey methodology. Archive of Sexual Behavior 47: 1069–1084.
Schmid, L., Wörn, J., Hank, K., Sawatzki, B., and Walper, S. (2021). Changes in employment and relationship satisfaction in times of the COVID-19 pandemic: Evidence from the German family Panel. European Societies 23 23(sup1: European Societies in the Time of the Coronavirus Crisis): 743‒758.
Schonlau, M. and Couper, M.P. (2017). Options for conducting web surveys. Statistical Science 32(2): 279‒292.
Schonlau, M., Soest, A., and Kapteyn, A. (2007). Are ‘Webographic’ or attitudinal questions useful for adjusting estimates from web surveys using propensity scoring? Survey Research Methods 1(3): 155‒163.
Schonlau, M., Soest, A., Kapteyn, A., and Couper, M.P. (2009). Selection bias in web surveys and the use of propensity scores. Sociological Methods and Research 27(3): 291‒318.
Schröder, J. and Schmiedeberg, C. (2020). Effects of partner presence during the interview on survey responses: The example of questions concerning the division of household labor. Sociological Methods and Research online first: 1‒23.
Tourangeau, R. (2017). Presidential address: Paradoxes of nonresponse. Public Opinion Quarterly 81(3): 803‒814.
Tourangeau, R. and Smith, T.W. (1996). Asking sensitive questions: The impact of data collection mode, question format, and question context. Public Opinion Quarterly 60(1): 275‒304.
Tourangeau, R. and Yan, T. (2007). Sensitive questions in surveys. Psychological Bulletin 133(5): 859‒883.
Van Damme, M. and Dykstra, P. (2018). Spousal resources and relationship quality in eight European countries. Community, Work and Family 21(5): 541‒563.
Vehovar, V., Batagelj, Z., Manfreda, K.L., and Zaletel, M. (2002). Nonresponse in web surveys. In: Groves, R.M., Dillman, D.A., Eltinge, J.L., and Little, R.J.A. (eds.). Survey Nonresponse. New York: Wiley: 229‒242.
Weinreb, A., Sana, M., and Stecklov, G. (2018). Strangers in the field: A methodological experiment on interviewer–respondent familiarity. Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique 137–138(1): 94‒119.
Wiik, K.A., Keizer, R., and Lappegard, T. (2012). Relationship quality in marital and cohabiting unions across Europe. Journal of Marriage and Family 74(3): 389‒398.
Wolf, C., Christmann, P., Gummer, T., Schnaudt, C., and Verhoeven, S. (2021). Conducting general social surveys as self-administered mixed-mode surveys. Public Opinion Quarterly 85(2): 623‒648.