Volume 54 - Article 35 | Pages 1125–1158
Formatting the two-step gender measure: Experimental insights from the United States
By Tessa Holtzman, Aliya Saperstein
demographic-research.54-35 (zip file, 274 kB)
readme.54-35 (text file, 3 kB)
Abstract
Background: Measuring sex and gender is central to demographic research and studies of social inequality. Best-practice guidelines for surveying English-speaking adults recommend a two-step approach, which uses two items to distinguish sex at birth from current identity. Additional research is needed to understand whether specific formatting decisions affect response distributions or measures of data quality.
Objective: We explore three understudied formatting choices: (1) Should sex or gender terms be used for current identity responses, (2) should both items appear on the same page or different pages in online surveys, and (3) in which order should the response options be presented? By answering these questions, we provide practical guidance for researchers applying the two-step measure, and evidence on how robust the measure is to various formatting differences.
Methods: We draw on three survey experiments conducted on two US adult samples: a sexual and gender minority (SGM) sample (n = 2,402) and a general population sample (n = 1,491).
Conclusions: Our results suggest researchers using the two-step approach can improve data quality by (1) using gender terms for current identity, and (2) using a page break in online surveys. Varying the response option order does not have measurable effects on data quality in our samples, which frees researchers in most survey contexts to consider nontraditional response orders that have other advantages.
Contribution: Some formatting changes can improve data quality, especially for SGM respondents, but small differences in how the two-step measure is formatted do not compromise comparability across studies or overall performance in general population surveys.
Author’s Affiliation
- Tessa Holtzman - Stanford University, United States of America EMAIL
- Aliya Saperstein - Stanford University, United States of America EMAIL
Other articles by the same author/authors in Demographic Research
Racial classification as a multistate process
Volume 50 - Article 17
Race, color, and income inequality across the Americas
Volume 31 - Article 24
Similar articles in Demographic Research
Modelling the age and sex profiles of net international migration
Volume 53 - Article 19
| Keywords:
age,
estimation,
international migration,
net migration,
sex
The sex preference for children in Europe: Children’s sex and the probability and timing of births
Volume 48 - Article 8
| Keywords:
Europe,
family structure,
fertility,
gender,
progression rate,
sex,
sex composition,
son preference
The turnaround in internal migration between East and West Germany over the period 1991 to 2018
Volume 43 - Article 33
| Keywords:
age,
East Germany,
internal migration,
sex,
West Germany
Reliability of retrospective event histories within the German Generations and Gender Survey: The role of interviewer and survey design factors
Volume 34 - Article 11
| Keywords:
data validation,
fertility,
Germany,
GGS,
interviewer control,
marriage,
questionnaire,
screening questions,
survey design,
union histories
Nonresident Fathers and Formal Child Support: Evidence from the CPS, NSFG, and SIPP
Volume 29 - Article 46
| Keywords:
child support,
methods,
nonresident fathers,
survey measurement
Cited References: 35
Download to Citation Manager
PubMed
Google Scholar