What They Are Not Telling Us: Analysis of Nonresponders on a National Survey of Resident Well-Being

Abstract

To characterize nonrespondents to a national survey about trainee well-being, examine response patterns to questions of sensitive nature, and assess how nonresponse biases prevalence estimates of mistreatment and well-being.

Background: Surgical trainees are at risk for burnout and mistreatment, which are discernible only by self-report. Therefore, prevalence estimates may be biased by nonresponse.

Methods: A survey was administered with the 2018 and 2019 American Board of Surgery In-Training Examinations assessing demographics, dissatisfaction with education and career, mistreatment, burnout, thoughts of attrition, and suicidality. Responders in 2019 were characterized as survey "Completers," "Discontinuers" (quit before the end), and "Selective Responders" (selectively answered questions throughout). Multivariable logistic regression assessed associations of respondent type with mistreatment and well-being outcomes, adjusting for individual and program characteristics. Longitudinal survey identifiers linked survey responses for eligible trainees between 2018 and 2019 surveys to further inform nonresponse patterns.

Results: In 2019, 6956 (85.6%) of 8129 eligible trainees initiated the survey, with 66.5% Completers, 17.5% Discontinuers, and 16.0% Selective Responders. Items with the highest response rates included dissatisfaction with education and career (93.2%), burnout (86.3%), thoughts of attrition (90.8%), and suicidality (94.4%). Discontinuers and Selective Responders were more often junior residents and racially/ethnically minoritized than Completers. No differences were seen in burnout and suicidality rates between Discontinuers, Selective Responders, and Completers. Non-White or Hispanic residents were more likely to skip questions about racial/ethnic discrimination than non-Hispanic White residents (21.2% vs 15.8%; odds ratio [OR], 1.35; 95% confidence interval [CI], 1.19-1.53), particularly when asked to identify the source. Women were not more likely to omit questions regarding gender/gender identity/sexual orientation discrimination (OR, 0.91; 95% CI, 0.79-1.04) or its sources (OR, 1.02; 95% CI, 0.89-1.16). Both Discontinuers and Selective Responders more frequently reported physical abuse (2.5% vs 1.1%; P = 0.001) and racial discrimination (18.3% vs 13.6%; P < 0.001) on the previous survey (2018) than Completers.

Conclusions: Overall response rates are high for this survey. Prevalence estimates of burnout, suicidality, and gender discrimination are likely minimally impacted by nonresponse. Nonresponse to survey items about racial/ethnic discrimination by racially/ethnically minoritized residents likely results in underestimation of this type of mistreatment.

Keywords: and inclusion; burnout; diversity; equity; mistreatment; nonresponse; surgical education; well-being.