Introduction: Residency applicants use multiple resources to guide their application process including the Student Doctor Network (SDN), a publicly available online forum for the discussion of various topics in medical education. In recent years, specialty-specific forums for residency applicants to self-report their own application information have become popular. These forums allow other applicants to review self-reported data from their peers to inform their own application process. The accuracy of this resource is unknown. To determine whether the SDN is an accurate source of information for emergency medicine (EM) applicants, we compared self-reported SDN data to objective data from the National Resident Matching Program (NRMP).
Methods: We retrospectively reviewed self-reported SDN data by DO and MD candidates from EM forums for the 2014, 2016, and 2018 residency application cycles. These data were compared to the NRMP charting outcomes for each respective year.
Results: A total of 360 EM applicants self-reported data on the SDN during the years reviewed. The majority of these applicants (79%) posted for the 2018 application cycle following transition to a Google Docs spreadsheet. For the first two years of analysis, mean United States Medical Licensing Examination (USMLE) scores were similar to SDN reports. For the most recent year studied, applicants who posted to SDN reported higher mean (USMLE) Step 1 (234, 95% confidence interval [CI], 233-236) and Step 2 scores (250, 95% CI, 248-251) when compared to NRMP data (231 and 241). Reported contiguous residency program ranks were similar to NRMP in all years, and the proportion indicating Alpha Omega Alpha Honor Medical Society membership was similar to NRMP only for the most recent year studied.
Conclusion: Self-reporting on SDN showed a slight bias toward higher USMLE step scores in the most recent year when compared to objective NRMP data. Self-reporting on SDN has increased in recent years, but it is unknown whether this increase will lead to more accurate information for EM applicants. Given the self-reported nature of the SDN, applicants should use SDN forums with caution.
