R
esults of the 2021 NRMP
Program Director Survey
August 2021
www.nrmp.org
Q
uestions about the contents of this publication may be directed to National Resident Matching
Program at datareques[email protected]
.
Q
uestions about the NRMP should be directed to Donna L. Lamb, D.HSc., M.B.A., B.S.N.,
President and CEO, National Resident Matching Program, (202) 400-2233 or admin@nrmp.org
.
Suggested Citation
National Resident Matching Program, Data Release and Research Committee: Results of the
2021 NRMP Program Director Survey. National Resident Matching Program, Washington, DC. 2021.
Copyright © 2021 National Resident Matching Program. All rights reserved. Permission to use,
copy, and/or distribute any documentation and/or related images from this publication shall be
expressly obtained from the NRMP.
I
ntroduction .
................................................................................................................................................... 1
All Specialties .
............................................................................................................................................... 3
Charts for Individual Specialties
Anesthesiology ......................................................................................................................................... 14
Child Neurology ........................................................................................................................................ 25
Dermatology ............................................................................................................................................. 36
Emergency Medicine ................................................................................................................................ 47
Family Medicine ........................................................................................................................................ 58
Internal Medicine ...................................................................................................................................... 69
Internal Medicine - Pediatrics ................................................................................................................... 80
Neurology.................................................................................................................................................. 91
Neurological Surgery .............................................................................................................................. 102
Obstetrics and Gynecology ..................................................................................................................... 113
Orthopaedic Surgery ............................................................................................................................... 124
Otolaryngology ........................................................................................................................................ 135
Pathology ................................................................................................................................................ 146
Pediatrics ................................................................................................................................................ 157
Physical Medicine and Rehabilitation ….................................................................................................. 168
Plastic Surgery ........................................................................................................................................ 179
Psychiatry ............................................................................................................................................... 190
Radiology-Diagnostic .............................................................................................................................. 201
Radiation Oncology ................................................................................................................................. 212
Surgery ................................................................................................................................................... 223
Transitional Year ..................................................................................................................................... 234
Table of Contents
NRMP Program Director Survey Results, 2021
1
I
n March 2021, the National Resident Matching Program (NRMP) conducted its survey of directors
of all programs participating in the Main Residency Match
®
. The Program Director Survey usually is a biennial
survey conducted by the NRMP in even years (e.g., 2018, 2020) with the primary purpose of characterizing the
factors that Program Directors use to (1) select applicants to interview, and (2) rank applicants for
the Main Residency Match. However, because of the unprecedented circumstances resulting from the COVID-
19 pandemic and the consequent move to virtual recruitment and interviewing for July 2021 residency
appointments, the NRMP decided to administer the Program Director Survey in 2021.
The survey was issued to program directors who certified a rank order list as part of the 2021 Main Residency
Match. It was fielded during the 11 days between the Rank Order List Certification Deadline and the start of
Match Week to prevent match outcomes from influencing respondents' answers. The survey included many of
the items from the 2020 survey questionnaire along with questions intended to query program directors’
experiences with the virtual recruitment process. Specifically, the survey solicited information on:
• the number of applications received, screened, and reviewed, as well as the number of applicants
interviewed and ranked;
• the frequency with which programs interviewed and ranked specific applicant groups;
• use of test scores in considering which applicants to interview;
• applicant characteristics considered in both interview selection and ranking; and
• experiences with virtual recruitment, including:
o approaches used to engage and communicate with potential applicants,
o potential challenges posed by the virtual environment, and
o whether programs anticipated conducting part or all of the application or selection processes
virtually in the future.
General findings concerning the virtual recruitment experience of programs have been published to the NRMP
website in a research brief; additional analyses will be reported in a future document.
S
ome items from prior administrations of the Program Director Survey were deleted for the 2021
administration in order to allow for robust questioning about the virtual experience while minimizing respondent
burden. Deleted items included questions about:
• specific target scores on USMLE Step 1 and Step 2 CK exams below which programs generally did not
grant interviews and above which they almost always granted interviews;
• whether programs offered more invitations than interview slots and reasons for that practice;
• time allowed for applicants to respond to interview invitations;
• how programs scheduled interviews;
• preferred modes of communication with and about applicants during Supplemental Offer and Acceptance
Program (SOAP) rounds; and
• importance of factors such as professionalism, quality of patient care, clinical competency, and ethics in
as
sessing residents’ success during residency.
Future iterations of the survey will re-introduce questions about interview behaviors and assessment of
applicant success in residency.
T
he overall response rate for all specialties combined was 23.3 percent (n=1,033). Specialty-specific response
rates for Transitional Year programs and programs in the 20 specialties where 10 or more responses were
submitted are presented in the table below. The “All Others” category combines into a single group 23
specialties, including 17 combined programs (e.g., Emergency Medicine/Anesthesiology,
Pediatrics/Psychiatry/Child Psychiatry), that submitted fewer than 10 responses. The “All Others” category was
only used in analyses for all specialties combined.
Introduction
NRMP Program Director Survey Results, 2021
2
Specialty
Surveys Sent
Number Responding
Response Rate
Anesthesiology
149
42
28.2%
Child Neurology
74
13
17.6%
Dermatology
126
17
13.5%
Emergency Medicine
256
74
28.9%
Family Medicine
631
159
25.2%
Internal Medicine
533
127
23.8%
Internal Medicine-Pediatrics
77
20
26.0%
Neurological Surgery
113
19
16.8%
Neurology
154
29
18.8%
Obstetrics and Gynecology
272
89
32.7%
Orthopaedic Surgery
180
36
20.0%
Otolaryngology
116
28
24.1%
Pathology-Anatomic and Clinical
133
33
24.8%
Pediatrics
185
46
24.9%
Physical Medicine and Rehabilitation
94
29
30.9%
Plastic Surgery (Integrated)
84
15
17.9%
Psychiatry
245
61
24.9%
Radiation Oncology
86
13
15.1%
Radiology-Diagnostic
178
34
19.1%
Surgery-General
307
76
24.8%
Transitional Year
146
31
21.2%
All Others
290
42
14.5%
Total
4,429
1,033
23.3%
Numbers of responses are presented in most of the graphs. For those graphs reflecting data from multiple
survey questions, the largest available N from among the survey questions is listed. Numbers of applicants
ranked and positions in the Match are self-reported by respondents. Factors considered by programs (and their
mean importance) in selecting applicants for interview and ranking are presented in two sets of figures:
• Education and Academic Performance Characteristics: includes grades, test scores, and
ac
creditation status/reputation of applicants’ medical schools.
•
Personal Characteristics and Other Knowledge: includes respondents’ perceptions of applicants’
commitment to their specialties, ethics and professionalism, and, as a ranking factor, programs’
interview day experiences with applicants.
This report presents results on selected items for all specialties combined and separately for each specialty
identified in the table. The NRMP hopes that applicants, program directors, and medical school officials and
faculty advisors find these data useful as they prepare for and participate in the Main Residency Match.
_______________
The NRMP's data reporting and research activities are guided by its Data Release and Research Committee.
NRMP data and reports can be found at: www.nrmp.org/main-residency-match-data/
.
NRMP Program Director Survey Results, 2021
3
All Specialties, Total n = 1,033
NRMP Program Director Survey Results, 2021
4
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
(Total n = 1,018)
9
1013
506
423
249
112
101
0
200
400
600
800
1000
1200
Quota Applications
received
Applications
rejected
based on
standardized
screen
Applications
receiving
holistic review
Interview
invitations
sent
Applicants
interviewed
Applicants
ranked
Figure PD_1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
5
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 991)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
6
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 902)
1
Some percentages may not add to 100 because of rounding.
1
9
6
28
19
35
6
28
60
49
54
49
93
63
34
23
26
16
0
10
20
30
40
50
60
70
80
90
100
US MD
Sr
US DO
Sr
US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
7
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 1,011)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
38
27
5
2
43
37
10
4
21
41
35
14
17
30
30
22
41
26
34
7
34
24
36
8
6
26
77
6
10
24
66
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
8
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 944)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
27
21
4
2
31
28
7
3
39
47
37
14
20
29
30
14
23
18
27
6
31
23
28
7
11
14
33
78
18
20
36
77
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
9
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 960)
1
Some percentages may not add to 100 because of rounding.
1
6
7
26
18
30
4
23
54
47
50
48
96
71
39
27
32
22
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
10
1
Rated on a scale of 1 (not at all important) to 5 (very important)
6.6
8.9
12.6
21.0
22.9
31.8
38.1
44.2
46.2
46.2
46.4
50.5
50.6
53.0
55.0
55.9
58.5
59.4
65.2
68.1
74.1
74.6
78.8
85.9
86.2
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.0
3.0
3.2
3.4
3.2
3.7
3.7
4.2
3.8
3.7
3.6
3.6
3.5
3.8
3.4
3.7
3.9
4.4
4.1
3.8
4.4
3.9
3.8
4.0
3.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_I1
Percent of Respondents Endorsing
Figure PD_I2
Education and Academic Performance Characteristics Considered
in Deciding Whom to Interview (%)
Mean Importance of Education and Academic Performance
Characteristics Considered in Deciding Whom to Interview
1
Mean Importance Rating
NRMP Program Director Survey Results, 2021
11
1
Rated on a scale of 1 (not at all important) to 5 (very important)
18.9
24.2
27.8
31.0
33.4
35.5
41.1
44.8
62.8
63.6
64.8
70.1
72.3
73.9
75.5
79.5
80.9
83.8
85.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.8
3.8
4.7
3.6
3.9
4.2
3.6
4.2
3.9
4.1
3.9
4.2
4.2
4.5
4.1
4.3
4.1
3.9
4.2
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_I3
Percent of Respondents Endorsing
Mean Importance Rating
Figure PD_I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
NRMP Program Director Survey Results, 2021
12
1
Rated on a scale of 1 (not at all important) to 5 (very important)
5.0
6.1
8.4
13.6
14.1
20.3
23.2
24.0
26.1
26.3
28.2
31.8
32.1
33.8
35.8
36.8
37.1
42.0
42.7
45.4
46.5
49.9
60.4
61.3
61.8
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.1
3.6
3.5
3.2
3.6
3.9
4.2
3.8
3.6
3.7
3.8
3.9
3.7
3.6
3.9
4.1
4.4
3.8
3.9
3.9
4.4
3.9
3.9
4.0
3.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_R1
Percent of Respondents Endorsing
Mean Importance Rating
Figure PD_R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
NRMP Program Director Survey Results, 2021
13
1
Rated on a scale of 1 (not at all important) to 5 (very important)
8.1
11.9
12.7
19.3
19.9
20.1
20.7
20.9
22.7
29.8
35.2
45.3
48.5
50.8
59.8
61.6
62.6
64.4
64.7
64.8
67.6
70.0
77.5
79.5
84.9
87.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of patient population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.9
4.1
3.6
4.1
4.7
3.8
3.7
4.3
3.8
3.7
4.3
3.9
3.9
4.2
4.0
4.3
4.6
3.8
4.3
4.1
4.4
4.2
4.8
4.6
4.8
4.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_R3
Percent of Respondents Endorsing
Figure PD_R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Mean Importance Rating
NRMP Program Director Survey Results, 2021
14
Anesthesiology, Total n = 42
NRMP Program Director Survey Results, 2021
15
M
ean Numbers of Applications Received, Interview Invitations, Interviews, and Applicants
Ranked, 2021
(Total n = 36)
12
1226
509
656
174
158
147
0
200
400
600
800
1000
1200
1400
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_AN-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
16
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 39)
0
10
20
30
40
50
60
70
80
90
100
Percentages of applications
Rejected based on standardized screen Received holistic review
Figure PD_AN-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
17
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 39)
1
Some percentages may not add to 100 because of rounding.
3
11
16
22
27
50
64
68
68
100
73
47
25
16
11
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_AN-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
18
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 42)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
45
29
3
2
46
32
11
5
31
50
40
20
24
43
27
22
24
12
35
10
24 14
38
8
10
23
68
5
11
24
65
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_AN-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
19
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 42)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
33
26
5 5
36
29
7
5
45
52
39
17
26
33
24
15
14
10
24
7
12
10
22
10
7
12
32
71
26
29
46
71
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_AN-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
20
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 39)
1
Some percentages may not add to 100 because of rounding.
6
13
15
29
59
72
72
73
100
71
41
22
16
12
0
10
20
30
40
50
60
70
80
90
100
US MD
Sr
US DO
Sr
US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_AN-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
21
1
Rated on a scale of 1 (not at all important) to 5 (very important)
4.8
4.8
7.1
31.0
21.4
31.0
52.4
52.4
54.8
33.3
47.6
61.9
69.0
57.1
59.5
59.5
64.3
64.3
61.9
85.7
83.3
83.3
88.1
90.5
95.2
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
1.5
4.0
3.5
3.4
3.0
4.0
3.8
3.7
4.0
3.8
3.9
3.7
3.5
4.0
3.3
3.9
4.1
4.8
3.8
4.0
4.7
3.7
3.7
4.3
3.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How med school handled virtual rotations
COMLEX-USA Level 3 score
USMLE step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_AN-I1
Percent of Respondents Endorsing
Figure PD_AN-I2
Education and Academic Performance Characteristics Considered
in Deciding Whom to Interview (%)
Mean Importance of Education and Academic Performance
Characteristics Considered in Deciding Whom to Interview
1
Mean Importance Rating
NRMP Program Director Survey Results, 2021
22
1
Rated on a scale of 1 (not at all important) to 5 (very important)
14.3
11.9
21.4
9.5
35.7
28.6
40.5
33.3
76.2
69.0
57.1
78.6
85.7
76.2
85.7
78.6
81.0
83.3
78.6
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept.
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.2
3.0
5.0
2.7
3.4
3.4
3.3
4.2
3.7
4.0
3.9
4.2
4.2
4.5
4.1
4.3
4.0
3.9
4.0
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept.
Other life experience
Personal prior knowledge
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_AN-I3
Percent of Respondents Endorsing
Mean Importance Rating
Figure PD_AN-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
NRMP Program Director Survey Results, 2021
23
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent rated the importance of COMLEX-USA Level 3 score as a consideration in deciding which applicants to rank.
2.4
2.4
2.4
9.5
19.0
23.8
23.8
35.7
21.4
16.7
35.7
31.0
38.1
50.0
47.6
28.6
35.7
42.9
45.2
52.4
47.6
66.7
69.0
69.0
73.8
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.0
4.0
2.8
3.8
4.2
3.4
3.6
3.6
3.7
3.8
3.7
4.1
3.9
4.0
4.0
4.8
4.2
4.2
4.0
4.7
4.1
4.1
4.1
4.0
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_AN-R1
Percent of Respondents Endorsing
Mean Importance Rating
Figure PD_AN-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
NRMP Program Director Survey Results, 2021
24
1
Rated on a scale of 1 (not at all important) to 5 (very important)
4.8
9.5
11.9
14.3
23.8
9.5
31.0
14.3
11.9
26.2
23.8
40.5
47.6
52.4
69.0
57.1
57.1
69.0
73.8
64.3
64.3
69.0
78.6
76.2
83.3
88.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
4.5
3.3
3.6
4.0
4.7
3.0
4.2
4.2
3.8
3.5
4.2
3.7
4.0
4.2
4.1
4.2
4.5
3.8
4.3
3.8
4.3
4.2
4.7
4.5
4.8
4.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rota in specialty elsewhere
Appl facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_AN-R3
Percent of Respondents Endorsing
Figure PD_AN-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Mean Importance Rating
NRMP Program Director Survey Results, 2021
25
Child Neurology, Total n = 13
NRMP Program Director Survey Results, 2021
26
.
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
(Total n = 11)
2
115
36
90
39
31
30
0
20
40
60
80
100
120
140
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_CN-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
27
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 11)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_CN-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
28
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 11)
1
Some percentages may not add to 100 because of rounding.
0
10
30
44
0
10
0
30
30
44
80 60
100
60
40
11
20
30
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_CN-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
29
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 13)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
23
8
46
42
17
8
15
50
55
27
8
25
58
50
62
33
27
18
46
25
8
8
8
18
55
8
17
33
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_CN-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
30
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 10)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
20
10
11 11
50
30
22 22
40 60
67
44
10
30
33
22
40 20
11
11
20 20
11
11
10
11
33
20 20
33
44
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_CN-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
31
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 11)
1
Some percentages may not add to 100 because of rounding.
10
22
38
9
10
33
50
73
64
100
80
44
13
27 27
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_CN-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
32
1
Rated on a scale of 1 (not at all important) to 5 (very important)
4.1
15.4
38.5
7.7
53.8
38.5
46.2
61.5
53.8
76.9
69.2
46.2
53.8
38.5
69.2
38.5
84.6
53.8
92.3
61.5
76.9
84.6
84.6
92.3
84.6
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi Membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.0
3.5
3.2
2.0
3.1
3.8
3.5
4.3
3.9
3.8
3.9
3.3
3.7
4.0
3.9
4.0
4.0
4.2
4.2
4.0
4.1
4.2
3.6
4.5
3.5
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_CN-I1
Figure PD_CN-I2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Interview (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
33
1
Rated on a scale of 1 (not at all important) to 5 (very important)
15.4
46.2
38.5
30.8
30.8
46.2
53.8
23.1
76.2
61.5
57.1
69.2
69.2
69.2
92.3
100.0
69.2
92.3
84.6
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
2.5
3.3
4.2
3.8
3.3
3.5
3.3
3.7
3.6
3.6
3.4
4.3
4.0
4.8
4.3
4.3
3.8
3.8
4.3
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_CN-I3
Figure PD_CN-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
34
1
Rated on a scale of 1 (not at all important) to 5 (very important)
15.4
23.1
23.1
46.2
7.7
30.8
38.5
46.2
61.5
69.2
46.2
53.8
61.5
53.8
69.2
69.2
46.2
30.8
30.8
84.6
61.5
76.9
61.5
92.3
61.5
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.0
2.7
3.0
2.5
1.0
3.3
4.6
3.8
3.5
3.7
3.3
4.0
3.0
3.6
3.8
4.1
4.0
3.5
3.5
3.7
4.1
3.6
3.3
3.8
3.5
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 2 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in require clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_CN-R1
Figure PD_CN-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
35
1
Rated on a scale of 1 (not at all important) to 5 (very important)
15.4
15.4
38.5
30.8
23.1
46.2
38.5
30.8
38.5
46.2
23.1
61.5
76.9
69.2
100.0
76.9
69.2
84.6
92.3
84.6
100.0
76.9
92.3
84.6
92.3
100.0
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition/elective rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.0
3.5
3.2
4.0
5.0
3.0
3.4
3.8
3.0
3.2
3.7
3.3
3.3
3.2
4.0
3.9
5.0
4.0
3.8
4.0
4.8
4.1
4.9
4.7
4.9
5.0
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Appl facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition/elective rotation in PD's dept
Volunteer/extracurr experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_CN-R3
Figure PD_CN-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
36
Dermatology, Total n = 17
NRMP Program Director Survey Results, 2021
37
.
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
1
(Total n = 17)
1
Mean number of invitations reflects the exclusion of one respondent who reported sending over 100,000.
4
509
98
398
49
44
43
0
100
200
300
400
500
600
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_D-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
38
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 17)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_D-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
39
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 16)
1
Some percentages may not add to 100 because of rounding.
25
6
28
19
35
50
60
49
54
49
100
25
34
23
26
16
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_D-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
40
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 17)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
29
21
24
53
35
13
21
57
43
21
47
12
6
7
57
7
14
7
35
59
80
36
43
71
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_D-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
41
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 14)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
21
43
64
36
21
7
14 14
7
29
14
21
7
7
36
50
79
71
79
86
93
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_D-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
42
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 16)
1
Some percentages may not add to 100 because of rounding.
21
36
31
15
50
33
50
54
62
100
29
67
14
15
23
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_D-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
43
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering COMLEX-USA Level 3 score in deciding which applicants to interview.
5.9
0.0
5.9
11.8
35.3
5.9
35.3
17.6
11.8
35.3
29.4
64.7
64.7
11.8
76.5
17.6
76.5
29.4
64.7
76.5
58.8
88.2
47.1
94.1
94.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
1.0
3.0
4.0
3.5
3.0
3.5
4.7
3.0
4.2
2.8
3.9
3.7
3.5
4.0
3.7
4.1
5.0
4.3
3.8
4.5
4.4
3.4
4.1
3.3
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_D-I1
Figure PD_D-I2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Interview (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Interview
1,2
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
44
1
Rated on a scale of 1 (not at all important) to 5 (very important)
23.5
64.7
5.9
47.1
17.6
11.8
70.6
47.1
82.4
82.4
94.1
82.4
70.6
82.4
88.2
76.5
88.2
100.0
100.0
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition/elective rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.8
3.9
5.0
3.6
3.7
3.0
3.5
4.1
4.1
3.9
4.0
4.4
4.4
4.7
4.6
4.5
4.5
4.5
4.6
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_D-I3
Figure PD_D-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
45
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering medical school handling of virtual rotations, passing USMLE Step 2 CS, COMLEX - USA Level 2
PE, USMLE Step 3, or COMLEX - USA Level 3 scores in deciding which applicants to rank.
0.0
0.0
0.0
11.8
11.8
0.0
5.9
17.6
17.6
11.8
0.0
5.9
29.4
29.4
17.6
23.5
5.9
11.8
5.9
35.3
11.8
35.3
11.8
35.3
35.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.5
5.0
3.0
3.0
4.3
3.5
3.0
4.2
4.0
4.3
4.0
5.0
4.0
5.0
4.3
5.0
3.8
5.0
3.7
3.5
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_D-R1
Figure PD_D-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1,2
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
46
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering visa status, ability to work legally without a visa, or NRMP flag for match violation in deciding
which applicants to rank.
5.9
11.8
17.6
0.0
0.0
52.9
5.9
0.0
17.6
41.2
35.3
52.9
52.9
58.8
70.6
64.7
70.6
64.7
64.7
41.2
64.7
76.5
82.4
82.4
88.2
88.2
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Applicant facility with meeting platform tech
Away rotation in specialty elsewhere
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.0
3.7
3.5
3.4
3.0
4.0
3.4
4.0
4.0
4.0
3.9
4.6
4.6
4.5
4.1
3.6
4.7
4.4
4.4
4.9
4.7
5.0
4.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_D-R3
Figure PD_D-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1,2
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
47
Emergency Medicine, Total n = 74
NRMP Program Director Survey Results, 2021
48
.
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
(Total n = 72)
11
1035
320
639
207
168
155
0
200
400
600
800
1000
1200
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_EM-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
49
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 69)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_EM-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
50
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 70)
1
Some percentages may not add to 100 because of rounding.
2
4
25
28
43
4
29
71
56
59
56
96
70
25
20
14
2
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_EM-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
51
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 72)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
38
31
4
41
34
6
2
24
51
26
9
26
45
31
8
39
18
30
4
30
17
31
6
39
87
4
4
31
84
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_EM-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
52
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 71)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
32
23
1
31
28
1
45
56
29
9
26
38
25
9
21
18
27
4
27
17
28
3
1
3
43
87
16
17
46
88
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_EM-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
53
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 70)
1
Some percentages may not add to 100 because of rounding.
3
3
25
26
44
3
22
65
51
55
54
97
75
32
24
20
2
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_EM-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
54
1
Rated on a scale of 1 (not at all important) to 5 (very important)
9.5
2.7
2.7
25.7
16.2
21.6
36.5
27.0
41.9
52.7
28.4
58.1
54.1
51.4
45.9
55.4
56.8
64.9
79.7
66.2
74.3
70.3
77.0
77.0
83.8
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.1
2.5
2.5
3.3
2.8
3.6
3.5
3.8
3.6
4.2
3.8
3.6
3.5
4.1
3.3
3.6
3.7
4.7
4.5
3.8
4.6
3.9
3.8
3.8
3.5
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_EM-I1
Figure PD_EM-I2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Interview (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
55
1
Rated on a scale of 1 (not at all important) to 5 (very important)
60.8
28.4
31.1
23.0
24.3
31.1
36.5
63.5
62.2
58.1
60.8
68.9
73.0
70.3
74.3
81.1
82.4
64.9
90.5
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
4.4
3.3
4.5
3.3
4.1
4.7
3.4
4.6
4.0
4.1
4.0
4.3
4.2
4.4
4.0
4.3
4.0
3.6
4.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_EM-I3
Figure PD_EM-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
56
1
Rated on a scale of 1 (not at all important) to 5 (very important)
8.1
1.4
2.7
12.2
17.6
17.6
17.6
29.7
25.7
29.7
24.3
27.0
44.6
39.2
32.4
56.8
39.2
52.7
47.3
52.7
44.6
51.4
64.9
58.1
70.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.3
4.0
4.5
3.0
3.1
3.7
3.6
3.6
3.7
4.0
3.4
3.6
3.5
3.2
3.7
4.3
4.4
3.5
3.9
3.9
4.4
3.7
3.8
3.8
3.5
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How med school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_EM-R1
Figure PD_EM-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
57
1
Rated on a scale of 1 (not at all important) to 5 (very important)
12.2
50.0
13.5
13.5
18.9
18.9
25.7
13.5
20.3
23.0
58.1
47.3
48.6
51.4
66.2
70.3
58.1
63.5
67.6
81.1
68.9
74.3
74.3
77.0
79.7
82.4
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.9
4.7
3.1
4.8
4.4
3.9
3.8
4.5
3.3
3.5
4.7
4.0
4.1
4.4
3.9
4.4
4.6
3.4
4.2
4.8
4.4
4.1
4.8
4.5
4.9
4.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meetig platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_EM-R3
Figure PD_EM-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
58
Family Medicine, Total n = 159
NRMP Program Director Survey Results, 2021
59
.
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
(Total n = 146)
20
987
560
343
119
99
86
0
200
400
600
800
1000
1200
Quota Applications
received
Applications
rejected based
on standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_FM-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
60
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 153)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_FM-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
61
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 139)
1
Some percentages may not add to 100 because of rounding.
2 2
4
10
14
50
9
6
60
56
51
36
90
93
36
34
35
14
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_FM-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
62
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 156)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
17
20
5
21
26
6
9
26
40
18
9
18
34
23
74
52
36
7
64
49
39
6
1
3
20
76
6
7
22
70
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_FM-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
63
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 155)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
3
5
2
1
19
21
5
1
36
37
41
14
11
25
40
18
33
28
16
5
69
52
37
8
28
30
41
80
1
2
18
74
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_FM-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
64
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 143)
1
Some percentages may not add to 100 because of rounding.
1
1
6
14
15
43
5
5
57
50
39
36
94
94
38
36
46
21
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_FM-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
65
1
Rated on a scale of 1 (not at all important) to 5 (very important)
6.9
11.3
14.5
16.4
11.3
44.7
30.2
53.5
59.1
30.8
46.5
35.8
25.8
71.1
41.5
73.0
53.5
78.6
50.3
51.6
79.2
64.2
75.5
86.8
75.5
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.5
2.8
3.0
3.2
2.7
3.7
3.7
4.3
3.8
3.4
3.7
3.4
3.3
3.5
3.3
3.3
3.6
4.0
3.8
3.4
3.9
3.6
3.6
3.8
3.3
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_FM-I1
Figure PD_FM-I2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Interview (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
66
1
Rated on a scale of 1 (not at all important) to 5 (very important)
9.4
8.2
28.9
47.2
40.9
49.7
10.7
56.6
57.2
68.6
62.9
65.4
75.5
72.3
76.1
95.6
75.5
89.9
84.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.4
2.9
4.6
3.7
4.1
4.3
2.7
4.1
3.8
4.1
3.8
4.0
4.2
4.5
4.0
4.4
4.1
4.1
3.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_FM-I3
Figure PD_FM-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
67
1
Rated on a scale of 1 (not at all important) to 5 (very important)
6.3
6.9
8.8
8.2
8.8
20.1
27.0
17.0
18.2
15.7
22.0
37.1
20.8
10.7
25.2
22.6
51.6
49.7
55.3
30.2
52.2
31.4
57.2
61.0
51.6
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.2
2.6
3.4
4.2
3.6
3.4
3.6
3.7
3.4
3.7
3.6
3.8
3.7
3.6
3.7
3.3
3.7
3.6
3.7
3.8
3.4
3.6
3.8
3.6
3.4
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How med school handled virtual rotations
Awards/honors basic sciences
Sigma Sigma Phi membership
Medical school accred status
Medical school reputation
Awards/honors in clin clerkships
Awards/honors clerkship preferred spec
Continuous med educ w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship preferred spec
Grades in req'd clerkships
Class ranking/quartile
MSPE
COMLEX-USA Level 3 score
USMLE Step 3 score
Passing COMLEX-USA Level 2 PE
Passing USMLE Step 2 CS
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Any failed attempt at USMLE
USMLE Step 2 CK score
USMLE Step 1 score
Figure PD_FM-R1
Figure PD_FM-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
68
1
Rated on a scale of 1 (not at all important) to 5 (very important)
8.1
5.7
12.7
20.8
20.8
5.7
20.7
25.8
36.5
7.5
42.8
46.5
45.3
55.3
53.5
52.8
58.5
66.7
64.8
54.1
82.4
65.4
77.5
79.5
84.9
87.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
4.0
4.3
3.7
4.4
4.7
3.5
3.7
4.5
3.8
2.9
4.4
3.8
3.9
4.2
4.0
4.0
4.5
3.8
4.4
3.7
4.5
4.0
4.7
4.6
4.7
4.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_FM-R3
Figure PD_FM-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
69
Internal Medicine, Total n = 127
NRMP Program Director Survey Results, 2021
70
.
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
(Total n = 124)
20
2906
1645
749
281
240
212
0
500
1000
1500
2000
2500
3000
3500
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_IM-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
71
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 118)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_IM-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
72
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 106)
1
Some percentages may not add to 100 because of rounding.
1
3
5
28
6
15
13
20
67
48
42
48
86
77
28
25
52
37
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_IM-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
73
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 124)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
44
39
4
3
55
57
14
3
22
34
44
19
18
19
33
34
34
25
32
4
23
19
38
7
1
3
20
73
4
5
14
56
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_IM-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
74
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 120)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
30
29
3
3
48
46
8
3
39
45
40
17
18
24
35
18
19
14
30
3
22
17
33
4
12
12
28
77
13
13
25
75
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_IM-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
75
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 119)
1
Some percentages may not add to 100 because of rounding.
1
3
8
26
6
14
10
21
59
49
43
49
89
77
33
26
51
38
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_IM-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
76
1
Rated on a scale of 1 (not at all important) to 5 (very important)
7.9
12.7
17.5
22.2
14.3
48.4
47.6
49.2
54.8
41.3
57.1
44.4
43.7
75.4
49.2
73.8
54.0
65.1
63.5
76.2
82.5
73.8
93.7
85.7
90.5
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.5
3.2
3.3
3.4
2.9
3.7
3.8
4.4
3.8
3.4
3.7
3.6
3.4
4.0
3.3
3.9
3.8
4.6
4.2
4.1
4.5
3.9
4.0
4.2
3.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic scienes
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_IM-I1
Figure PD_IM-I2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Interview (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
77
1
Rated on a scale of 1 (not at all important) to 5 (very important)
4.8
16.7
31.0
38.9
42.1
41.3
29.4
36.5
57.1
56.3
60.3
65.9
70.6
73.0
67.5
64.3
81.0
73.0
68.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
4.0
3.5
4.8
3.7
4.3
4.3
3.4
4.2
3.7
4.1
3.8
4.0
4.1
4.5
3.9
4.1
4.2
3.6
3.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_IM-I3
Figure PD_IM-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
78
1
Rated on a scale of 1 (not at all important) to 5 (very important)
7.1
10.3
14.3
12.7
22.2
32.5
34.1
41.3
31.0
30.2
41.3
50.8
41.3
38.1
46.8
52.4
50.8
61.1
65.1
58.7
65.1
69.0
87.3
72.2
77.0
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.2
3.6
4.1
3.1
3.6
4.0
4.6
3.8
3.5
3.7
3.9
4.1
3.7
3.5
3.9
4.2
4.5
4.1
4.2
4.0
4.5
4.1
4.1
4.2
3.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_IM-R1
Figure PD_IM-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
79
1
Rated on a scale of 1 (not at all important) to 5 (very important)
7.1
4.8
16.7
38.1
29.4
17.5
22.2
36.5
33.3
27.8
33.3
46.8
56.3
50.0
63.5
64.3
68.3
61.9
67.5
63.5
58.7
74.6
65.1
70.6
86.5
88.9
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.9
3.5
3.4
4.2
4.8
3.6
3.7
4.3
3.9
3.5
4.2
3.9
3.9
4.2
4.0
4.2
4.7
3.7
4.3
3.9
4.2
4.3
4.7
4.5
4.8
4.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_IM-R3
Figure PD_IM-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
80
Internal Medicine-Pediatrics, Total n = 20
NRMP Program Director Survey Results, 2021
81
.
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
(Total n = 18)
6
256
66
194
84
75
73
0
50
100
150
200
250
300
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_IMP-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
82
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 18)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_IMP-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
83
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 17)
1
Some percentages may not add to 100 because of rounding.
29
21
50
27
41
14
57
36
53
53
100
57
21
14
20
6
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_IMP-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
84
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 19)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
32
11
60
40
13
15
21
47
11
20
40
13
8
47
32
37
13
7
27
11
53
100
7
13
47
77
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_IMP-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
85
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 15)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
Interview.
3
Some percentages may not add to 100 because of rounding.
20
7
15
7
53
67
27
46
13
20
13
13
31
20
7
13
60
100 100
8
60
100
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_IMP-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
86
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 19)
1
Some percentages may not add to 100 because of rounding.
12 12
31
19
36
12
47
50
56
64
100
77
41
19
25
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_IMP-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
87
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering USMLE Step 3 or COMLEX-USA Level 3 scores in deciding which applicants to interview.
5.0
0.0
0.0
30.0
30.0
25.0
50.0
45.0
35.0
60.0
50.0
75.0
60.0
50.0
80.0
55.0
55.0
55.0
90.0
85.0
85.0
85.0
85.0
100.0
95.0
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
2.0
4.0
2.8
3.8
3.9
4.6
2.6
3.8
3.7
4.3
3.6
3.7
3.7
3.6
4.0
4.5
3.9
3.9
4.3
4.1
3.4
4.1
3.4
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_IMP-I1
Figure PD_IMP-I2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Interview (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Interview
1,2
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
88
1
Rated on a scale of 1 (not at all important) to 5 (very important)
15.0
15.0
35.0
30.0
25.0
30.0
30.0
40.0
75.0
65.0
95.0
90.0
70.0
80.0
90.0
85.0
90.0
95.0
90.0
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition/elective rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
2.7
3.5
4.7
3.8
4.8
4.7
3.4
3.6
4.4
3.6
4.2
4.8
4.0
4.7
4.2
4.1
4.4
3.8
3.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_IMP-I3
Figure PD_IMP-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
89
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering COMLEX-USA Level 3 score or medical school handling of virtual rotations in deciding which
applicants to rank.
0.0
0.0
5.0
10.0
20.0
15.0
15.0
15.0
45.0
35.0
20.0
10.0
65.0
55.0
40.0
70.0
25.0
35.0
40.0
65.0
40.0
60.0
60.0
80.0
55.0
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic science
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
1.0
3.0
3.5
3.7
5.0
4.7
2.9
3.3
3.8
3.5
4.1
3.3
4.0
3.6
4.6
3.7
3.6
3.7
4.5
3.5
3.5
3.8
3.4
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_IMP-R1
Figure PD_IMP-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1,2
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
90
1
Rated on a scale of 1 (not at all important) to 5 (very important)
5.0
10.0
5.0
15.0
10.0
10.0
5.0
20.0
30.0
30.0
25.0
75.0
55.0
45.0
60.0
80.0
60.0
70.0
55.0
55.0
65.0
75.0
80.0
80.0
80.0
75.0
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.9
4.0
3.6
4.3
5.0
4.5
3.7
4.5
4.0
3.2
4.0
4.3
4.5
3.7
4.3
4.7
4.8
3.6
4.2
3.9
4.0
4.6
4.8
4.6
4.8
4.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_IMP-R3
Figure PD_IMP-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
91
Neurology, Total n = 29
NRMP Program Director Survey Results, 2021
92
.
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
(Total n = 29)
6
636
307
285
94
81
74
0
100
200
300
400
500
600
700
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_N-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
93
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 28)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_N-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
94
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 25)
1
Some percentages may not add to 100 because of rounding.
18
10
41
4
4
23
48
23
56
58
100
59
43
36
40
38
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_N-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
95
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 29)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
25
21
36
35
7
21
50
36
23
25
45
31
31
54
25
46
8
39
17
52
7
4
18
69
3
10
62
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_N-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
96
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 25)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
12 12
4
33
38
4
40
60
44
16
25
38
30
26
40
20
32
4
33
17
52
13
8 8
20
80
8
8
13
61
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_N-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
97
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 27)
1
Some percentages may not add to 100 because of rounding.
0
8
16
38
5
5
0
24
44
33
57
59
100
68
40
29
38
36
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_N-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
98
1
Rated on a scale of 1 (not at all important) to 5 (very important)
10.3
24.1
27.6
31.0
31.0
31.0
44.8
58.6
72.4
65.5
65.5
58.6
65.5
62.1
69.0
65.5
69.0
75.9
75.9
82.8
72.4
89.7
93.1
96.6
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical schools handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
4.0
3.6
3.4
4.0
2.9
3.7
4.1
4.0
3.4
3.7
3.8
3.9
3.8
3.7
3.5
3.7
4.2
4.4
3.9
4.1
4.4
3.9
3.8
4.5
3.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical schools handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_N-I1
Figure PD_N-I2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Interview (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
99
1
Rated on a scale of 1 (not at all important) to 5 (very important)
24.1
34.5
44.8
37.9
24.1
34.5
41.4
34.5
69.0
72.4
72.4
75.9
65.5
79.3
79.3
93.1
75.9
86.2
93.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.4
3.7
4.6
3.4
4.0
3.5
3.7
4.0
3.9
4.1
3.8
4.4
4.1
4.6
3.9
4.3
3.8
3.9
4.2
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_N-I3
Figure PD_N-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
100
1
Rated on a scale of 1 (not at all important) to 5 (very important)
13.8
24.1
24.1
20.7
24.1
34.5
31.0
27.6
34.5
37.9
48.3
41.4
44.8
58.6
44.8
58.6
41.4
51.7
51.7
55.2
58.6
69.0
72.4
82.8
79.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
2.8
3.6
3.6
3.3
4.0
3.6
4.6
3.9
3.2
3.6
3.7
3.8
3.9
4.0
4.1
3.9
4.5
3.7
3.7
4.1
4.6
4.1
3.7
4.4
3.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_N-R1
Figure PD_N-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
101
1
Rated on a scale of 1 (not at all important) to 5 (very important)
10.3
10.3
17.2
6.9
27.6
31.0
31.0
10.3
31.0
31.0
31.0
48.3
55.2
65.5
62.1
79.3
79.3
72.4
65.5
75.9
86.2
58.6
86.2
82.8
89.7
93.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.0
3.3
4.0
4.0
4.9
3.7
3.3
4.3
4.0
3.3
4.6
3.7
3.8
3.9
3.8
4.4
4.7
3.6
4.4
4.0
4.6
4.4
4.8
4.5
4.9
4.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_N-R3
Figure PD_N-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
102
Neurological Surgery, Total n = 19
NRMP Program Director Survey Results, 2021
103
.
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
(Total n = 19)
2
298
114
201
52
46
38
0
50
100
150
200
250
300
350
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_NS-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
104
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 19)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_NS-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
105
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 19)
1
Some percentages may not add to 100 because of rounding.
32
47
22
26
58
38
42
67
68
100
11
63
11
11
5
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_NS-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
106
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 18)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
56
22
6
6
60
27
13
8
11
50
33
6
13
47
40
8
33
17
22
27
20
20
11
39
88
7
27
85
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_NS-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
107
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 12)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
58
42
8
10
36
27
17
25
33
10
9
18
10
17
8
25
9
20
11
8
25
33
80
46
55
70
89
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_NS-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
108
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 18)
1
Some percentages may not add to 100 because of rounding.
36
6
39
21
29
57
44
54
64
64
100
7
50
8
14
7
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_NS-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
109
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering Sigma Sigma Phi membership, or USMLE Step 3 or COMLEX-USA Level 3 scores, in deciding
which applicants to interview.
5.3
0.0
0.0
0.0
36.8
5.3
26.3
21.1
26.3
42.1
36.8
15.8
36.8
5.3
57.9
10.5
52.6
10.5
63.2
63.2
31.6
73.7
68.4
73.7
89.5
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.0
3.6
3.0
4.0
4.8
4.6
4.1
3.6
4.3
4.4
4.0
3.7
4.5
4.2
4.5
4.6
4.0
4.7
4.1
3.9
3.6
4.2
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_NS-I1
Figure PD_NS-I2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Interview (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Interview
1,2
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
110
1
Rated on a scale of 1 (not at all important) to 5 (very important)
21.1
47.4
21.1
10.5
21.1
15.8
73.7
26.3
52.6
52.6
42.1
52.6
57.9
63.2
52.6
68.4
68.4
68.4
94.7
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
4.5
4.6
4.8
5.0
4.3
3.3
4.6
4.2
4.0
4.0
3.8
4.5
4.1
4.5
3.9
4.8
3.9
4.1
4.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_NS-I3
Figure PD_NS-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
111
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering Sigma Sigma Phi membership, USMLE Step 3 or COMLEX-USA Level 3 scores, or medical
school handling of virtual rotations in deciding which applicants to rank.
0.0
0.0
0.0
15.8
0.0
5.3
15.8
5.3
21.1
36.8
36.8
10.5
5.3
42.1
31.6
36.8
10.5
10.5
5.3
36.8
26.3
42.1
68.4
42.1
78.9
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
4.0
3.0
4.3
5.0
4.0
4.1
4.0
4.0
5.0
4.0
4.2
4.3
4.5
5.0
5.0
4.3
4.4
4.0
4.0
3.9
4.4
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_NS-R1
Figure PD_NS-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1,2
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
112
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering second interviews/visits in deciding which applicants to rank.
0.0
26.3
5.3
26.3
15.8
47.4
5.3
10.5
10.5
63.2
26.3
31.6
21.1
26.3
26.3
42.1
42.1
47.4
47.4
73.7
63.2
26.3
73.7
78.9
73.7
89.5
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
4.6
4.0
4.0
4.7
4.4
4.0
4.5
4.5
4.4
4.0
4.3
4.0
4.0
4.5
4.6
4.0
4.2
4.6
4.7
4.4
4.9
4.8
4.6
4.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Volunteer/extracuricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_NS-R3
Figure PD_NS-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1,2
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
113
Obstetrics and Gynecology, Total n = 89
NRMP Program Director Survey Results, 2021
114
.
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
(Total n = 89)
6
652
300
375
91
81
75
0
100
200
300
400
500
600
700
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_OG-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
115
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 87)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_OG-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
116
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 81)
1
Some percentages may not add to 100 because of rounding.
2
16
7
37
33
55
7
37
64
45
52
37
92
47
29
18
15
7
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_OG-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
117
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 87)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
44
35
7
5
33 33
12
3
15
34
35
10
13
22
21
19
39
26
42
6
38
28
43
9
2
6
17
80
15
17
24
69
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_OG-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
118
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 78)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
33
30
5
1
32
31
7
5
35
39
40
10
14
19
33
9
28
27
40
8
30
26
29
7
4
5
14
81
24
24
33
79
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_OG-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
119
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 83)
1
Some percentages may not add to 100 because of rounding.
1
10
7
33
27
61
30
54
43
59
34
99
61
39
24
14
5
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_OG-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
120
1
Rated on a scale of 1 (not at all important) to 5 (very important)
4.5
7.9
11.2
21.3
28.1
29.2
31.5
42.7
33.7
55.1
53.9
64.0
53.9
43.8
53.9
43.8
56.2
50.6
76.4
71.9
71.9
79.8
78.7
84.3
84.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
2.0
3.6
3.5
2.9
3.2
3.5
3.6
4.0
4.0
3.5
3.5
3.7
3.6
3.7
3.5
3.7
4.1
4.3
4.0
3.8
4.5
3.9
3.7
4.1
3.6
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_OG-I1
Figure PD_OG-I2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Interview (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
121
1
Rated on a scale of 1 (not at all important) to 5 (very important)
14.6
22.5
31.5
52.8
32.6
25.8
57.3
46.1
69.7
66.3
77.5
79.8
78.7
73.0
78.7
76.4
88.8
84.3
88.8
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.4
4.1
4.6
3.3
3.9
4.2
3.6
4.1
4.2
4.0
4.0
4.3
4.0
4.6
4.3
4.3
4.2
4.0
4.0
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_OG-I3
Figure PD_OG-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
122
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2.2
4.5
6.7
13.5
9.0
11.2
16.9
7.0
19.1
22.5
20.2
15.7
27.0
27.0
28.1
32.6
20.2
23.6
24.7
36.0
29.2
36.0
42.7
49.4
39.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
2.5
4.5
3.7
3.5
3.4
4.4
4.3
3.9
3.8
3.9
4.4
4.2
3.8
3.5
3.9
4.0
4.7
3.8
3.7
3.9
4.7
3.7
3.8
3.8
3.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_OG-R1
Figure PD_OG-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
123
1
Rated on a scale of 1 (not at all important) to 5 (very important)
3.4
5.6
9
15.7
14.6
19.1
21.3
10.1
27
31.5
32.6
39.3
53.9
41.6
65.2
64
65.2
56.2
62.9
55.1
60.7
75.3
78.7
86.5
80.9
82
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.7
3.6
3.6
3.9
4.8
3.9
3.5
4.3
3.5
3.6
4.3
4.1
4.1
4.2
4.2
4.2
4.7
3.7
4.1
4.0
4.3
4.5
4.9
4.8
4.8
4.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_OG-R3
Figure PD_OG-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
124
Orthopaedic Surgery, Total n = 36
NRMP Program Director Survey Results, 2021
125
.
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
(Total n = 35)
5
655
244
366
68
62
55
0
100
200
300
400
500
600
700
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_OS-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
126
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 34)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_OS-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
127
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 35)
1
Some percentages may not add to 100 because of rounding.
4
28
14
54
53
77
18
47
62
34
44
21
79
25
24
11
3
3
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_OS-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
128
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 34)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
74
35
9
7
47
28
11
21
44
27
10
5
11
11
17
3
12
29
7
5
11
28
11
3
9
35
77
42
50 50
72
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_OS-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
129
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 28)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
61
39
7
4
36
32
14
12
32
39
32
15
14
18
14
8
4
11
25
11
11
4
4
11
36
70
50 50
61
76
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_OS-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
130
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 31)
1
Some percentages may not add to 100 because of rounding.
3
25
10
58
61
75
7
38
55
25
26
17
90
38
36
17
13
8
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_OS-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
131
1
Rated on a scale of 1 (not at all important) to 5 (very important)
5.6
2.8
5.6
19.4
19.4
8.3
36.1
22.2
25.0
36.1
30.6
50.0
69.4
25.0
66.7
33.3
63.9
22.2
50.0
63.9
41.7
86.1
77.8
69.4
94.4
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.0
4.0
3.5
3.9
3.4
3.7
3.4
4.1
4.0
3.8
3.2
3.9
3.7
3.7
3.5
3.8
3.9
4.9
4.0
3.9
4.6
4.1
3.6
3.7
3.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_OS-I1
Figure PD_OS-I2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Interview (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
132
1
Rated on a scale of 1 (not at all important) to 5 (very important)
19.4
16.7
11.1
5.6
13.9
19.4
61.1
61.1
55.6
69.4
55.6
77.8
63.9
80.6
63.9
55.6
83.3
91.7
88.9
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.8
3.3
4.8
3.5
2.8
4.4
3.8
4.5
4.1
4.4
3.8
4.3
3.9
4.4
4.1
4.1
3.7
3.5
4.4
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Interest in academic career
Away rotation in specialty elsewhere
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_OS-I3
Figure PD_OS-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
133
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering COMLEX-USA Level 3 score in deciding which applicants to rank.
2.8
0.0
2.8
11.1
11.1
8.3
11.1
13.9
27.8
25.0
13.9
8.3
22.2
44.4
33.3
8.3
8.3
22.2
22.2
50.0
8.3
38.9
38.9
41.7
52.8
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
4.0
4.0
3.8
4.0
3.7
4.3
3.8
3.5
3.3
3.8
4.3
4.1
4.0
4.2
4.0
5.0
3.8
3.7
4.2
5.0
3.9
4.0
3.7
4.0
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_OS-R1
Figure PD_OS-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1,2
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
134
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering second interview/visit in deciding which applicants to rank.
0.0
5.6
5.6
5.6
11.1
5.6
5.6
11.1
2.8
41.7
52.8
30.6
41.7
47.2
41.7
58.3
50.0
55.6
44.4
63.9
30.6
72.2
75.0
69.4
77.8
83.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
4.5
3.5
5.0
4.5
4.5
3.0
4.0
4.0
3.9
4.5
3.9
4.2
4.7
4.1
4.2
4.4
3.9
3.8
4.3
4.2
3.9
4.8
4.7
4.9
4.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_OS-R3
Figure PD_OS-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1,2
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
135
Otolaryngology, Total n = 28
NRMP Program Director Survey Results, 2021
136
.
M
ean Numbers of Applications Received, Interview Invitations,
Interviews, and Applicants Ranked, 2021
(Total n = 28)
3
407
67
340
56
49
46
0
50
100
150
200
250
300
350
400
450
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_O-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
137
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 28)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_O-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
138
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 26)
1
Some percentages may not add to 100 because of rounding.
32
74
42
54
6
52
80
17
50
42
94
16
20
9
8
4
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_O-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
139
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 28)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
54
7
4
47
18
52
31
7
18
65
47
12
29
19
19
4
24
6
12
22
46
89
12
29
41
88
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_O-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
140
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 19)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
53
16
32
58
42
16
16
32
26
11
16
21
16
5
21
16
16
11
21
42
79
47
53
58
79
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_O-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
141
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 28)
1
Some percentages may not add to 100 because of rounding.
28
59
53
47
4
50
54
29 41
47
96
22
46
12
6
6
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_O-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
142
1
Rated on a scale of 1 (not at all important) to 5 (very important)
3.6
3.6
7.1
14.3
39.3
7.1
35.7
46.4
35.7
53.6
32.1
64.3
71.4
7.1
67.9
14.3
53.6
14.3
82.1
53.6
35.7
92.9
57.1
85.7
89.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
4.0
1.0
1.0
3.3
3.0
2.0
3.7
3.8
3.5
3.5
2.6
3.3
3.4
2.0
3.6
3.3
4.1
4.0
4.0
3.7
4.2
4.0
3.3
3.8
3.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_O-I1
Figure PD_O-I2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Interview (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
143
1
Rated on a scale of 1 (not at all important) to 5 (very important)
17.9
39.3
10.7
17.9
35.7
35.7
78.6
53.6
67.9
75.0
71.4
78.6
82.1
75.0
82.1
75.0
85.7
89.3
96.4
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.3
3.8
5.0
2.8
3.3
3.4
4.4
4.2
3.7
4.3
4.2
4.5
4.6
4.8
3.9
4.4
4.1
3.9
4.5
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_O-I3
Figure PD_O-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
144
1
Rated on a scale of 1 (not at all important) to 5 (very important)
7.1
3.6
7.1
14.3
7.1
7.1
14.3
10.7
25.0
28.6
17.9
10.7
21.4
28.6
25.0
21.4
7.1
10.7
7.1
35.7
17.9
35.7
35.7
46.4
53.6
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical schools handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
2.5
1.0
1.5
3.3
3.5
2.5
3.3
3.7
3.3
3.3
2.2
4.0
3.5
3.8
3.7
3.5
2.5
2.7
2.5
3.8
4.0
3.6
3.6
3.2
3.5
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_O-R1
Figure PD_O-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
145
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering fluency in language spoken by patient population or second interview/visit in deciding which
applicants to rank.
0.0
3.6
14.3
7.1
3.6
14.3
3.6
7.1
0.0
71.4
32.1
46.4
42.9
50.0
60.7
64.3
67.9
60.7
64.3
75.0
60.7
71.4
92.9
89.3
89.3
92.9
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
2.0
3.0
3.0
3.0
4.0
3.0
4.0
4.1
4.3
4.0
3.7
4.1
3.7
4.4
4.4
3.7
4.4
4.3
4.3
4.0
4.8
4.7
4.9
4.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_O-R3
Figure PD_O-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1,2
Percent of Respondents Endorsing
Mean Importance Rating
NRMP Program Director Survey Results, 2021
146
Pathology-Anatomic and Clinical, Total n = 33
NRMP Program Director Survey Results, 2021
147
M
ean Numbers of Applications Received, Interview Invitations, Interviews, and Applicants
Ranked, 2021
(Total n = 33)
4
504
251
248
68
59
48
0
100
200
300
400
500
600
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_PA-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
148
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 30)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_PA-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
149
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 27)
1
Some percentages may not add to 100 because of rounding.
4 4
15
4 4
7 7
30
35
22
26
89 89
70
50
74
70
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_PA-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
150
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 33)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
27
21
41
38
6
36
49
39
22
28
34
28
50
36
27
42
9
31
28
50
9
3
18
69
16
41
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_PA-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
151
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 33)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
15
9
27
21
6
64
64
46
27
42
49
33
19
9
15
27
9
27
24
39
9
12 12
27
64
3
6
21
72
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_PA-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
152
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 30)
1
Some percentages may not add to 100 because of rounding.
4
14
4
10
13
39
35
36
19
90
87
57
52
64
78
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_PA-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
153
1
Rated on a scale of 1 (not at all important) to 5 (very important)
6.1
24.2
33.3
18.2
36.4
51.5
36.4
39.4
57.6
42.4
60.6
30.3
39.4
81.8
54.5
84.8
57.6
81.8
45.5
75.8
87.9
63.6
93.9
87.9
97.0
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
2.0
2.8
2.9
3.2
3.3
3.3
3.8
4.2
4.1
3.7
3.5
3.2
2.9
3.5
3.3
3.7
4.1
4.6
4.0
3.5
4.6
3.5
3.7
4.0
3.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_PA-I1
Percent of Respondents Endorsing
Figure PD_PA-I2
Education and Academic Performance Characteristics Considered
in Deciding Whom to Interview (%)
Mean Importance of Education and Academic Performance
Characteristics Considered in Deciding Whom to Interview
1
Mean Importance Rating
NRMP Program Director Survey Results, 2021
154
1
Rated on a scale of 1 (not at all important) to 5 (very important)
39.4
24.2
36.4
18.2
36.4
33.3
48.5
42.4
45.5
51.5
45.5
51.5
54.5
69.7
69.7
93.9
78.8
93.9
93.9
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
4.3
4.3
4.8
3.5
3.8
3.8
3.3
4.5
3.8
4.5
3.5
4.1
4.3
4.5
3.8
4.7
3.8
3.9
4.5
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_PA-I3
Percent of Respondents Endorsing
Mean Importance Rating
Figure PD_PA-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
NRMP Program Director Survey Results, 2021
155
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering medical school handling of virtual rotations in deciding which applicants to rank.
0.0
18.2
24.2
27.3
9.1
39.4
39.4
36.4
33.3
30.3
45.5
51.5
12.1
27.3
45.5
36.4
60.6
72.7
66.7
45.5
69.7
60.6
78.8
78.8
81.8
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
2.8
3.0
3.0
3.3
3.6
3.9
3.6
3.3
3.4
3.7
4.0
3.3
3.1
3.7
3.8
4.7
4.0
3.7
3.5
4.6
3.5
3.7
3.9
4.0
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_PA-R1
Percent of Respondents Endorsing
Mean Importance Rating
Figure PD_PA-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
NRMP Program Director Survey Results, 2021
156
1
Rated on a scale of 1 (not at all important) to 5 (very important)
15.2
33.3
18.2
24.2
33.3
36.4
24.2
15.2
21.2
33.3
42.4
33.3
33.3
60.6
51.5
57.6
72.7
72.7
78.8
84.8
90.9
69.7
93.9
93.9
93.9
100.0
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
4.2
4.2
3.7
3.9
4.8
3.8
4.0
4.2
4.3
3.6
4.2
3.6
3.6
4.4
3.9
4.2
4.6
3.8
4.3
4.4
4.8
4.1
4.8
4.7
4.8
4.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_PA-R3
Percent of Respondents Endorsing
Figure PD_PA-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Mean Importance Rating
NRMP Program Director Survey Results, 2021
157
Pediatrics, Total n = 46
NRMP Program Director Survey Results, 2021
158
M
ean Numbers of Applications Received, Interview Invitations, Interviews, and Applicants
Ranked, 2021
(Total n = 46)
13
1018
525
454
217
185
176
0
200
400
600
800
1000
1200
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_P-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
159
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 45)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_P-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
160
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 40)
1
Some percentages may not add to 100 because of rounding.
3
3
3
22
21
30
3
26
65
51
45
50
94
71
32
27
34
20
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_P-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
161
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 45)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
36
30
7
2
53
42
13
3
13
39
33
7
13
29
32
11
51
27
37
32
21
34
8
5
23
91
3
8
21
79
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_P-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
162
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 45)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
16 16
2 2
40
33
7
38
49
34
2
13 27
23
5
31
20
23
40
31
36
2
16 16
41
95
7
9
34
93
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_P-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
163
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 41)
1
Some percentages may not add to 100 because of rounding.
19
11
21
12
55
41
43
47
100
88
45
41
46
32
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_P-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
164
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering COMLEX-USA Level 3 score or medical school handling of virtual rotations in deciding which
applicants to interview.
0.0
0.0
4.3
23.9
13.0
21.7
32.6
43.5
45.7
34.8
34.8
47.8
45.7
56.5
45.7
69.6
41.3
69.6
65.2
65.2
78.3
73.9
65.2
91.3
84.8
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
1.0
3.5
3.2
4.5
3.3
4.2
3.8
3.0
4.3
3.3
3.4
3.7
3.0
3.5
3.9
4.5
3.9
3.4
4.5
4.0
3.8
4.4
3.6
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_P-I1
Percent of Respondents Endorsing
Figure PD_P-I2
Education and Academic Performance Characteristics Considered
in Deciding Whom to Interview (%)
Mean Importance of Education and Academic Performance
Characteristics Considered in Deciding Whom to Interview
1
Mean Importance Rating
NRMP Program Director Survey Results, 2021
165
1
Rated on a scale of 1 (not at all important) to 5 (very important)
8.7
8.7
21.7
30.4
37.0
30.4
21.7
45.7
56.5
47.8
69.6
60.9
52.2
65.2
78.3
73.9
80.4
80.4
78.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.0
3.3
5.0
3.5
3.8
4.3
2.7
3.9
3.7
4.0
3.8
4.0
4.2
4.3
4.0
4.1
4.2
3.6
3.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition/elective rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_P-I3
Percent of Respondents Endorsing
Mean Importance Rating
Figure PD_P-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
NRMP Program Director Survey Results, 2021
166
1
Rated on a scale of 1 (not at all important) to 5 (very important)
4.3
2.2
4.3
10.9
21.7
19.6
21.7
28.3
17.4
19.6
23.9
41.3
47.8
45.7
30.4
41.3
50.0
56.5
50.0
52.2
56.5
54.3
65.2
76.1
67.4
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.5
2.8
3.4
4.1
3.2
3.4
3.6
4.0
3.4
3.2
3.7
3.9
4.0
3.8
4.3
3.0
3.5
4.2
4.3
4.3
3.5
3.7
4.3
3.9
3.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
Awards/honors in basic sciences
Sigma Sigma Phi membership
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Grades in required clerkships
Class ranking/quartile
MSPE
COMLEX-USA Level 3 score
USMLE Step 3 score
Passing COMLEX-USA Level 2 PE
Passing USMLE Step 2 CS
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Any failed attempt at USMLE
USMLE Step 2 CK score
USMLE Step 1 score
Figure PD_P-R1
Percent of Respondents Endorsing
Mean Importance Rating
Figure PD_P-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
NRMP Program Director Survey Results, 2021
167
1
Rated on a scale of 1 (not at all important) to 5 (very important)
4.3
4.3
6.5
19.6
21.7
8.7
8.7
13.0
23.9
17.4
32.6
63.0
54.3
43.5
67.4
56.5
58.7
67.4
50.0
69.6
56.5
78.3
84.8
84.8
95.7
91.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
4.5
4.5
3.5
3.8
4.6
3.5
3.3
4.3
3.6
3.3
4.2
3.6
3.7
3.8
4.2
3.9
4.4
3.6
4.0
3.7
4.1
4.3
4.8
4.6
4.8
4.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_P-R3
Percent of Respondents Endorsing
Figure PD_P-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Mean Importance Rating
NRMP Program Director Survey Results, 2021
168
Physical Medicine and Rehabilitation, Total n = 29
NRMP Program Director Survey Results, 2021
169
M
ean Numbers of Applications Received, Interview Invitations, Interviews, and Applicants
Ranked, 2021
(Total n = 28)
6
440
130
296
87
76
71
0
50
100
150
200
250
300
350
400
450
500
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_PMR-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
170
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 28)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Summary of Program Interviewing and Ranking Activities
Figure PD_PMR-2
NRMP Program Director Survey Results, 2021
171
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 25)
1
Some percentages may not add to 100 because of rounding.
4
16
28
42
4 4
68
56
44
50
96 96
28 28 28
8
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Summary of Program Interviewing and Ranking Activities
Figure PD_PMR-3
NRMP Program Director Survey Results, 2021
172
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 29)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
31
24
3
46
36
24 38
38
14
23
23
36
18
41 28
35
4
27
27
41
14
3
10
24
82
5
14
23
68
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_PMR-4
NRMP Program Director Survey Results, 2021
173
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 29)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
17
21
7
3
31
24
10
4
41
35
38
14
28
45
41
18
17
14
14
3
41
24
28
4
24
31
41
79
7
21
75
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_PMR-5
NRMP Program Director Survey Results, 2021
174
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 29)
1
Some percentages may not add to 100 because of rounding.
7
15
24
35
3
3
63
54
52
52
97 97
30
31
24
13
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Program Ranking Behavior
Figure PD_PMR-6
NRMP Program Director Survey Results, 2021
175
1
Rated on a scale of 1 (not at all important) to 5 (very important)
10.3
13.8
17.2
48.3
37.9
62.1
41.4
44.8
48.3
51.7
69.0
75.9
62.1
75.9
72.4
86.2
75.9
93.1
69.0
75.9
93.1
79.3
72.4
96.6
89.7
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.7
2.7
3.0
3.1
3.4
3.7
3.4
4.2
4.2
3.4
3.8
3.3
3.3
3.7
3.5
3.6
4.1
4.5
4.0
4.0
4.5
3.8
3.9
3.9
3.6
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Education and Academic Performance Characteristics Considered
in Deciding Whom to Interview (%)
Mean Importance of Education and Academic Performance
Characteristics Considered in Deciding Whom to Interview
1
Mean Importance Rating
Figure PD_PMR-I1
Figure PD_PMR-I2
NRMP Program Director Survey Results, 2021
176
1
Rated on a scale of 1 (not at all important) to 5 (very important)
51.7
41.4
20.7
10.3
27.6
37.9
62.1
55.2
62.1
69.0
75.9
72.4
75.9
86.2
79.3
96.6
89.7
79.3
100.0
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.9
3.3
5.0
2.0
4.0
3.7
3.7
4.0
3.7
3.9
4.1
4.1
4.5
4.5
4.1
4.2
3.7
3.9
4.3
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Percent of Respondents Endorsing
Mean Importance Rating
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Figure PD_PMR-I3
Figure PD_PMR-I4
NRMP Program Director Survey Results, 2021
177
1
Rated on a scale of 1 (not at all important) to 5 (very important)
3.4
6.9
13.8
31.0
31.0
37.9
31.0
24.1
41.4
41.4
34.5
41.4
44.8
41.4
48.3
44.8
65.5
58.6
55.2
51.7
65.5
55.2
51.7
69.0
58.6
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
5.0
3.0
3.3
3.4
3.6
3.7
4.0
3.4
3.6
3.4
3.7
4.2
3.5
3.7
3.9
3.9
4.4
3.8
3.7
3.7
4.4
3.9
3.8
3.8
3.8
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Mean Importance Rating
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Figure PD_PMR-R1
Figure PD_PMR-R2
NRMP Program Director Survey Results, 2021
178
1
Rated on a scale of 1 (not at all important) to 5 (very important)
10.3
24.1
13.8
20.7
20.7
24.1
20.7
27.6
13.8
48.3
44.8
75.9
58.6
69.0
69.0
72.4
75.9
82.8
72.4
86.2
72.4
82.8
86.2
86.2
89.7
93.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.7
4.0
3.8
4.2
4.3
3.6
3.5
4.1
3.3
3.6
4.1
4.0
3.8
4.2
3.6
4.2
4.4
3.5
4.2
4.2
4.4
3.9
4.6
4.5
4.7
4.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Percent of Respondents Endorsing
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Mean Importance Rating
Figure PD_PMR-R3
Figure PD_PMR-R4
NRMP Program Director Survey Results, 2021
179
Plastic Surgery (Integrated), Total n = 15
NRMP Program Director Survey Results, 2021
180
M
ean Numbers of Applications Received, Interview Invitations, Interviews, and Applicants
Ranked, 2021
(Total n = 15)
2
282
87
245
42
35
31
0
50
100
150
200
250
300
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_PS-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
181
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 15)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Figure PD_PS-2
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
182
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 15)
1
Some percentages may not add to 100 because of rounding.
29
43
20
27
64
64
50
60
60
100
7
36
7
20
13
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Figure PD_PS-3
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
183
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 15)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
40
13
46
17
53
67
53
14
46
58
58
25
7
0
13
7
0
0
8
8
20
33
79
9
25
33
67
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_PS-4
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
184
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 11)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
36
18
9
55
64
46
18
27 27
30
18
9
9
9
9
18
36
73
64
73
70
82
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Figure PD_PS-5
Use of Standardized Licensure Exams to Select Applicants for
Interview
NRMP Program Director Survey Results, 2021
185
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 14)
1
Some percentages may not add to 100 because of rounding.
42
8
58
64
46
50
58
33
18
36
100
8
33
8
18
18
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Figure PD_PS-6
Program Ranking Behavior
NRMP Program Director Survey Results, 2021
186
1
Rated on a scale of 1 (not at all important) to 5 (very important)
6.7
6.7
6.7
26.7
46.7
13.3
46.7
46.7
60.0
60.0
33.3
46.7
73.3
13.3
66.7
13.3
60.0
26.7
60.0
53.3
53.3
73.3
66.7
73.3
93.3
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
1.0
3.0
3.0
2.0
3.9
3.5
3.6
4.3
3.2
4.6
3.0
3.4
3.6
4.0
3.9
4.0
4.1
5.0
4.8
4.5
4.9
4.6
3.7
3.9
4.2
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_PS-I1
Percent of Respondents Endorsing
Figure PD_PS-I2
Education and Academic Performance Characteristics Considered
in Deciding Whom to Interview (%)
Mean Importance of Education and Academic Performance
Characteristics Considered in Deciding Whom to Interview
1
Mean Importance Rating
NRMP Program Director Survey Results, 2021
187
1
Rated on a scale of 1 (not at all important) to 5 (very important)
18.9
60.0
27.8
6.7
33.4
35.5
80.0
44.8
60.0
63.6
73.3
86.7
73.3
66.7
73.3
73.3
73.3
73.3
85.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
4.0
3.8
4.8
5.0
4.0
4.0
4.2
4.3
3.8
4.6
3.6
4.4
4.0
4.6
4.2
4.5
4.3
3.7
5.0
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Figure PD_PS-I3
Percent of Respondents Endorsing
Mean Importance Rating
Figure PD_PS-I4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
NRMP Program Director Survey Results, 2021
188
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering USMLE Step 3, or COMLEX-USA Level 2 PE or Level 3, scores in deciding which applicants to
rank.
6.7
0.0
0.0
26.7
6.7
0.0
13.3
20.0
46.7
40.0
20.0
26.7
20.0
40.0
33.3
26.7
20.0
13.3
6.7
46.7
33.3
33.3
46.7
33.3
66.7
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
1.0
4.0
2.0
4.5
4.3
4.2
4.0
3.3
3.5
4.0
4.2
4.4
4.8
4.7
4.0
5.0
4.6
4.4
3.2
3.3
4.0
4.0
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Figure PD_PS-R1
Percent of Respondents Endorsing
Mean Importance Rating
Figure PD_PS-R2
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1,2
NRMP Program Director Survey Results, 2021
189
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering second interview/visit in deciding which applicants to rank.
0.0
20.0
6.7
20.0
33.3
53.3
13.3
6.7
6.7
60.0
26.7
40.0
53.3
60.0
46.7
60.0
66.7
40.0
66.7
86.7
60.0
66.7
80.0
86.7
73.3
86.7
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
4.3
1.0
4.0
4.6
3.9
3.5
4.0
4.0
3.8
4.8
4.2
3.9
4.8
4.1
4.6
4.7
4.2
4.0
4.9
4.4
4.3
4.8
4.8
4.7
4.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Figure PD_PS-R3
Percent of Respondents Endorsing
Figure PD_PS-R4
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Mean Importance Rating
NRMP Program Director Survey Results, 2021
190
Psychiatry, Total n = 61
NRMP Program Director Survey Results, 2021
191
M
ean Numbers of Applications Received, Interview Invitations, Interviews, and Applicants
Ranked, 2021
(Total n = 61)
7
971
458
403
100
91
80
0
200
400
600
800
1000
1200
Quota Applications
rec'd
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_Psy-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
192
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 61)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Summary of Program Interviewing and Ranking Activities
Figure PD_Psy-2
NRMP Program Director Survey Results, 2021
193
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 50)
1
Some percentages may not add to 100 because of rounding.
9
6
27
16
29
5
24
73
59
62
65
95
67
21
14
22
6
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Summary of Program Interviewing and Ranking Activities
Figure PD_Psy-3
NRMP Program Director Survey Results, 2021
194
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 61)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
25 25
8
2
38
34
17
6
15
38
38
25
9
28
27
27
57
28
23
7
51
30
31
14
3
10
30
67
2
8
25
53
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_Psy-4
NRMP Program Director Survey Results, 2021
195
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 56)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
23
21
5
2
24
22
7
2
34
45
39
26
22
36
41
28
30
20
21
7
43
29
26
10
13
14
34
66
11
13
26
60
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_Psy-5
NRMP Program Director Survey Results, 2021
196
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 59)
1
Some percentages may not add to 100 because of rounding.
6
12
23
12
30
5
17
58
60
53
53
95
78
31
17
35
17
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Program Ranking Behavior
Figure PD_Psy-6
NRMP Program Director Survey Results, 2021
197
1
Rated on a scale of 1 (not at all important) to 5 (very important)
6.6
9.8
13.1
14.8
11.5
34.4
41.0
47.5
60.7
42.6
44.3
54.1
42.6
55.7
50.8
52.5
57.4
63.9
73.8
65.6
75.4
72.1
73.8
90.2
65.6
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
2.7
3.2
3.0
3.3
3.0
3.4
3.7
4.5
4.0
4.0
3.2
4.0
3.5
3.4
3.4
3.4
3.8
4.3
4.3
3.7
4.3
4.0
3.5
4.0
3.4
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Education and Academic Performance Characteristics Considered
in Deciding Whom to Interview (%)
Mean Importance of Education and Academic Performance
Characteristics Considered in Deciding Whom to Interview
1
Mean Importance Rating
Figure PD_Psy-I1
Figure PD_Psy-I2
NRMP Program Director Survey Results, 2021
198
1
Rated on a scale of 1 (not at all important) to 5 (very important)
9.8
32.8
39.3
47.5
23.0
41.0
29.5
42.6
68.9
59.0
65.6
59.0
77.0
70.5
80.3
90.2
86.9
90.2
78.7
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.6
4.2
3.2
3.8
3.9
4.2
4.3
4.7
4.3
4.5
4.4
4.3
3.3
4.8
3.6
4.0
4.1
4.0
4.2
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Interest in academic career
Fluency in language of pt population
Involvement and interest in research
Other life experience
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Away rotation in specialty elsewhere
NRMP flag for match violation
Visa status
Ability to work legally w/o visa
Audition elective/rotation in PD's dept
Personal prior knowledge of applicant
Letters of recommendation in specialty
Percent of Respondents Endorsing
Mean Importance Rating
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Figure PD_Psy-I3
Figure PD_Psy-I4
NRMP Program Director Survey Results, 2021
199
1
Rated on a scale of 1 (not at all important) to 5 (very important)
3.3
6.6
6.6
8.2
13.1
24.6
24.6
26.2
24.6
29.5
31.1
50.8
39.3
27.9
39.3
37.7
42.6
41.0
50.8
44.3
54.1
55.7
59.0
62.3
50.8
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
2.5
3.0
2.8
3.0
4.0
3.3
4.3
3.7
3.9
3.8
3.4
4.0
4.0
3.8
3.9
4.1
4.4
3.6
3.7
3.8
4.3
3.6
3.8
4.1
3.6
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Mean Importance Rating
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Figure PD_Psy-R1
Figure PD_Psy-R2
NRMP Program Director Survey Results, 2021
200
1
Rated on a scale of 1 (not at all important) to 5 (very important)
4.9
3.3
19.7
13.1
21.3
26.2
11.5
27.9
37.7
26.2
29.5
36.1
52.5
47.5
60.7
62.3
60.7
75.4
75.4
54.1
85.2
82.0
78.7
78.7
90.2
85.2
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.3
3.5
3.3
3.4
4.7
3.8
3.7
4.5
4.1
3.6
4.2
4.0
4.0
4.3
4.3
4.2
4.7
4.0
4.4
3.9
4.5
4.4
4.8
4.6
4.9
4.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Percent of Respondents Endorsing
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Mean Importance Rating
Figure PD_Psy-R3
Figure PD_Psy-R4
NRMP Program Director Survey Results, 2021
201
Radiology-Diagnostic, Total n = 34
NRMP Program Director Survey Results, 2021
202
M
ean Numbers of Applications Received, Interview Invitations, Interviews, and Applicants
Ranked, 2021
(Total n = 34)
11
644
224
453
123
111
98
0
100
200
300
400
500
600
700
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_RD-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
203
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 34)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Summary of Program Interviewing and Ranking Activities
Figure PD_RD-2
NRMP Program Director Survey Results, 2021
204
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 27)
1
Some percentages may not add to 100 because of rounding.
11
22
7
19
8
19
54
44
63
52
92
70
46
33
30 30
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Summary of Program Interviewing and Ranking Activities
Figure PD_RD-3
NRMP Program Director Survey Results, 2021
205
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 34)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
47
12
3
65
42
13
7
35
71
47
9
23
42
42
17
15
12
18
6
10
10
19
7
3
6
32
85
3
7
26
70
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_RD-4
NRMP Program Director Survey Results, 2021
206
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 31)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
42
16
3
3
33
17
7
45
68
39
13
33
50
33
13
7
7
26
3
7
7
17
3
7
10
32
80
27
27
43
83
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_RD-5
NRMP Program Director Survey Results, 2021
207
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 34)
1
Some percentages may not add to 100 because of rounding.
6
13
9
18
9
18
58
53
55
52
91
76
42
33
36
30
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Program Ranking Behavior
Figure PD_RD-6
NRMP Program Director Survey Results, 2021
208
1
Rated on a scale of 1 (not at all important) to 5 (very important)
8.8
8.8
11.8
20.6
29.4
20.6
29.4
47.1
44.1
50.0
47.1
44.1
70.6
38.2
70.6
50.0
64.7
58.8
52.9
82.4
70.6
73.5
85.3
88.2
97.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.0
3.0
4.3
4.2
3.9
4.7
3.9
4.6
4.1
3.7
4.0
3.8
3.9
4.4
3.4
4.5
4.4
4.9
3.7
4.2
4.8
4.0
4.1
4.4
4.6
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Education and Academic Performance Characteristics Considered
in Deciding Whom to Interview (%)
Mean Importance of Education and Academic Performance
Characteristics Considered in Deciding Whom to Interview
1
Mean Importance Rating
Figure PD_RD-I1
Figure PD_RD-I2
NRMP Program Director Survey Results, 2021
209
1
Rated on a scale of 1 (not at all important) to 5 (very important)
23.5
20.6
35.3
14.7
38.2
44.1
44.1
52.9
64.7
79.4
70.6
67.6
94.1
76.5
88.2
88.2
85.3
91.2
88.2
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.1
4.1
4.8
4.6
4.0
4.2
3.5
4.0
3.7
4.2
3.8
4.1
4.1
4.4
4.0
4.1
3.7
3.6
3.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Percent of Respondents Endorsing
Mean Importance Rating
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Figure PD_RD-I3
Figure PD_RD-I4
NRMP Program Director Survey Results, 2021
210
1
Rated on a scale of 1 (not at all important) to 5 (very important)
5.9
5.9
11.8
26.5
14.7
20.6
26.5
20.6
44.1
32.4
35.3
23.5
26.5
44.1
38.2
26.5
35.3
38.2
32.4
50.0
44.1
64.7
58.8
70.6
76.5
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
4.0
4.0
3.8
3.2
4.6
4.4
4.3
4.7
3.9
4.3
4.3
4.4
4.0
4.2
4.5
4.3
5.0
4.7
4.6
4.3
4.9
4.4
4.4
4.3
4.6
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Mean Importance Rating
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Figure PD_RD-R1
Figure PD_RD-R2
NRMP Program Director Survey Results, 2021
211
1
Rated on a scale of 1 (not at all important) to 5 (very important)
8.8
11.8
14.7
20.6
20.6
32.4
35.3
26.5
8.8
35.3
38.2
44.1
47.1
58.8
55.9
47.1
64.7
67.6
67.6
50.0
70.6
67.6
79.4
70.6
91.2
91.2
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
5.0
4.0
4.4
4.3
4.4
3.6
3.5
4.6
4.7
3.9
4.2
3.9
3.9
4.3
4.0
4.3
4.5
3.7
4.2
4.1
4.2
4.0
4.7
4.7
4.7
4.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Percent of Respondents Endorsing
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Mean Importance Rating
Figure PD_RD-R3
Figure PD_RD-R4
NRMP Program Director Survey Results, 2021
212
Radiology Oncology, Total n = 13
NRMP Program Director Survey Results, 2021
213
M
ean Numbers of Applications Received, Interview Invitations, Interviews, and Applicants
Ranked, 2021
(Total n = 13)
3
112
14
92
48
37
36
0
20
40
60
80
100
120
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_RO-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
214
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 13)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Summary of Program Interviewing and Ranking Activities
Figure PD_RO-2
NRMP Program Director Survey Results, 2021
215
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 10)
1
Some percentages may not add to 100 because of rounding.
13
20
10
22
63
63
60 80
67
100
38
25
20
10
11
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Summary of Program Interviewing and Ranking Activities
Figure PD_RO-3
NRMP Program Director Survey Results, 2021
216
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 12)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
17
20
25
58
42
17
10
40 40
22
58
0
33
25
70
60
50
33
42
25
58
10
44
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_RO-4
NRMP Program Director Survey Results, 2021
217
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 12)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
25
42
67
50
17 17
25
17
8
33 33
25
25
33 17
17
17
25
58
50
58
67
75
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_RO-5
NRMP Program Director Survey Results, 2021
218
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 11)
1
Some percentages may not add to 100 because of rounding.
10
25
33 33
50
50
38
44 44
100
50
40
38
22 22
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Program Ranking Behavior
Figure PD_RO-6
NRMP Program Director Survey Results, 2021
219
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering passing COMLEX-USA Level 2 PE or COMLEX-USA Level 3 scores, or medical school handling
of virtual rotations, in deciding which applicants to interview.
0.0
0.0
15.4
7.7
46.2
0.0
38.5
38.5
23.1
69.2
15.4
38.5
46.2
7.7
53.8
7.7
53.8
30.8
61.5
84.6
38.5
69.2
53.8
76.9
84.6
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
2.5
4.0
2.3
3.6
3.5
4.0
3.2
2.5
3.4
3.3
4.0
3.0
4.0
3.7
4.5
4.0
3.6
4.4
4.1
2.7
4.4
3.5
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Education and Academic Performance Characteristics Considered
in Deciding Whom to Interview (%)
Mean Importance of Education and Academic Performance
Characteristics Considered in Deciding Whom to Interview
1
Mean Importance Rating
Figure PD_RO-I1
Figure PD_RO-I2
NRMP Program Director Survey Results, 2021
220
1
Rated on a scale of 1 (not at all important) to 5 (very important)
38.5
53.8
7.7
15.4
23.1
7.7
76.9
46.2
69.2
38.5
69.2
76.9
76.9
76.9
53.8
76.9
76.9
76.9
61.5
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.3
4.0
4.8
3.0
3.6
4.0
3.6
4.1
3.4
4.0
3.7
4.4
4.3
4.7
3.7
4.5
4.1
3.8
4.2
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Percent of Respondents Endorsing
Mean Importance Rating
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Figure PD_RO-I3
Figure PD_RO-I4
NRMP Program Director Survey Results, 2021
221
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering passing COMLEX-USA Level 2 PE or COMLEX-USA Level 3 scores, or medical school handling
of virtual rotations, in deciding which applicants to rank.
0.0
0.0
7.7
23.1
15.4
0.0
15.4
38.5
23.1
30.8
15.4
15.4
38.5
38.5
69.2
46.2
23.1
7.7
7.7
69.2
30.8
53.8
30.8
76.9
69.2
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.0
3.0
4.0
3.0
3.6
3.0
3.5
3.5
4.0
3.4
3.4
4.0
4.2
5.0
3.0
3.0
3.9
5.0
4.1
2.8
4.3
3.6
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Mean Importance Rating
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Figure PD_RO-R1
Figure PD_RO-R2
NRMP Program Director Survey Results, 2021
222
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2
No respondent reported considering second interview/visit in deciding which applicants to rank.
0.0
46.2
15.4
23.1
15.4
38.5
7.7
15.4
15.4
61.5
46.2
53.8
46.2
53.8
61.5
53.8
61.5
69.2
53.8
61.5
76.9
76.9
61.5
69.2
69.2
69.2
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.5
3.3
2.3
4.0
4.0
3.7
3.0
3.0
3.8
3.8
3.9
3.8
4.1
3.6
4.4
4.6
3.3
4.3
4.6
4.6
4.3
4.8
4.6
4.9
4.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Percent of Respondents Endorsing
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1,2
Mean Importance Rating
Figure PD_RO-R3
Figure PD_RO-R4
NRMP Program Director Survey Results, 2021
223
Surgery-General, Total n = 76
NRMP Program Director Survey Results, 2021
224
M
ean Numbers of Applications Received, Interview Invitations, Interviews, and Applicants
Ranked, 2021
(Total n = 76)
6
1031
611
484
102
89
79
0
200
400
600
800
1000
1200
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_GS-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
225
A
verage Percentages of Applications Rejected and Reviewed, 2021
(Total n = 74)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Summary of Program Interviewing and Ranking Activities
Figure PD_GS-2
NRMP Program Director Survey Results, 2021
226
P
ercentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 68)
1
Some percentages may not add to 100 because of rounding.
2
8
8
27
18
27
3
50
55
55
68
63
95
42
37
19
14
10
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Summary of Program Interviewing and Ranking Activities
Figure PD_GS-3
NRMP Program Director Survey Results, 2021
227
P
ercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 74)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
60
46
8
4
63
53
12
8
28
43
16
7
22
33
12
9
11
11
47
7
11
11
46
6
1
28
82
5
3
29
77
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_GS-4
NRMP Program Director Survey Results, 2021
228
P
ercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 70)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
53
41
6
1
36
33
12
4
33
43
19
4
22
26
12
3
10
10
47
9
9
6
23
10
4
6
29
86
33
35
54
83
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_GS-5
NRMP Program Director Survey Results, 2021
229
P
ercentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 69)
1
Some percentages may not add to 100 because of rounding.
6
3
29
14
15
1
44
56
52
65
72
99
50
41
19
21
13
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Program Ranking Behavior
Figure PD_GS-6
NRMP Program Director Survey Results, 2021
230
1
Rated on a scale of 1 (not at all important) to 5 (very important)
1.3
7.9
7.9
19.7
30.3
22.4
44.7
42.1
32.9
61.8
39.5
56.6
65.8
39.5
69.7
44.7
63.2
42.1
75.0
69.7
71.1
76.3
84.2
85.5
96.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.0
3.2
3.0
3.6
3.1
3.9
3.6
4.1
3.8
3.7
3.7
3.7
3.6
4.0
3.6
4.0
3.9
4.8
4.3
3.9
4.8
4.0
4.0
3.9
4.0
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical schools handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Education and Academic Performance Characteristics Considered
in Deciding Whom to Interview (%)
Mean Importance of Education and Academic Performance
Characteristics Considered in Deciding Whom to Interview
1
Mean Importance Rating
Figure PD_GS-I1
Figure PD_GS-I2
NRMP Program Director Survey Results, 2021
231
1
Rated on a scale of 1 (not at all important) to 5 (very important)
13.2
30.3
26.3
18.4
34.2
32.9
63.2
32.9
65.8
71.1
63.2
81.6
72.4
82.9
75.0
72.4
81.6
84.2
93.4
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.8
4.3
4.9
3.6
3.9
4.4
3.9
4.0
3.9
3.9
3.9
4.5
4.2
4.7
3.9
4.4
4.1
3.8
4.3
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Percent of Respondents Endorsing
Mean Importance Rating
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Figure PD_GS-I3
Figure PD_GS-I4
NRMP Program Director Survey Results, 2021
232
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2.6
1.3
2.6
11.8
10.5
13.2
17.1
21.1
26.3
31.6
22.4
23.7
28.9
39.5
35.5
42.1
22.4
34.2
32.9
43.4
36.8
50.0
65.8
53.9
67.1
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.0
5.0
3.5
3.6
3.9
4.0
4.2
3.9
3.9
3.9
4.2
3.8
3.7
3.6
3.9
4.2
4.8
4.1
4.0
3.9
4.7
3.9
4.0
3.9
4.0
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Mean Importance Rating
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Figure PD_GS-R1
Figure PD_GS-R2
NRMP Program Director Survey Results, 2021
233
1
Rated on a scale of 1 (not at all important) to 5 (very important)
9.2
2.6
14.5
19.7
17.1
27.6
23.7
28.9
9.2
38.2
25.0
44.7
46.1
55.3
68.4
75.0
69.7
57.9
69.7
77.6
68.4
71.1
84.2
84.2
89.5
89.5
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
3.0
3.5
3.7
3.6
4.9
4.5
3.8
4.3
3.9
4.0
4.0
3.9
3.9
4.3
4.1
4.6
4.6
3.7
4.3
4.2
4.5
4.2
4.8
4.7
4.8
4.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Percent of Respondents Endorsing
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Mean Importance Rating
Figure PD_GS-R3
Figure PD_GS-R4
NRMP Program Director Survey Results, 2021
234
Transitional Year, Total n = 31
NRMP Program Director Survey Results, 2021
235
Mean Numbers of Applications Received, Interview Invitations, Interviews, and Applicants
Ranked, 2021
(Total n = 31)
11
738
435
251
114
105
95
0
100
200
300
400
500
600
700
800
Quota Applications
received
Applications
rejected based
on
standardized
screen
Applications
receiving
holistic review
Interview
invitations sent
Applicants
interviewed
Applicants
ranked
Figure PD_TY-1
Summary of Program Interviewing and Ranking Activities
NRMP Program Director Survey Results, 2021
236
Average Percentages of Applications Rejected and Reviewed, 2021
(Total n = 29)
0
10
20
30
40
50
60
70
80
90
100
Percentages of Applications
Rejected based on standardized screen Received holistic review
Summary of Program Interviewing and Ranking Activities
Figure PD_TY-2
NRMP Program Director Survey Results, 2021
237
Percentages of Programs Interviewing Candidates by Applicant Type, 2021
1
(Total n = 28)
1
Some percentages may not add to 100 because of rounding.
5
14
10
36
18
48
5
24
50
32
61
33
90
62
40
32
21
19
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Often Seldom Never
Summary of Program Interviewing and Ranking Activities
Figure PD_TY-3
NRMP Program Director Survey Results, 2021
238
Percentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,
2021
1,2
(Total n = 29)
1
Seniors and graduates are considered together.
2
Some percentages may not add to 100 because of rounding.
64
55
21
14
56 56
19 19
18
31
24
14
15
22
26
15
18
14
28
7
11
4
19
0
28
66
19 19
37
67
0
10
20
30
40
50
60
70
80
90
100
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
USMLE
Step 1
USMLE
Step 2 CK
USMLE
Step 2 CS
USMLE
Step 3
Require target score Prefer but do not require target score Require pass only Do not consider
US MD
Applicants
IMG
Applicants
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_TY-4
NRMP Program Director Survey Results, 2021
239
Percentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 2021
1
(Total n = 28)
2,3
1
DO seniors and DO graduates are considered together.
2
Total number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants for
interview.
3
Some percentages may not add to 100 because of rounding.
46
43
18
11
62
64
18
14
29
36
25
14
15
18
32
14
18
14
29
7
15
11
18
7
7 7
29
68
8
7
32
64
0
10
20
30
40
50
60
70
80
90
100
USMLE Step
1
USMLE Step
2 CK
USMLE Step
2 CS
USMLE Step
3
COMLEX-
USA Level 1
COMLEX-
USA Level 2
CE
COMLEX-
USA Level 2
PE
COMLEX-
USA Level 3
Require target score Prefer but do not require target score Require pass only Do not consider
Use of Standardized Licensure Exams to Select Applicants for
Interview
Figure PD_TY-5
NRMP Program Director Survey Results, 2021
240
Percentages of Programs Ranking Candidates by Applicant Type, 2021
1
(Total n = 28)
1
Some percentages may not add to 100 because of rounding.
4
4
9
22
19
30
15
39
22
57
45
96
82
52
57
24
25
0
10
20
30
40
50
60
70
80
90
100
US MD Sr US DO Sr US MD
Grad
US DO
Grad
US IMG Non-US
IMG
Never Seldom Often
Program Ranking Behavior
Figure PD_TY-6
NRMP Program Director Survey Results, 2021
241
1
Rated on a scale of 1 (not at all important) to 5 (very important)
3.2
16.1
32.3
22.6
22.6
48.4
38.7
54.8
41.9
25.8
64.5
32.3
48.4
71.0
32.3
67.7
61.3
74.2
32.3
67.7
90.3
61.3
96.8
80.6
93.5
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
3.0
2.8
3.6
3.3
3.4
3.7
3.8
4.4
4.0
3.3
3.8
3.2
3.5
4.1
3.3
4.3
4.1
4.6
3.9
3.7
4.5
3.8
4.3
3.8
4.3
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Sigma Sigma Phi membership
Awards/honors in basic sciences
Passing COMLEX-USA Level 2 PE
Medical school reputation
Medical school accreditation status
Continuous medical education w/o gaps
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
GHHS membership
AOA membership
COMLEX-USA Level 2 CE score
Awards/honors in clinical clerkships
COMLEX-USA Level 1 score
Consistency of grades
Any failed attempt at COMLEX-USA
Grades in clerkship in preferred specialty
Class ranking/quartile
Any failed attempt at USMLE
Grades in required clerkships
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Education and Academic Performance Characteristics Considered
in Deciding Whom to Interview (%)
Mean Importance of Education and Academic Performance
Characteristics Considered in Deciding Whom to Interview
1
Mean Importance Rating
Figure PD_TY-I1
Figure PD_TY-I2
NRMP Program Director Survey Results, 2021
242
1
Rated on a scale of 1 (not at all important) to 5 (very important)
6.5
25.8
29.0
25.8
48.4
32.3
35.5
22.6
45.2
45.2
38.7
51.6
71.0
61.3
61.3
41.9
61.3
87.1
67.7
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
3.0
4.1
4.8
3.5
4.3
4.3
4.0
3.7
3.9
3.6
3.4
4.3
4.1
4.4
3.8
4.2
4.0
4.1
3.9
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Away rotation in specialty elsewhere
Interest in academic career
NRMP flag for match violation
Fluency in language of pt population
Visa status
Ability to work legally w/o visa
Involvement and interest in research
Audition elective/rotation in PD's dept
Other life experience
Personal prior knowledge of applicant
Volunteer/extracurricular experience
Leadership qualities
Perceived interest in program
Professionalism and ethics
Having overcome significant obstacles
Perceived commitment to specialty
Diversity characteristics
Personal statement (overall)
Letters of recommendation in specialty
Percent of Respondents Endorsing
Mean Importance Rating
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Interview (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Interview
1
Figure PD_TY-I3
Figure PD_TY-I4
NRMP Program Director Survey Results, 2021
243
1
Rated on a scale of 1 (not at all important) to 5 (very important)
2.6
16.1
16.1
11.8
10.5
41.9
17.1
21.1
26.3
31.6
48.4
23.7
28.9
39.5
35.5
42.1
41.9
54.8
61.3
43.4
51.6
50.0
74.2
53.9
67.7
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
2.5
4.2
4.2
3.5
3.5
4.5
4.5
3.7
4.2
3.8
4.5
4.5
3.4
3.7
4.4
4.0
4.8
4.5
4.4
4.0
4.8
4.1
4.4
4.1
4.4
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
How medical school handled virtual rotations
COMLEX-USA Level 3 score
USMLE Step 3 score
Awards/honors in basic sciences
Sigma Sigma Phi membership
Passing COMLEX-USA Level 2 PE
Medical school accreditation status
Medical school reputation
Awards/honors in clinical clerkships
Awards/honors, clerkship in preferred specialty
Passing USMLE Step 2 CS
Continuous medical education w/o gaps
GHHS membership
AOA membership
Consistency of grades
Grades in clerkship in preferred specialty
Any failed attempt at COMLEX-USA
COMLEX-USA Level 1 score
COMLEX-USA Level 2 CE score
Grades in required clerkships
Any failed attempt at USMLE
Class ranking/quartile
USMLE Step 2 CK score
MSPE
USMLE Step 1 score
Percent of Respondents Endorsing
Mean Importance Rating
Education and Academic Performance Characteristics Considered in Deciding
Whom to Rank (%)
Mean Importance of Education and Academic Performance Characteristics
Considered in Deciding Whom to Rank
1
Figure PD_TY-R1
Figure PD_TY-R2
NRMP Program Director Survey Results, 2021
244
1
Rated on a scale of 1 (not at all important) to 5 (very important)
3.2
3.2
12.9
25.8
22.6
9.7
9.7
29.0
9.7
19.4
9.7
19.4
25.8
35.5
38.7
45.2
51.6
67.7
58.1
41.9
29.0
45.2
64.5
48.4
61.3
80.6
0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
5.0
2.0
4.0
5.0
5.0
4.7
5.0
4.8
2.7
4.7
4.3
4.0
4.4
4.5
3.8
4.7
4.6
4.1
4.3
4.4
4.4
4.0
4.8
4.6
4.8
4.7
1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0
Second interview/visit
Away rotation in specialty elsewhere
Applicant facility with meeting platform tech
Visa status
NRMP flag for match violation
Interest in academic career
Other post-interview contact
Ability to work legally w/o visa
Fluency in language of pt population
Involvement and interest in research
Audition elective/rotation in PD's dept
Volunteer/extracurricular experience
Other life experience
Personal prior knowledge of applicant
Having overcome significant obstacles
Leadership qualities
Professionalism and ethics
Personal statement
Perceived interest in program
Letters of recommendation in specialty
Perceived commitment to specialty
Diversity characteristics
Interactions with house staff during interview/visit
Feedback from current residents
Interactions with faculty during interview/visit
Interpersonal skills
Percent of Respondents Endorsing
Personal Characteristics and Other Knowledge of Applicants Considered in
Deciding Whom to Rank (%)
Mean Importance of Personal Characteristics and Other Knowledge of Applicants
Considered in Deciding Whom to Rank
1
Mean Importance Rating
Figure PD_TY-R3
Figure PD_TY-R4
