PD Survey Report 2014
PD Survey Report 2014
PD Survey Report 2014
June 2014
www.nrmp.org
Requests for permission to use these data as well as questions about the content of this
publication or the National Resident Matching Program data and reports may be directed to
Mei Liang, Director of Research, NRMP, at datarequest@nrmp.org.
Questions about the NRMP should be directed to Mona M. Signer, Executive Director, NRMP,
at support@nrmp.org.
Suggested Citation
National Resident Matching Program, Data Release and Research Committee: Results of the
2014 NRMP Program Director Survey. National Resident Matching Program, Washington, DC.
2014.
Copyright 2014 National Resident Matching Program.
Table of Contents
Introduction .................................................................................................................................................................. 1
All Specialties............................................................................................................................................................... 2
Charts for Individual Specialties
Anesthesiology ....................................................................................................................................................... 8
Child Neurology ................................................................................................................................................... 14
Dermatology ......................................................................................................................................................... 20
Emergency Medicine ........................................................................................................................................... 26
Family Medicine ................................................................................................................................................... 32
Internal Medicine.................................................................................................................................................. 38
Internal Medicine/Pediatrics ................................................................................................................................. 44
Neurological Surgery............................................................................................................................................ 50
Neurology ............................................................................................................................................................. 56
Obstetrics and Gynecology .................................................................................................................................. 62
Orthopaedic Surgery ............................................................................................................................................. 68
Otolaryngology ..................................................................................................................................................... 74
Pathology .............................................................................................................................................................. 80
Pediatrics .............................................................................................................................................................. 86
Physical Medicine and Rehabilitation .................................................................................................................. 92
Plastic Surgery ...................................................................................................................................................... 98
Psychiatry ........................................................................................................................................................... 104
Radiation Oncology ............................................................................................................................................ 110
Radiology-Diagnostic ......................................................................................................................................... 116
Surgery ............................................................................................................................................................... 122
Thoracic Surgery ................................................................................................................................................ 128
Transitional Year ................................................................................................................................................ 134
Vascular Surgery ................................................................................................................................................ 140
Introduction
In March 2014, the National Resident Matching Program
(NRMP) conducted its biennial survey of the directors of all
programs participating in the Main Residency Match. The
primary purpose of the survey was to shed light on the factors
that program directors use to (1) select applicants to interview
and (2) rank applicants for the Match.
The survey was fielded during the 18 days between the rank
order list deadline and Match Week so that program match
outcomes would not influence respondents' answers.
The survey solicited information on:
the number of applications received, screened, and
reviewed, as well as the number of applicants interviewed
and ranked
whether the program typically interviews and ranks specific
applicant groups
use of test scores in considering which applicants to
interview, and
the factors used for both interview selection and for ranking
applicants.
The overall response rate for all specialties in this report was
52.7 percent. Transitional Year and 22 specialties with 10 or
more responses are included in this report. Their response rates
are listed in the table below. Response rates for those
specialties ranged from a high of 65.4 percent for Emergency
Medicine and Pediatrics to a low of 42.6 for Radiology.
_______________
Specialty
Anesthesiology
ChildNeurology
Dermatology
EmergencyMedicine
FamilyMedicine
InternalMedicine
InternalMedicine/Pediatrics
NeurologicalSurgery
Neurology
ObstetricsandGynecology
OrthopaedicSurgery
Otolaryngology
Pathology
Pediatrics
PhysicalMedicineandRehabilitation
PlasticSurgery
Psychiatry
RadiationOncology
RadiologyDiagnostic
Surgery
ThoracicSurgery
TransitionalYear
VascularSurgery
Allothers
Total
71
41
60
104
236
197
35
55
60
123
87
46
84
121
34
39
84
44
75
121
12
47
22
46
1,844
55.9%
56.9%
54.5%
65.4%
55.0%
52.0%
43.8%
53.9%
46.5%
53.5%
59.2%
46.0%
62.7%
65.4%
44.2%
61.9%
46.7%
52.4%
42.6%
44.0%
48.0%
51.6%
50.0%
45.5%
52.7%
Figure 1
All Specialties
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=1,793)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
Average Rating
4.1
Lettersofrecommendationinthespecialty
94%
86%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
84%
4.0
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
4.2
80%
78%
4.1
3.6
75%
4.1
Gradesinrequiredclerkships
70%
4.0
Gapsinmedicaleducation
70%
4.1
Honorsinclinicalclerkships
69%
4.0
Perceivedcommitmenttospecialty
69%
69%
Classranking/quartile
4.3
3.9
Evidenceofprofessionalismandethics
65%
Personalpriorknowledgeoftheapplicant
65%
4.1
Auditionelective/rotationwithinyourdepartment
4.0
Leadershipqualities
63%
63%
Honorsinclerkshipindesiredspecialty
61%
4.3
Gradesinclerkshipindesiredspecialty
61%
61%
4.3
AlphaOmegaAlpha(AOA)membership
4.5
4.0
3.8
PassUSMLEStep2CS/COMLEXLvl2PE
57%
4.1
Perceivedinterestinprogram
4.1
Consistencyofgrades
57%
56%
Otherlifeexperience
56%
3.6
Volunteer/extracurricularexperiences
54%
3.6
GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch
4.0
3.8
48%
43%
Visastatus*
3.7
4.0
39%
34%
ApplicantwasflaggedwithMatchviolationbytheNRMP
4.8
3.7
Interestinacademiccareer
28%
Honorsinbasicsciences
27%
GoldSocietymembership
3.7
Awayrotationinyourspecialtyatanotherinstitution
27%
25%
Fluencyinlanguagespokenbyyourpatientpopulation
25%
3.6
USMLE/COMLEXStep3score
100%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
3.5
3.7
18%
50%
0% 1
3.5
3
Figure 2
All Specialties
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=1,799)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 93%
Interpersonalskills 93%
Interactionswithhousestaffduringinterviewandvisit
88%
Feedbackfromcurrentresidents
82%
USMLEStep1/COMLEXLevel1score
80%
Lettersofrecommendationinthespecialty
74%
USMLEStep2CK/COMLEXLevel2CEscore
71%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
68%
Perceivedcommitmenttospecialty
67%
Evidenceofprofessionalismandethics
64%
Perceivedinterestinprogram
62%
Leadershipqualities
60%
Personalpriorknowledgeoftheapplicant
58%
Classranking/quartile
57%
GraduateofU.S.allopathicmedicalschool
57%
PersonalStatement
55%
Auditionelective/rotationwithinyourdepartment
55%
Gradesinrequiredclerkships
51%
PassingUSMLEStep2CS/COMLEXLevel2PE
50%
Honorsinclinicalclerkships
49%
Honorsinclerkshipindesiredspecialty
45%
Gapsinmedicaleducation
45%
Gradesinclerkshipindesiredspecialty
45%
AlphaOmegaAlpha(AOA)membership
45%
Otherlifeexperience
44%
Consistencyofgrades
40%
Volunteer/extracurricularexperiences
40%
Demonstratedinvolvementandinterestinresearch
36%
GraduateofhighlyregardedU.S.medicalschool
36%
Otherpostinterviewcontact
33%
Interestinacademiccareer
26%
Visastatus*
23%
ApplicantwasflaggedwithMatchviolationbytheNRMP
22%
Fluencyinlanguagespokenbyyourpatientpopulation
20%
GoldSocietymembership
20%
Honorsinbasicsciences
20%
Secondinterview/visit
19%
Awayrotationinyourspecialtyatanotherinstitution
17%
USMLE/COMLEXStep3score
15%
0% 1
100%
50%
Average Rating
4.8
4.8
4.7
4.6
4.1
4.1
4.1
4.0
4.3
4.5
4.1
4.1
4.3
4.0
4.1
3.6
4.3
4.0
4.1
4.0
4.2
4.1
4.2
4.0
3.7
4.0
3.7
3.7
3.9
4.0
3.8
4.0
4.7
3.8
3.8
3.5
3.7
3.9
3.7
3
4
5
All Specialties
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure 3
N=1,746
N=1,601
100%
80%
80%
68%
63%
60%
40%
60%
40%
31%
26%
20%
0%
20%
1%
Yes, pass only
0%
No
11%
Never
Seldom
Often
100%
N=1,672
N=1,417
100%
80%
80%
60%
40%
58%
60%
50%
40%
31%
19%
20%
35%
20%
6%
0%
0%
No
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
USMLE Step 1
N=989
170
USMLE Step 2 CK
N=688
USMLE Step 1
N=684
USMLE Step 2 CK
N=508
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol in the box represents the mean.
NRMP Program Director Survey Results, 2014
All Specialties
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure 4
USMLE Step 3
N=1,604
100%
90%
90%
80%
N=1,049
100%
78%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
22%
20%
20%
10%
18%
11%
10%
N=61
0%
71%
Yes
0%
No
N=41
Yes, pass only
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
40%
50%
41%
40%
36%
30%
23%
20%
10%
10%
Yes, pass only
33%
33%
34%
No
30%
20%
0%
N=1,102
100%
N=1,140
0%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
COMLEX-USA Level 3*
N=1,057
100%
90%
90%
80%
80%
70%
70%
60%
50%
73%
60%
50%
50%
38%
40%
40%
30%
30%
20%
20%
12%
10%
0%
N=789
100%
17%
10%
10%
Yes, pass only
0%
No
No
All Specialties
Program's Interview Activities
Figure 5
100%
856
90%
800
80%
700
70%
600
60%
500
50%
51%
44%
40%
400
30%
300
20%
200
119
10%
96
100
77
0%
0
Number of
positions in the
Match
Number of
applications
received
N=1,844*
N=1,799
Number of
interview
invitations sent
Number of
applicants
interviewed
N=1,776
Number of
applicants ranked
N=1,791
N=1,844*
N=1,733
N=1,799
Percentage of Programs that Typically Interview and Rank Each Applicant Type
100%
99%
90%
80%
71%
69%
70%
60%
60%
51%
50%
40%
48%
35%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
Fifth Pathway
U.S. IMG
Non-U.S. IMG
N=1,772
59%
50%
40%
30%
24%
20%
15%
10%
2%
0%
We want to be contacted by
the applicants medical
school after we have initiated
contact with the applicant
Other
Anesthesiology
(N=71)
Figure AN-1
Anesthesiology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=67)
Percent Citing Factor
Average Rating
USMLEStep1/COMLEXLevel1score 99%
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
4.5
81%
3.9
87%
4.2
82%
4.1
78%
3.4
85%
4.1
69%
Gapsinmedicaleducation
75%
Honorsinclinicalclerkships
75%
Perceivedcommitmenttospecialty
Classranking/quartile
Evidenceofprofessionalismandethics
4.2
4.0
60%
4.1
70%
75%
Auditionelective/rotationwithinyourdepartment
75%
4.5
4.2
4.0
67%
Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
Volunteer/extracurricularexperiences
4.2
69%
3.8
46%
4.0
69%
4.2
60%
3.6
57%
3.6
52%
Demonstratedinvolvementandinterestinresearch
51%
3.7
3.4
Visastatus*
45%
ApplicantwasflaggedwithMatchviolationbytheNRMP
45%
Interestinacademiccareer
3.2
3.3
36%
Awayrotationinyourspecialtyatanotherinstitution
3.8
25%
13%
Fluencyinlanguagespokenbyyourpatientpopulation
4.9
40%
GoldSocietymembership
3.8
27%
Honorsinbasicsciences
3.9
51%
GraduateofhighlyregardedU.S.medicalschool
USMLE/COMLEXStep3score
100%
4.2
52%
Perceivedinterestinprogram
Otherlifeexperience
4.2
48%
PassUSMLEStep2CS/COMLEXLvl2PE
Consistencyofgrades
4.2
81%
Personalpriorknowledgeoftheapplicant
Leadershipqualities
4.1
2.9
3.8
15%
50%
0% 1
3.1
3
Figure AN-2
Anesthesiology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=67)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 96%
Interpersonalskills
91%
Interactionswithhousestaffduringinterviewandvisit
85%
Feedbackfromcurrentresidents
81%
USMLEStep1/COMLEXLevel1score
88%
Lettersofrecommendationinthespecialty
65%
USMLEStep2CK/COMLEXLevel2CEscore
69%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
74%
Perceivedcommitmenttospecialty
72%
Evidenceofprofessionalismandethics
76%
Perceivedinterestinprogram
69%
Leadershipqualities
75%
Personalpriorknowledgeoftheapplicant
66%
Classranking/quartile
75%
GraduateofU.S.allopathicmedicalschool
59%
PersonalStatement
60%
Auditionelective/rotationwithinyourdepartment
68%
Gradesinrequiredclerkships
59%
PassingUSMLEStep2CS/COMLEXLevel2PE
43%
Honorsinclinicalclerkships
54%
Honorsinclerkshipindesiredspecialty
37%
Gapsinmedicaleducation
49%
Gradesinclerkshipindesiredspecialty
41%
AlphaOmegaAlpha(AOA)membership
56%
Otherlifeexperience
51%
Consistencyofgrades
59%
Volunteer/extracurricularexperiences
41%
Demonstratedinvolvementandinterestinresearch
38%
GraduateofhighlyregardedU.S.medicalschool
43%
Otherpostinterviewcontact
28%
Interestinacademiccareer
19%
Visastatus*
21%
ApplicantwasflaggedwithMatchviolationbytheNRMP
21%
7%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
26%
Honorsinbasicsciences
29%
Secondinterview/visit
16%
Awayrotationinyourspecialtyatanotherinstitution
10%
USMLE/COMLEXStep3score
13%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
10
Average Rating
4.8
4.8
4.7
4.6
4.2
3.8
4.2
4.2
4.2
4.4
4.0
4.1
4.3
4.1
4.3
3.3
4.1
4.1
4.1
4.0
4.0
3.9
3.9
3.8
3.7
4.0
3.6
3.5
3.9
3.7
3.2
3.9
4.7
3.4
3.8
3.7
3.3
3.7
3.4
2
Anesthesiology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure AN-3
N=68
100%
90%
90%
80%
80%
70%
70%
60%
50%
40%
43%
40%
30%
30%
15%
20%
10%
0%
57%
60%
50%
20%
N=63
100%
85%
10%
0%
Yes, pass only
0%
0%
No
Never
Seldom
Often
Scores required?
N=64
N=53
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
48%
50%
50%
40%
30%
55%
45%
40%
28%
23%
30%
20%
20%
10%
10%
0%
0%
Yes, pass only
No
0%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=53
N=30
N=42
USMLE Step 2 CK
N=26
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
11
Anesthesiology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure AN-4
USMLE Step 3
N=61
100%
90%
90%
80%
80%
70%
N=41
100%
73%
70%
64%
60%
60%
50%
50%
36%
40%
40%
30%
30%
20%
20%
N=61
10%
0%
20%
N=41 7%
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=45
90%
90%
80%
80%
70%
70%
60%
60%
53%
50%
50%
40%
40%
30%
24%
22%
30%
20%
20%
10%
10%
0%
N=43
0%
No
42%
33%
26%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=38
90%
90%
80%
80%
70%
70%
47%
45%
50%
40%
40%
30%
30%
20%
20%
8%
10%
0%
73%
60%
60%
50%
N=30
0%
No
13%
13%
10%
12
No
Figure AN-5
Anesthesiology
Program's Interview Activities
1,000
100%
900
90%
800
80%
704
700
70%
600
60%
500
400
46%
Percentage of applications
rejected
Percentage of applicants
receiving an in-depth review
40%
300
30%
200
152
142
100
0
47%
50%
20%
102
10%
7
Number of
positions in the
Match
N=71*
Number of
applications
received
N=68
Number of
interview
invitations sent
Number of
applicants
interviewed
N=67
N=68
0%
Number of
applicants
ranked
N=71*
N=66
N=68
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
30% of Anesthesiology programs consider all applicant groups
100%
N=67
90%
85%
84%
80%
70%
60%
55%
52%
50%
40%
51%
31%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
13
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Child Neurology
(N=41)
14
Figure CN-1
Child Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=40)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
Average Rating
93%
3.9
Lettersofrecommendationinthespecialty 98%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
4.3
95%
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
4.2
80%
83%
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
3.9
3.7
65%
80%
4.1
Gapsinmedicaleducation
57%
Honorsinclinicalclerkships
83%
Perceivedcommitmenttospecialty
83%
Classranking/quartile
Evidenceofprofessionalismandethics
Leadershipqualities
4.2
73%
3.9
70%
3.9
78%
Consistencyofgrades
Otherlifeexperience
Volunteer/extracurricularexperiences
4.1
4.3
4.0
73%
4.3
57%
4.0
55%
3.5
60%
3.7
63%
3.6
60%
3.8
35%
3.6
28%
Awayrotationinyourspecialtyatanotherinstitution
3.4
23%
28%
Fluencyinlanguagespokenbyyourpatientpopulation
15
4.7
18%
GoldSocietymembership
4.0
40%
Honorsinbasicsciences
3.9
45%
ApplicantwasflaggedwithMatchviolationbytheNRMP
USMLE/COMLEXStep3score
100%
3.5
53%
Visastatus*
Interestinacademiccareer
3.6
57%
GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch
3.5
68%
Gradesinclerkshipindesiredspecialty
Perceivedinterestinprogram
4.2
57%
78%
PassUSMLEStep2CS/COMLEXLvl2PE
3.8
63%
Honorsinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
4.1
4.1
Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment
4.0
3.5
3.8
53%
50%
0% 1
Figure CN-2
Child Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=40)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 95%
Interpersonalskills
93%
Interactionswithhousestaffduringinterviewandvisit
90%
Feedbackfromcurrentresidents
75%
USMLEStep1/COMLEXLevel1score
83%
Lettersofrecommendationinthespecialty
90%
USMLEStep2CK/COMLEXLevel2CEscore
75%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
83%
Perceivedcommitmenttospecialty
75%
Evidenceofprofessionalismandethics
68%
Perceivedinterestinprogram
78%
Leadershipqualities
60%
Personalpriorknowledgeoftheapplicant
57%
Classranking/quartile
50%
GraduateofU.S.allopathicmedicalschool
48%
PersonalStatement
70%
Auditionelective/rotationwithinyourdepartment
60%
Gradesinrequiredclerkships
57%
PassingUSMLEStep2CS/COMLEXLevel2PE
73%
Honorsinclinicalclerkships
57%
Honorsinclerkshipindesiredspecialty
57%
Gapsinmedicaleducation
38%
Gradesinclerkshipindesiredspecialty
55%
AlphaOmegaAlpha(AOA)membership
35%
Otherlifeexperience
45%
Consistencyofgrades
33%
Volunteer/extracurricularexperiences
43%
Demonstratedinvolvementandinterestinresearch
65%
GraduateofhighlyregardedU.S.medicalschool
43%
Otherpostinterviewcontact
45%
Interestinacademiccareer
50%
Visastatus*
20%
ApplicantwasflaggedwithMatchviolationbytheNRMP
20%
Fluencyinlanguagespokenbyyourpatientpopulation
20%
10%
GoldSocietymembership
Honorsinbasicsciences
25%
Secondinterview/visit
30%
Awayrotationinyourspecialtyatanotherinstitution
18%
45%
USMLE/COMLEXStep3score
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
16
Average Rating
4.7
4.7
4.6
4.5
3.9
4.1
4.0
4.1
4.5
4.3
4.2
4.0
4.1
4.2
4.1
3.9
4.1
4.1
4.0
4.2
4.3
4.1
4.2
3.9
3.7
4.1
4.1
3.7
4.1
4.2
3.9
3.8
4.6
3.8
3.8
4.2
3.9
4.4
4.0
2
Child Neurology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure CN-3
N=39
100%
90%
80%
62%
70%
60%
60%
50%
50%
38%
40%
30%
30%
20%
20%
10%
0%
76%
80%
70%
40%
N=37
100%
90%
10%
0%
Yes, pass only
22%
3%
0%
No
Never
Seldom
Often
Scores required?
N=38
N=34
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
65%
50%
37%
40%
30%
32%
30%
20%
20%
13%
10%
10%
0%
0%
Yes, pass only
No
3%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=16
N=11
N=11
USMLE Step 2 CK
N=8
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
17
Child Neurology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure CN-4
USMLE Step 3
N=37
100%
89%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
0%
Yes
39%
29%
32%
20%
11%
N=37
10%
N=31
100%
N=31
10%
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=26
90%
90%
80%
80%
70%
70%
60%
60%
50%
40%
50%
42%
38%
40%
42%
35%
30%
30%
19%
20%
23%
20%
10%
10%
0%
N=26
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=23
90%
90%
80%
80%
70%
70%
60%
60%
50%
40%
50%
39%
39%
30%
40%
22%
30%
20%
20%
10%
10%
0%
N=20
0%
No
18
35%
40%
25%
No
Figure CN-5
Child Neurology
Program's Interview Activities
1,000
100%
900
90%
800
80%
700
70%
600
500
49%
50%
400
40%
300
30%
200
20%
85
100
0
58%
60%
2
Number of
positions in the
Match
N=41*
Number of
applications
received
N=39
10%
25
18
13
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=39
N=39
0%
Percentage of applications
rejected
N=41*
Percentage of applicants
receiving an in-depth review
N=39
N=39
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
43% of Child Neurology programs consider all applicant groups
100%
N=40
90%
80%
73%
78%
68%
70%
68%
60%
60%
50%
45%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
19
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Dermatology
(N=60)
20
Figure D-1
Dermatology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=59)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
92%
Lettersofrecommendationinthespecialty
93%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
4.3
4.5
83%
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
4.0
64%
4.1
85%
4.0
59%
Perceivedcommitmenttospecialty
Classranking/quartile
Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant
4.2
64%
4.2
Gapsinmedicaleducation
Honorsinclinicalclerkships
Average Rating
42%
3.6
76%
4.3
73%
4.5
59%
4.3
64%
4.6
75%
4.5
Auditionelective/rotationwithinyourdepartment
64%
4.4
Leadershipqualities
63%
4.3
Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
4.5
69%
4.4
58%
4.0
64%
PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
Consistencyofgrades
Otherlifeexperience
Volunteer/extracurricularexperiences
GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch
4.2
61%
4.3
68%
3.8
54%
3.9
53%
4.1
49%
3.9
39%
4.2
22%
Awayrotationinyourspecialtyatanotherinstitution
3.9
29%
15%
Fluencyinlanguagespokenbyyourpatientpopulation
21
4.9
17%
GoldSocietymembership
4.1
24%
Honorsinbasicsciences
3.8
46%
ApplicantwasflaggedwithMatchviolationbytheNRMP
USMLE/COMLEXStep3score
100%
3.7
51%
Visastatus*
Interestinacademiccareer
4.1
25%
3.1
10%
50%
0% 1
4.0
3
4
Figure D-2
Dermatology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=59)
Percent Citing Factor
Average Rating
Interactionswithfacultyduringinterviewandvisit 97%
Interpersonalskills 95%
Interactionswithhousestaffduringinterviewandvisit 95%
Feedbackfromcurrentresidents
80%
USMLEStep1/COMLEXLevel1score
59%
Lettersofrecommendationinthespecialty
71%
USMLEStep2CK/COMLEXLevel2CEscore
39%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
51%
Perceivedcommitmenttospecialty
64%
Evidenceofprofessionalismandethics
68%
Perceivedinterestinprogram
63%
Leadershipqualities
54%
Personalpriorknowledgeoftheapplicant
49%
Classranking/quartile
34%
GraduateofU.S.allopathicmedicalschool
34%
PersonalStatement
46%
Auditionelective/rotationwithinyourdepartment
47%
Gradesinrequiredclerkships
37%
PassingUSMLEStep2CS/COMLEXLevel2PE
20%
Honorsinclinicalclerkships
49%
Honorsinclerkshipindesiredspecialty
34%
Gapsinmedicaleducation
20%
Gradesinclerkshipindesiredspecialty
34%
AlphaOmegaAlpha(AOA)membership
36%
Otherlifeexperience
39%
Consistencyofgrades
34%
Volunteer/extracurricularexperiences
37%
Demonstratedinvolvementandinterestinresearch
39%
GraduateofhighlyregardedU.S.medicalschool
22%
Otherpostinterviewcontact
22%
Interestinacademiccareer
39%
Visastatus*
5%
ApplicantwasflaggedwithMatchviolationbytheNRMP
14%
7%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
15%
Honorsinbasicsciences
27%
Secondinterview/visit
3%
2.0
Awayrotationinyourspecialtyatanotherinstitution
20%
USMLE/COMLEXStep3score
7%
100%
50%
0% 1 2
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
22
4.9
4.9
4.9
4.8
4.1
4.2
3.9
4.0
4.4
4.6
4.1
4.3
4.6
4.2
4.2
3.9
4.7
4.3
3.8
4.2
4.5
4.0
4.3
3.9
4.0
4.3
4.0
4.1
3.7
3.6
4.1
4.3
4.6
3.8
3.8
3.6
3.9
3.8
3
Dermatology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure D-3
N=57
100%
82%
90%
80%
80%
70%
70%
60%
50%
40%
43%
40%
30%
30%
18%
20%
10%
0%
57%
60%
50%
20%
N=51
100%
90%
10%
0%
Yes, pass only
0%
0%
No
Never
Seldom
Often
Scores required?
N=51
N=38
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
47%
50%
50%
40%
30%
39%
40%
29%
30%
24%
20%
20%
10%
10%
0%
0%
Yes, pass only
58%
No
3%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=43
N=19
N=13
USMLE Step 2 CK
N=8
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
23
Dermatology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure D-4
USMLE Step 3
N=46
100%
N=24
100%
90%
90%
80%
80%
74%
70%
70%
60%
60%
50%
50%
40%
40%
26%
30%
30%
20%
20%
N=46
10%
0%
71%
17%
N=24
10%
Yes
0%
No
13%
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=17
90%
90%
80%
80%
70%
65%
80%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
N=15
18%
18%
20%
10%
10%
0%
0%
No
13%
7%
Yes, pass only
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=15
90%
80%
80%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
13%
7%
10%
0%
92%
80%
70%
20%
N=12
90%
10%
0%
No
24
8%
0%
Yes, pass only
No
Figure D-5
Dermatology
Program's Interview Activities
1,000
100%
900
90%
800
80%
700
70%
600
500
50%
412
400
40%
300
33%
30%
200
20%
100
0
58%
60%
4
Number of
positions in the
Match
N=60*
Number of
applications
received
N=59
43
36
32
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=59
N=59
10%
0%
Percentage of applications
rejected
N=60*
Percentage of applicants
receiving an in-depth review
N=54
N=59
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
18% of Dermatology programs consider all applicant groups
100%
N=57
90%
80%
74%
70%
60%
50%
40%
35%
30%
30%
26%
26%
U.S. IMG
Non-U.S. IMG
19%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
25
Fifth Pathway
Emergency Medicine
(N=104)
26
Figure EM-1
Emergency Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=101)
Percent Citing Factor
Average Rating
USMLEStep1/COMLEXLevel1score 97%
3.9
Lettersofrecommendationinthespecialty 99%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
4.8
91%
3.9
94%
4.0
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
Gapsinmedicaleducation
67%
3.0
4.0
83%
3.8
88%
3.8
72%
Honorsinclinicalclerkships
82%
4.0
Perceivedcommitmenttospecialty
81%
4.1
Classranking/quartile
83%
3.7
Evidenceofprofessionalismandethics
69%
4.4
Personalpriorknowledgeoftheapplicant
68%
4.3
Auditionelective/rotationwithinyourdepartment
Leadershipqualities
Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
4.4
87%
3.9
80%
4.6
86%
4.6
90%
PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
3.9
50%
3.9
65%
Consistencyofgrades
Otherlifeexperience
3.7
75%
3.8
52%
3.5
72%
Volunteer/extracurricularexperiences
63%
GraduateofhighlyregardedU.S.medicalschool
61%
Demonstratedinvolvementandinterestinresearch
3.6
3.4
3.1
43%
Visastatus*
3.9
37%
ApplicantwasflaggedwithMatchviolationbytheNRMP
29%
Interestinacademiccareer
30%
Honorsinbasicsciences
27
3.0
3.3
39%
4.3
78%
Fluencyinlanguagespokenbyyourpatientpopulation
USMLE/COMLEXStep3score
100%
3.5
22%
GoldSocietymembership
Awayrotationinyourspecialtyatanotherinstitution
4.6
3.2
22%
18%
50%
0% 1
3.4
3
Figure EM-2
Emergency Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=101)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit
89%
Interpersonalskills 93%
Interactionswithhousestaffduringinterviewandvisit
91%
Feedbackfromcurrentresidents
88%
USMLEStep1/COMLEXLevel1score
86%
Lettersofrecommendationinthespecialty
87%
USMLEStep2CK/COMLEXLevel2CEscore
80%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
75%
Perceivedcommitmenttospecialty
66%
Evidenceofprofessionalismandethics
61%
Perceivedinterestinprogram
62%
Leadershipqualities
74%
Personalpriorknowledgeoftheapplicant
63%
Classranking/quartile
63%
GraduateofU.S.allopathicmedicalschool
62%
PersonalStatement
43%
Auditionelective/rotationwithinyourdepartment
75%
Gradesinrequiredclerkships
60%
PassingUSMLEStep2CS/COMLEXLevel2PE
44%
Honorsinclinicalclerkships
57%
Honorsinclerkshipindesiredspecialty
71%
Gapsinmedicaleducation
41%
Gradesinclerkshipindesiredspecialty
71%
AlphaOmegaAlpha(AOA)membership
50%
Otherlifeexperience
58%
Consistencyofgrades
31%
Volunteer/extracurricularexperiences
51%
Demonstratedinvolvementandinterestinresearch
28%
GraduateofhighlyregardedU.S.medicalschool
41%
Otherpostinterviewcontact
36%
Interestinacademiccareer
23%
Visastatus*
23%
ApplicantwasflaggedwithMatchviolationbytheNRMP
23%
20%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
28%
16%
Honorsinbasicsciences
Secondinterview/visit
26%
Awayrotationinyourspecialtyatanotherinstitution
63%
USMLE/COMLEXStep3score
11%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
28
Average Rating
4.8
4.8
4.7
4.6
3.8
4.7
4.0
3.8
4.1
4.5
4.0
4.1
4.4
3.8
4.1
3.0
4.5
3.8
3.9
4.0
4.4
3.6
4.4
3.9
3.7
3.8
3.8
3.4
3.8
3.9
3.6
4.0
4.5
3.6
3.6
2.9
3.4
4.3
3.5
2
Emergency Medicine
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure EM-3
N=97
100%
90%
80%
80%
69%
70%
60%
50%
30%
50%
40%
31%
30%
20%
19%
20%
10%
0%
76%
70%
60%
40%
N=94
100%
90%
10%
0%
Yes, pass only
5%
0%
No
Never
Seldom
Often
Scores required?
N=96
N=85
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
54%
50%
50%
40%
40%
30%
20%
20%
10%
10%
0%
0%
Yes, pass only
48%
30%
24%
22%
52%
No
Never
0%
often
Seldom
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=62
N=46
N=41
USMLE Step 2 CK
N=34
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
29
Emergency Medicine
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure EM-4
USMLE Step 3
N=88
100%
N=55
100%
90%
90%
80%
80%
66%
70%
73%
70%
60%
60%
50%
50%
40%
40%
34%
30%
30%
20%
20%
N=88
10%
0%
15%
Yes
0%
No
13%
N=55
10%
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=68
90%
90%
80%
80%
70%
70%
60%
60%
40%
40%
37%
40%
30%
24%
20%
20%
10%
10%
0%
48%
50%
50%
30%
N=66
0%
No
29%
23%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=58
90%
90%
80%
80%
70%
50%
30%
60%
50%
40%
31%
30%
20%
20%
10%
10%
0%
78%
70%
59%
60%
40%
N=45
10%
0%
No
30
11%
11%
No
Figure EM-5
Emergency Medicine
Program's Interview Activities
900
90%
830
800
80%
700
70%
600
60%
500
56%
50%
41%
400
40%
300
30%
174
200
138
20%
123
100
10%
11
0
Number of
positions in the
Match
N=104*
Number of
applications
received
N=104
Number of
interview
invitations sent
Number of
applicants
interviewed
N=101
N=103
0%
Number of
applicants
ranked
Percentage of applications
rejected
N=104*
Percentage of applicants
receiving an in-depth review
N=99
N=104
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
20% of Emergency Medicine programs consider all applicant groups
100%
N=101
90%
80%
72%
77%
70%
60%
47%
50%
40%
35%
30%
24%
22%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
31
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Family Medicine
(N=236)
32
Figure FM-1
Family Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=227)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
91%
3.8
83%
87%
PersonalStatement
87%
4.0
4.1
3.9
78%
Gradesinrequiredclerkships
Gapsinmedicaleducation
4.0
80%
USMLEStep2CK/COMLEXLevel2CEscore
GraduateofU.S.allopathicmedicalschool
4.1
68%
3.9
81%
4.3
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
52%
4.5
56%
Evidenceofprofessionalismandethics
70%
Personalpriorknowledgeoftheapplicant
69%
Auditionelective/rotationwithinyourdepartment
70%
Leadershipqualities
3.5
4.6
4.2
4.0
3.9
60%
Honorsinclerkshipindesiredspecialty
Otherlifeexperience
Volunteer/extracurricularexperiences
4.2
81%
4.2
65%
3.7
63%
3.8
65%
4.3
56%
4.8
38%
3.2
8%
20%
Honorsinbasicsciences
GoldSocietymembership
2.9
3.5
25%
Awayrotationinyourspecialtyatanotherinstitution
3.2
12%
42%
Fluencyinlanguagespokenbyyourpatientpopulation
33
3.3
10%
Interestinacademiccareer
3.6
40%
ApplicantwasflaggedwithMatchviolationbytheNRMP
3.8
54%
Demonstratedinvolvementandinterestinresearch
USMLE/COMLEXStep3score
100%
3.4
31%
GraduateofhighlyregardedU.S.medicalschool
Visastatus*
4.1
51%
AlphaOmegaAlpha(AOA)membership
Consistencyofgrades
3.9
44%
Gradesinclerkshipindesiredspecialty
Perceivedinterestinprogram
3.7
87%
Classranking/quartile
PassUSMLEStep2CS/COMLEXLvl2PE
Average Rating
3.7
24%
50%
0% 1
3.4
3
Figure FM-2
Family Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=227)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 93%
Interpersonalskills 94%
Interactionswithhousestaffduringinterviewandvisit
91%
Feedbackfromcurrentresidents
84%
USMLEStep1/COMLEXLevel1score
79%
Lettersofrecommendationinthespecialty
67%
USMLEStep2CK/COMLEXLevel2CEscore
82%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
69%
Perceivedcommitmenttospecialty
84%
Evidenceofprofessionalismandethics
69%
Perceivedinterestinprogram
67%
Leadershipqualities
59%
Personalpriorknowledgeoftheapplicant
64%
Classranking/quartile
53%
GraduateofU.S.allopathicmedicalschool
62%
PersonalStatement
68%
Auditionelective/rotationwithinyourdepartment
61%
Gradesinrequiredclerkships
50%
PassingUSMLEStep2CS/COMLEXLevel2PE
77%
Honorsinclinicalclerkships
36%
Honorsinclerkshipindesiredspecialty
30%
Gapsinmedicaleducation
61%
Gradesinclerkshipindesiredspecialty
41%
AlphaOmegaAlpha(AOA)membership
27%
Otherlifeexperience
52%
Consistencyofgrades
45%
Volunteer/extracurricularexperiences
53%
Demonstratedinvolvementandinterestinresearch
12%
GraduateofhighlyregardedU.S.medicalschool
31%
Otherpostinterviewcontact
43%
8%
Interestinacademiccareer
Visastatus*
29%
ApplicantwasflaggedwithMatchviolationbytheNRMP
25%
Fluencyinlanguagespokenbyyourpatientpopulation
34%
GoldSocietymembership
21%
Honorsinbasicsciences
13%
Secondinterview/visit
36%
Awayrotationinyourspecialtyatanotherinstitution
8%
USMLE/COMLEXStep3score
17%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
34
Average Rating
4.8
4.8
4.8
4.8
3.9
3.8
4.0
4.0
4.5
4.6
4.2
4.1
4.3
3.7
4.0
3.8
4.4
3.9
4.2
3.8
4.0
4.2
4.0
3.7
3.8
3.8
4.0
3.1
3.7
4.1
3.5
4.4
4.9
3.9
3.8
3.4
3.8
3.7
3.7
2
Family Medicine
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure FM-3
N=219
100%
90%
80%
80%
70%
60%
70%
57%
60%
60%
50%
42%
50%
40%
40%
30%
30%
20%
20%
10%
0%
N=205
100%
90%
10%
0%
Yes, pass only
35%
5%
0%
No
Never
Seldom
Often
Scores required?
N=213
N=194
100%
100%
90%
90%
80%
80%
70%
70%
60%
50%
60%
50%
50%
41%
40%
40%
30%
30%
20%
20%
8%
10%
0%
68%
10%
0%
19%
13%
No
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=71
N=65
N=63
USMLE Step 2 CK
N=59
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
35
Family Medicine
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure FM-4
USMLE Step 3
N=208
100%
89%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
0%
20%
11%
N=208
10%
N=126
100%
Yes
80%
13%
N=126 6%
10%
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=200
90%
90%
80%
80%
70%
60%
70%
61%
60%
56%
50%
50%
40%
40%
36%
30%
30%
20%
20%
10%
0%
N=193
4%
Yes, pass only
32%
12%
10%
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=191
90%
80%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
16%
9%
10%
Yes, pass only
77%
80%
75%
70%
0%
N=117
90%
20%
0%
No
16%
7%
10%
36
No
Figure FM-5
Family Medicine
Program's Interview Activities
1,000
900
90%
800
80%
700
70%
600
60%
500
50%
400
40%
300
30%
200
80
64
Number of
applicants
interviewed
Number of
applicants
ranked
10%
7
Number of
positions in the
Match
N=236*
Number of
applications
received
N=228
Number of
interview
invitations sent
29%
20%
106
100
68%
N=223
N=225
0%
Percentage of applications
rejected
N=236*
Percentage of applicants
receiving an in-depth review
N=215
N=228
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
36% of Family Medicine programs consider all applicant groups
100%
95%
N=224
90%
79%
80%
77%
70%
63%
60%
53%
47%
50%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
37
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Internal Medicine
(N=197)
38
Figure IM-1
Internal Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=194)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
Lettersofrecommendationinthespecialty
Average Rating
92%
4.1
73%
3.8
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
90%
4.3
USMLEStep2CK/COMLEXLevel2CEscore
89%
4.2
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
Gapsinmedicaleducation
Honorsinclinicalclerkships
66%
79%
4.0
70%
4.1
73%
4.1
65%
Perceivedcommitmenttospecialty
Classranking/quartile
3.3
4.0
51%
3.7
74%
4.0
Evidenceofprofessionalismandethics
64%
Personalpriorknowledgeoftheapplicant
64%
4.4
3.8
Auditionelective/rotationwithinyourdepartment
54%
Leadershipqualities
53%
3.6
3.8
Honorsinclerkshipindesiredspecialty
57%
4.1
Gradesinclerkshipindesiredspecialty
59%
4.2
AlphaOmegaAlpha(AOA)membership
58%
PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
Consistencyofgrades
Otherlifeexperience
4.3
75%
3.7
47%
4.0
55%
3.4
46%
Volunteer/extracurricularexperiences
GraduateofhighlyregardedU.S.medicalschool
3.9
3.8
45%
Demonstratedinvolvementandinterestinresearch
3.7
40%
ApplicantwasflaggedwithMatchviolationbytheNRMP
4.9
44%
Interestinacademiccareer
29%
Awayrotationinyourspecialtyatanotherinstitution
9%
31%
Fluencyinlanguagespokenbyyourpatientpopulation
39
3.2
24%
GoldSocietymembership
3.5
21%
Honorsinbasicsciences
3.5
28%
Visastatus*
USMLE/COMLEXStep3score
100%
3.5
38%
4.0
3.1
3.7
21%
50%
0% 1
3.5
3
Figure IM-2
Internal Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=194)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit
92%
Interpersonalskills 95%
Interactionswithhousestaffduringinterviewandvisit
82%
Feedbackfromcurrentresidents
73%
USMLEStep1/COMLEXLevel1score
83%
Lettersofrecommendationinthespecialty
65%
USMLEStep2CK/COMLEXLevel2CEscore
86%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
79%
Perceivedcommitmenttospecialty
55%
Evidenceofprofessionalismandethics
64%
Perceivedinterestinprogram
55%
Leadershipqualities
55%
Personalpriorknowledgeoftheapplicant
59%
Classranking/quartile
71%
GraduateofU.S.allopathicmedicalschool
69%
PersonalStatement
52%
Auditionelective/rotationwithinyourdepartment
47%
Gradesinrequiredclerkships
55%
PassingUSMLEStep2CS/COMLEXLevel2PE
71%
Honorsinclinicalclerkships
51%
Honorsinclerkshipindesiredspecialty
52%
Gapsinmedicaleducation
54%
Gradesinclerkshipindesiredspecialty
52%
AlphaOmegaAlpha(AOA)membership
51%
Otherlifeexperience
36%
Consistencyofgrades
46%
Volunteer/extracurricularexperiences
29%
Demonstratedinvolvementandinterestinresearch
27%
GraduateofhighlyregardedU.S.medicalschool
40%
Otherpostinterviewcontact
21%
Interestinacademiccareer
21%
Visastatus*
36%
ApplicantwasflaggedwithMatchviolationbytheNRMP
36%
28%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
25%
Honorsinbasicsciences
17%
Secondinterview/visit
13%
Awayrotationinyourspecialtyatanotherinstitution
7%
USMLE/COMLEXStep3score
24%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
40
Average Rating
4.7
4.7
4.6
4.4
4.1
3.7
4.2
4.2
4.0
4.6
3.9
3.9
4.1
4.1
4.1
3.3
3.8
4.1
4.2
4.1
4.2
4.1
4.3
4.1
3.5
3.9
3.6
3.4
3.9
3.6
3.6
3.7
4.8
4.0
4.1
3.5
3.3
3.1
3.4
2
Internal Medicine
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure IM-3
N=184
100%
90%
80%
71%
70%
70%
60%
50%
50%
40%
40%
29%
30%
20%
20%
10%
10%
0%
77%
80%
60%
30%
N=173
100%
90%
1%
Yes, pass only
16%
6%
0%
No
Never
Seldom
Often
Scores required?
N=178
N=167
100%
100%
90%
90%
80%
80%
70%
65%
70%
60%
60%
50%
50%
40%
30%
40%
20%
11%
10%
10%
0%
33%
30%
25%
20%
0%
65%
No
2%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=112
N=100
N=81
USMLE Step 2 CK
N=72
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
41
Internal Medicine
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure IM-4
USMLE Step 3
N=172
100%
86%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
0%
20%
14%
N=172
10%
N=119
100%
76%
13%
N=119 12%
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=132
90%
90%
80%
80%
70%
70%
60%
60%
55%
40%
40%
28%
30%
17%
20%
27%
23%
20%
10%
10%
0%
50%
50%
50%
30%
N=130
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=131
90%
90%
80%
80%
70%
70%
60%
57%
74%
60%
50%
50%
40%
40%
27%
30%
20%
30%
20%
15%
14%
12%
10%
10%
0%
N=94
0%
No
42
No
Figure IM-5
Internal Medicine
Program's Interview Activities
1,000
900
90%
800
80%
700
70%
600
60%
500
50%
61%
400
40%
309
300
178
200
20%
100
10%
18
0
Number of
positions in the
Match
N=197*
30%
30%
251
Number of
applications
received
N=190
Number of
interview
invitations sent
Number of
applicants
interviewed
N=187
N=189
0%
Number of
applicants
ranked
Percentage of applications
rejected
N=197*
Percentage of applicants
receiving an in-depth review
N=178
N=190
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
39% of Internal Medicine programs consider all applicant groups
97%
N=190
90%
85%
82%
80%
76%
74%
70%
63%
60%
50%
44%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
43
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Internal Medicine/Pediatrics
(N=35)
44
Figure IMP-1
Internal Medicine/Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=34)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
94%
4.1
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
4.1
74%
3.9
85%
3.6
71%
4.2
74%
4.2
82%
68%
Honorsinclinicalclerkships
68%
Perceivedcommitmenttospecialty
Classranking/quartile
4.0
65%
Gapsinmedicaleducation
4.2
3.9
4.3
59%
4.2
74%
Evidenceofprofessionalismandethics
56%
Personalpriorknowledgeoftheapplicant
56%
Auditionelective/rotationwithinyourdepartment
Leadershipqualities
Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
PassUSMLEStep2CS/COMLEXLvl2PE
Consistencyofgrades
4.4
65%
4.6
68%
4.0
71%
3.8
59%
3.3
47%
3.5
62%
3.9
47%
2.9
24%
3.9
29%
ApplicantwasflaggedwithMatchviolationbytheNRMP
4.8
24%
Interestinacademiccareer
3.0
18%
Honorsinbasicsciences
3.4
24%
3.8
68%
Awayrotationinyourspecialtyatanotherinstitution
3.0
9%
15%
Fluencyinlanguagespokenbyyourpatientpopulation
45
4.1
41%
Visastatus*
4.2
53%
Demonstratedinvolvementandinterestinresearch
USMLE/COMLEXStep3score
100%
3.2
3.7
GraduateofhighlyregardedU.S.medicalschool
GoldSocietymembership
3.7
71%
Otherlifeexperience
Volunteer/extracurricularexperiences
4.4
38%
Perceivedinterestinprogram
Average Rating
3.2
21%
50%
0% 1
3.6
3
4
Figure IMP-2
Internal Medicine/Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=34)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 94%
Interpersonalskills
86%
Interactionswithhousestaffduringinterviewandvisit
91%
Feedbackfromcurrentresidents
86%
USMLEStep1/COMLEXLevel1score
89%
Lettersofrecommendationinthespecialty
71%
USMLEStep2CK/COMLEXLevel2CEscore
83%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
71%
Perceivedcommitmenttospecialty
77%
Evidenceofprofessionalismandethics
77%
Perceivedinterestinprogram
49%
Leadershipqualities
80%
Personalpriorknowledgeoftheapplicant
49%
Classranking/quartile
83%
GraduateofU.S.allopathicmedicalschool
54%
PersonalStatement
57%
Auditionelective/rotationwithinyourdepartment
34%
Gradesinrequiredclerkships
71%
PassingUSMLEStep2CS/COMLEXLevel2PE
60%
Honorsinclinicalclerkships
60%
Honorsinclerkshipindesiredspecialty
57%
Gapsinmedicaleducation
60%
Gradesinclerkshipindesiredspecialty
57%
AlphaOmegaAlpha(AOA)membership
71%
Otherlifeexperience
51%
Consistencyofgrades
46%
Volunteer/extracurricularexperiences
66%
Demonstratedinvolvementandinterestinresearch
31%
GraduateofhighlyregardedU.S.medicalschool
37%
Otherpostinterviewcontact
26%
Interestinacademiccareer
11%
Visastatus*
17%
ApplicantwasflaggedwithMatchviolationbytheNRMP
11%
9%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
40%
Honorsinbasicsciences
31%
Secondinterview/visit
11%
Awayrotationinyourspecialtyatanotherinstitution
9%
USMLE/COMLEXStep3score
11%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
46
Average Rating
4.7
4.7
4.7
4.6
4.1
3.6
4.2
4.1
4.3
4.2
4.3
3.9
3.6
4.1
4.3
3.4
3.7
4.0
4.4
4.2
4.3
3.8
4.2
3.7
3.4
3.8
3.8
3.3
4.2
3.3
3.8
4.3
4.3
2.3
3.9
3.3
2.8
3.7
4.5
2
Internal Medicine/Pediatrics
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure IMP-3
N=34
100%
90%
76%
80%
80%
70%
60%
50%
50%
40%
40%
24%
29%
30%
20%
20%
10%
0%
71%
70%
60%
30%
N=31
100%
90%
10%
0%
Yes, pass only
0%
0%
No
Never
Seldom
Often
Scores required?
N=33
N=27
100%
100%
90%
90%
80%
80%
70%
70%
58%
60%
60%
50%
40%
30%
50%
40%
30%
30%
20%
20%
12%
10%
10%
0%
0%
Yes, pass only
52%
48%
No
Never
0%
often
Seldom
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=23
N=18
N=20
USMLE Step 2 CK
N=14
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
47
Internal Medicine/Pediatrics
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure IMP-4
USMLE Step 3
N=32
100%
88%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
0%
10%
Yes
79%
16%
20%
13%
N=32
10%
N=19
100%
0%
No
N=19
5%
Yes, pass only
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=22
90%
90%
80%
80%
70%
70%
64%
60%
60%
50%
50%
40%
40%
30%
50%
32%
30%
23%
20%
14%
18%
20%
10%
10%
0%
N=22
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=21
90%
90%
80%
80%
70%
70%
60%
57%
50%
40%
40%
30%
24%
20%
30%
19%
0%
No
20%
20%
10%
10%
Yes, pass only
73%
60%
50%
0%
N=15
48
7%
Yes, pass only
No
Figure IMP-5
Internal Medicine/Pediatrics
Program's Interview Activities
1,000
100%
900
90%
800
80%
700
70%
600
60%
500
42%
400
40%
300
245
30%
200
20%
100
0
48%
50%
69
53
49
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
N=35*
Number of
applications
received
N=34
N=35
N=35
0%
Percentage of applications
rejected
N=35*
Percentage of applicants
receiving an in-depth review
N=34
N=34
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
15% of Internal Medicine/Pediatrics programs consider all applicant groups
100%
N=34
90%
80%
70%
62%
60%
47%
50%
40%
35%
35%
26%
30%
21%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
49
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Neurological Surgery
(N=55)
50
Figure NS-1
Neurological Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=54)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
Average Rating
93%
4.4
Lettersofrecommendationinthespecialty 98%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
4.7
81%
3.8
65%
4.0
78%
3.7
72%
4.3
Gradesinrequiredclerkships
59%
Gapsinmedicaleducation
61%
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
Leadershipqualities
4.6
59%
3.9
74%
4.5
63%
4.3
4.2
67%
4.3
74%
Honorsinclerkshipindesiredspecialty
4.3
61%
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
4.2
80%
Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment
3.9
69%
Classranking/quartile
Evidenceofprofessionalismandethics
4.3
4.3
44%
3.8
81%
PassUSMLEStep2CS/COMLEXLvl2PE
3.9
39%
Perceivedinterestinprogram
61%
Consistencyofgrades
61%
4.3
4.0
Otherlifeexperience
57%
3.6
Volunteer/extracurricularexperiences
56%
3.5
GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch
3.8
65%
4.1
80%
Visastatus*
ApplicantwasflaggedwithMatchviolationbytheNRMP
Interestinacademiccareer
4.1
59%
51
3.4
15%
3.9
56%
20%
Fluencyinlanguagespokenbyyourpatientpopulation
3.4
41%
GoldSocietymembership
USMLE/COMLEXStep3score
100%
4.6
22%
Honorsinbasicsciences
Awayrotationinyourspecialtyatanotherinstitution
4.0
39%
3.7
4%
50%
0% 1
4.5
4
Figure NS-2
Neurological Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=54)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 94%
Interpersonalskills
85%
Interactionswithhousestaffduringinterviewandvisit
87%
Feedbackfromcurrentresidents
85%
USMLEStep1/COMLEXLevel1score
70%
Lettersofrecommendationinthespecialty
89%
USMLEStep2CK/COMLEXLevel2CEscore
44%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
70%
Perceivedcommitmenttospecialty
78%
Evidenceofprofessionalismandethics
74%
Perceivedinterestinprogram
74%
Leadershipqualities
65%
Personalpriorknowledgeoftheapplicant
56%
Classranking/quartile
33%
GraduateofU.S.allopathicmedicalschool
46%
PersonalStatement
56%
Auditionelective/rotationwithinyourdepartment
65%
Gradesinrequiredclerkships
43%
PassingUSMLEStep2CS/COMLEXLevel2PE
26%
Honorsinclinicalclerkships
50%
Honorsinclerkshipindesiredspecialty
43%
Gapsinmedicaleducation
28%
Gradesinclerkshipindesiredspecialty
39%
AlphaOmegaAlpha(AOA)membership
48%
Otherlifeexperience
31%
Consistencyofgrades
37%
Volunteer/extracurricularexperiences
33%
Demonstratedinvolvementandinterestinresearch
63%
GraduateofhighlyregardedU.S.medicalschool
43%
Otherpostinterviewcontact
46%
Interestinacademiccareer
52%
Visastatus*
20%
ApplicantwasflaggedwithMatchviolationbytheNRMP
13%
Fluencyinlanguagespokenbyyourpatientpopulation
13%
GoldSocietymembership
6%
Honorsinbasicsciences
19%
Secondinterview/visit
31%
Awayrotationinyourspecialtyatanotherinstitution
37%
USMLE/COMLEXStep3score
2%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
52
Average Rating
4.8
4.8
4.9
4.7
4.4
4.5
4.2
3.5
4.5
4.6
4.4
4.4
4.6
3.6
4.3
3.8
4.6
3.8
4.1
4.0
4.0
3.9
4.0
4.0
3.9
4.0
3.9
4.1
4.0
4.2
4.2
3.5
4.6
3.7
3.3
3.4
3.9
3.9
5.0
2
Neurological Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure NS-3
N=52
100%
90%
79%
80%
80%
70%
70%
60%
50%
40%
42%
40%
30%
30%
19%
20%
10%
0%
58%
60%
50%
20%
N=48
100%
90%
10%
2%
Yes, pass only
0%
0%
No
Never
Seldom
Often
Scores required?
N=47
N=33
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
47%
50%
40%
50%
39%
40%
32%
30%
30%
21%
20%
20%
10%
10%
0%
0%
Yes, pass only
61%
No
Never
0%
often
Seldom
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=35
N=19
N=24
USMLE Step 2 CK
N=13
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
53
Neurological Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure NS-4
USMLE Step 3
N=46
100%
N=28
100%
90%
90%
76%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
24%
20%
75%
21%
20%
N=46
10%
0%
N=28
10%
Yes
0%
No
4%
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=17
90%
90%
80%
80%
70%
65%
78%
70%
60%
60%
50%
50%
40%
40%
30%
N=18
30%
24%
20%
20%
12%
10%
10%
0%
0%
No
17%
6%
Yes, pass only
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=17
90%
82%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
18%
20%
10%
10%
0%
94%
30%
30%
20%
N=16
90%
0%
Yes, pass only
0%
No
54
6%
0%
Yes, pass only
No
Neurological Surgery
Program's Interview Activities
Figure NS-5
1,000
100%
900
90%
800
80%
700
70%
600
500
50%
400
40%
40%
300
30%
202
200
20%
100
0
57%
60%
50
38
27
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
2
Number of
positions in the
Match
Number of
applications
received
N=55*
N=53
N=53
N=53
10%
0%
Percentage of applications
rejected
N=55*
Percentage of applicants
receiving an in-depth review
N=52
N=53
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
21% of Neurological Surgery programs consider all applicant groups
96%
N=53
90%
80%
70%
60%
53%
50%
40%
40%
26%
30%
40%
42%
U.S. IMG
Non-U.S. IMG
23%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
55
Fifth Pathway
Neurology
(N=60)
56
Figure N-1
Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=59)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
90%
Lettersofrecommendationinthespecialty
92%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
4.0
4.3
85%
4.2
75%
4.0
PersonalStatement
71%
GraduateofU.S.allopathicmedicalschool
71%
Gradesinrequiredclerkships
Gapsinmedicaleducation
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
Classranking/quartile
3.7
4.2
63%
4.2
76%
4.1
61%
4.1
71%
4.2
75%
4.0
Evidenceofprofessionalismandethics
63%
Personalpriorknowledgeoftheapplicant
63%
Auditionelective/rotationwithinyourdepartment
4.3
4.0
4.0
59%
Leadershipqualities
56%
Honorsinclerkshipindesiredspecialty
58%
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
Consistencyofgrades
GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch
4.1
4.1
4.0
56%
3.4
44%
3.4
53%
3.9
58%
3.3
49%
4.0
39%
4.7
34%
3.3
39%
Honorsinbasicsciences
3.4
22%
GoldSocietymembership
3.6
31%
Awayrotationinyourspecialtyatanotherinstitution
3.5
22%
27%
Fluencyinlanguagespokenbyyourpatientpopulation
57
3.9
49%
Interestinacademiccareer
4.4
64%
ApplicantwasflaggedwithMatchviolationbytheNRMP
4.2
56%
Visastatus*
USMLE/COMLEXStep3score
100%
3.9
61%
Otherlifeexperience
Volunteer/extracurricularexperiences
Average Rating
3.4
3.7
25%
50%
0% 1
Figure N-2
Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=59)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 97%
Interpersonalskills 98%
Interactionswithhousestaffduringinterviewandvisit 93%
Feedbackfromcurrentresidents
73%
USMLEStep1/COMLEXLevel1score
80%
Lettersofrecommendationinthespecialty
81%
USMLEStep2CK/COMLEXLevel2CEscore
68%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
73%
Perceivedcommitmenttospecialty
75%
Evidenceofprofessionalismandethics
61%
Perceivedinterestinprogram
56%
Leadershipqualities
59%
Personalpriorknowledgeoftheapplicant
61%
Classranking/quartile
68%
GraduateofU.S.allopathicmedicalschool
51%
PersonalStatement
54%
Auditionelective/rotationwithinyourdepartment
47%
Gradesinrequiredclerkships
49%
PassingUSMLEStep2CS/COMLEXLevel2PE
53%
Honorsinclinicalclerkships
49%
Honorsinclerkshipindesiredspecialty
47%
Gapsinmedicaleducation
47%
Gradesinclerkshipindesiredspecialty
46%
AlphaOmegaAlpha(AOA)membership
44%
Otherlifeexperience
41%
Consistencyofgrades
46%
Volunteer/extracurricularexperiences
37%
Demonstratedinvolvementandinterestinresearch
44%
GraduateofhighlyregardedU.S.medicalschool
44%
Otherpostinterviewcontact
37%
Interestinacademiccareer
39%
Visastatus*
22%
ApplicantwasflaggedwithMatchviolationbytheNRMP
22%
Fluencyinlanguagespokenbyyourpatientpopulation
25%
GoldSocietymembership
25%
Honorsinbasicsciences
20%
22%
Secondinterview/visit
20%
Awayrotationinyourspecialtyatanotherinstitution
19%
USMLE/COMLEXStep3score
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
58
Average Rating
4.9
4.8
4.7
4.5
3.9
4.2
3.8
4.1
4.3
4.4
4.0
4.1
4.2
4.1
4.1
3.6
4.1
4.0
4.0
4.0
4.2
4.1
4.2
4.1
3.5
4.0
3.3
3.3
4.0
4.0
3.6
3.8
4.7
3.7
3.9
3.4
4.0
3.9
4.0
2
Neurology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure N-3
N=58
100%
90%
80%
70%
60%
60%
60%
50%
50%
40%
40%
30%
30%
20%
20%
10%
0%
76%
80%
70%
40%
N=51
100%
90%
10%
0%
Yes, pass only
22%
2%
0%
No
Never
Seldom
Often
Scores required?
N=58
N=49
100%
100%
90%
90%
80%
80%
70%
70%
60%
40%
60%
50%
50%
50%
40%
34%
30%
30%
16%
20%
10%
0%
0%
Yes, target score
24%
20%
10%
Yes, pass only
73%
No
2%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=28
N=23
N=20
USMLE Step 2 CK
N=16
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
59
Neurology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure N-4
USMLE Step 3
N=57
100%
N=40
100%
90%
90%
77%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
23%
20%
20%
N=57
10%
0%
68%
20%
13%
N=40
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=41
90%
90%
80%
80%
70%
70%
60%
60%
51%
50%
50%
40%
40%
30%
27%
22%
30%
20%
20%
10%
10%
0%
N=40
0%
No
40%
38%
No
23%
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=36
90%
90%
80%
80%
70%
70%
47%
50%
50%
40%
40%
28%
30%
25%
20%
20%
10%
10%
0%
68%
60%
60%
30%
N=28
0%
No
60
25%
7%
Yes, pass only
No
Neurology
Program's Interview Activities
Figure N-5
1,000
100%
900
90%
800
80%
700
70%
600
60%
500
400
50%
Percentage of applications
rejected
Percentage of applicants
receiving an in-depth review
40%
300
30%
200
20%
100
0
48%
50%
443
73
59
51
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
Number of
applications
received
N=60*
N=60
N=59
N=59
0%
N=60*
N=59
N=60
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
53% of Neurology programs consider all applicant groups
97%
N=59
90%
81%
80%
80%
71%
70%
85%
71%
60%
53%
50%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
61
Fifth Pathway
U.S. IMG
Non-U.S. IMG
62
Figure OG-1
Average Rating
USMLEStep1/COMLEXLevel1score 97%
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
4.2
92%
4.1
76%
3.9
84%
4.1
81%
3.5
68%
4.2
75%
4.1
Gapsinmedicaleducation
72%
4.2
Honorsinclinicalclerkships
72%
4.2
Perceivedcommitmenttospecialty
Classranking/quartile
Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment
58%
72%
4.0
64%
4.1
3.9
62%
65%
Honorsinclerkshipindesiredspecialty
67%
Gradesinclerkshipindesiredspecialty
62%
AlphaOmegaAlpha(AOA)membership
62%
Perceivedinterestinprogram
4.4
69%
Leadershipqualities
PassUSMLEStep2CS/COMLEXLvl2PE
4.0
4.4
4.4
3.7
4.0
57%
4.0
50%
Consistencyofgrades
57%
Otherlifeexperience
57%
Volunteer/extracurricularexperiences
4.2
4.0
3.6
3.7
51%
GraduateofhighlyregardedU.S.medicalschool
3.6
38%
Demonstratedinvolvementandinterestinresearch
3.6
43%
Visastatus*
33%
ApplicantwasflaggedwithMatchviolationbytheNRMP
33%
4.2
4.8
Interestinacademiccareer
22%
Honorsinbasicsciences
21%
GoldSocietymembership
63
3.6
3.7
13%
21%
Fluencyinlanguagespokenbyyourpatientpopulation
3.2
35%
Awayrotationinyourspecialtyatanotherinstitution
USMLE/COMLEXStep3score
100%
3.5
3.5
14%
50%
0% 1
3.7
3
4
Figure OG-2
Interactionswithfacultyduringinterviewandvisit 96%
Interpersonalskills
91%
Interactionswithhousestaffduringinterviewandvisit
91%
Feedbackfromcurrentresidents
86%
USMLEStep1/COMLEXLevel1score
79%
Lettersofrecommendationinthespecialty
72%
USMLEStep2CK/COMLEXLevel2CEscore
74%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
58%
Perceivedcommitmenttospecialty
67%
Evidenceofprofessionalismandethics
61%
Perceivedinterestinprogram
57%
Leadershipqualities
60%
Personalpriorknowledgeoftheapplicant
60%
Classranking/quartile
53%
GraduateofU.S.allopathicmedicalschool
54%
PersonalStatement
49%
Auditionelective/rotationwithinyourdepartment
53%
Gradesinrequiredclerkships
46%
PassingUSMLEStep2CS/COMLEXLevel2PE
45%
Honorsinclinicalclerkships
48%
Honorsinclerkshipindesiredspecialty
54%
Gapsinmedicaleducation
42%
Gradesinclerkshipindesiredspecialty
46%
AlphaOmegaAlpha(AOA)membership
47%
Otherlifeexperience
42%
Consistencyofgrades
36%
Volunteer/extracurricularexperiences
34%
Demonstratedinvolvementandinterestinresearch
28%
GraduateofhighlyregardedU.S.medicalschool
29%
Otherpostinterviewcontact
35%
Interestinacademiccareer
20%
Visastatus*
16%
ApplicantwasflaggedwithMatchviolationbytheNRMP
17%
Fluencyinlanguagespokenbyyourpatientpopulation
15%
GoldSocietymembership
25%
Honorsinbasicsciences
12%
Secondinterview/visit
22%
Awayrotationinyourspecialtyatanotherinstitution
10%
USMLE/COMLEXStep3score
11%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
64
Average Rating
4.8
4.8
4.8
4.7
4.1
3.9
4.0
3.7
4.2
4.5
4.2
4.2
4.1
3.9
4.1
3.4
4.2
4.0
4.2
4.1
4.1
4.2
4.0
4.0
3.7
4.0
3.6
3.7
4.1
4.0
3.7
3.9
4.7
3.8
3.9
3.1
3.5
3.6
4.2
2
Figure OG-3
N=114
100%
80%
90%
75%
80%
70%
60%
50%
50%
40%
40%
25%
30%
20%
19%
20%
10%
0%
75%
70%
60%
30%
N=104
100%
90%
6%
10%
0%
0%
No
Never
Seldom
Often
Scores required?
N=112
N=97
100%
100%
90%
90%
80%
80%
70%
70%
60%
54%
60%
50%
50%
40%
30%
40%
27%
30%
19%
20%
20%
6%
10%
10%
0%
53%
41%
0%
Yes, pass only
No
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=71
N=46
N=50
USMLE Step 2 CK
N=34
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
65
Figure OG-4
USMLE Step 3
N=109
100%
N=60
100%
90%
90%
79%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
21%
20%
0%
23%
20%
N=109
10%
72%
N=60 5%
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=72
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
50%
29%
21%
20%
30%
35%
25%
20%
10%
10%
0%
41%
40%
40%
30%
N=69
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=63
90%
90%
80%
80%
70%
70%
60%
60%
50%
44%
44%
40%
30%
30%
10%
0%
20%
11%
Yes, pass only
20%
10%
0%
No
76%
50%
40%
20%
N=45
66
4%
Yes, pass only
No
Figure OG-5
1,000
100%
900
90%
800
80%
700
70%
600
60%
52%
500
50%
425
400
300
30%
200
20%
89
100
0
44%
40%
72
63
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
N=123*
Number of
applications
received
N=122
Number of
interview
invitations sent
N=119
N=122
0%
Percentage of applications
rejected
N=123*
Percentage of applicants
receiving an in-depth review
N=117
N=122
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
15% of Obstetrics and Gynecology programs consider all applicant groups
97%
N=116
90%
80%
75%
70%
60%
54%
48%
50%
40%
34%
30%
30%
18%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
67
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Orthopaedic Surgery
(N=87)
68
Figure OS-1
Orthopaedic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=85)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
95%
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
4.4
92%
4.2
79%
USMLEStep2CK/COMLEXLevel2CEscore
82%
GraduateofU.S.allopathicmedicalschool
81%
Gradesinrequiredclerkships
4.0
64%
PersonalStatement
Honorsinclinicalclerkships
4.5
74%
4.2
52%
Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant
4.3
53%
Honorsinclerkshipindesiredspecialty
4.2
75%
4.5
67%
4.4
4.6
64%
4.1
74%
4.5
69%
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
4.1
72%
Auditionelective/rotationwithinyourdepartment
Leadershipqualities
3.8
87%
Perceivedcommitmenttospecialty
Classranking/quartile
4.0
3.3
Gapsinmedicaleducation
4.4
58%
3.9
84%
PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
Otherlifeexperience
64%
4.2
3.6
3.6
59%
GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch
3.9
55%
66%
Volunteer/extracurricularexperiences
3.9
46%
3.7
69%
Visastatus*
19%
ApplicantwasflaggedwithMatchviolationbytheNRMP
20%
Interestinacademiccareer
3.8
3.8
12%
Awayrotationinyourspecialtyatanotherinstitution
32%
Fluencyinlanguagespokenbyyourpatientpopulation
9%
69
4.8
40%
GoldSocietymembership
4.0
25%
Honorsinbasicsciences
USMLE/COMLEXStep3score
100%
3.6
19%
Consistencyofgrades
Average Rating
3.4
3.7
3.9
0%
50%
0% 1
Figure OS-2
Orthopaedic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=85)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit
89%
Interpersonalskills
88%
Interactionswithhousestaffduringinterviewandvisit
86%
Feedbackfromcurrentresidents
82%
USMLEStep1/COMLEXLevel1score
70%
Lettersofrecommendationinthespecialty
73%
USMLEStep2CK/COMLEXLevel2CEscore
48%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
57%
Perceivedcommitmenttospecialty
46%
Evidenceofprofessionalismandethics
64%
Perceivedinterestinprogram
57%
Leadershipqualities
57%
Personalpriorknowledgeoftheapplicant
54%
Classranking/quartile
50%
GraduateofU.S.allopathicmedicalschool
61%
PersonalStatement
46%
Auditionelective/rotationwithinyourdepartment
62%
Gradesinrequiredclerkships
48%
PassingUSMLEStep2CS/COMLEXLevel2PE
11%
Honorsinclinicalclerkships
52%
Honorsinclerkshipindesiredspecialty
48%
Gapsinmedicaleducation
33%
Gradesinclerkshipindesiredspecialty
37%
AlphaOmegaAlpha(AOA)membership
55%
Otherlifeexperience
39%
Consistencyofgrades
38%
Volunteer/extracurricularexperiences
38%
Demonstratedinvolvementandinterestinresearch
48%
GraduateofhighlyregardedU.S.medicalschool
30%
Otherpostinterviewcontact
15%
Interestinacademiccareer
23%
Visastatus*
10%
ApplicantwasflaggedwithMatchviolationbytheNRMP
12%
2%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
11%
Honorsinbasicsciences
25%
Secondinterview/visit
12%
Awayrotationinyourspecialtyatanotherinstitution
21%
USMLE/COMLEXStep3score
1%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
70
Average Rating
4.6
4.6
4.6
4.6
4.2
4.3
4.0
3.9
4.1
4.5
4.0
4.1
4.5
4.0
4.4
3.5
4.7
4.0
4.3
4.1
4.1
4.0
4.2
3.9
3.7
4.0
3.7
3.9
4.0
3.9
3.9
4.0
4.7
3.0
3.8
3.6
3.7
3.5
4.0
2
Orthopaedic Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure OS-3
100%
93%
90%
80%
80%
70%
70%
60%
50%
40%
37%
40%
30%
30%
20%
0%
61%
60%
50%
10%
N=71
100%
90%
20%
7%
10%
0%
Yes, pass only
3%
0%
No
Never
Seldom
Often
Scores required?
N=75
N=55
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
52%
50%
50%
40%
30%
20%
65%
40%
28%
20%
20%
10%
10%
0%
0%
Yes, pass only
33%
30%
No
2%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=65
N=30
N=27
USMLE Step 2 CK
N=15
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
71
Orthopaedic Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure OS-4
USMLE Step 3
N=65
100%
N=41
100%
90%
90%
80%
80%
66%
70%
60%
60%
50%
50%
40%
40%
34%
30%
30%
20%
20%
N=65
10%
0%
73%
70%
22%
N=41 5%
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=27
90%
90%
80%
80%
74%
70%
70%
60%
60%
50%
50%
40%
40%
19%
20%
0%
84%
30%
30%
10%
N=25
20%
7%
10%
0%
No
8%
8%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=26
88%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
0%
92%
20%
20%
10%
N=26
90%
8%
Yes, pass only
10%
4%
Yes, target score
0%
No
72
4%
4%
No
Figure OS-5
Orthopaedic Surgery
Program's Interview Activities
1,000
100%
900
90%
800
80%
700
70%
600
549
60%
500
50%
400
40%
300
30%
200
20%
100
0
49%
46%
72
59
51
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
N=87*
Number of
applications
received
N=84
N=83
N=83
0%
Percentage of applications
rejected
N=87*
Percentage of applicants
receiving an in-depth review
N=81
N=84
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
13% of Orthopaedic Surgery programs consider all applicant groups
99%
N=83
90%
80%
70%
60%
51%
50%
40%
27%
30%
23%
20%
20%
16%
14%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
73
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Otolaryngology
(N=46)
74
Figure O-1
Otolaryngology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=46)
Percent Citing Factor
Average Rating
USMLEStep1/COMLEXLevel1score 98%
4.3
Lettersofrecommendationinthespecialty 100%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
4.6
74%
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
59%
Perceivedcommitmenttospecialty
4.2
61%
3.6
85%
4.4
67%
4.3
59%
Evidenceofprofessionalismandethics
4.0
65%
4.4
70%
Auditionelective/rotationwithinyourdepartment
4.4
4.3
63%
Leadershipqualities
76%
Honorsinclerkshipindesiredspecialty
76%
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
4.4
74%
Classranking/quartile
Personalpriorknowledgeoftheapplicant
3.7
67%
Gapsinmedicaleducation
Honorsinclinicalclerkships
4.0
74%
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
3.5
4.4
4.6
4.5
61%
4.0
83%
PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
4.2
46%
Otherlifeexperience
3.7
59%
3.8
72%
GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch
4.3
54%
Consistencyofgrades
Volunteer/extracurricularexperiences
4.1
20%
3.9
48%
4.3
80%
Visastatus*
4.0
17%
24%
ApplicantwasflaggedwithMatchviolationbytheNRMP
4.8
4.2
Interestinacademiccareer
35%
Honorsinbasicsciences
33%
17%
3.7
39%
13%
3.8
GoldSocietymembership
Awayrotationinyourspecialtyatanotherinstitution
Fluencyinlanguagespokenbyyourpatientpopulation
USMLE/COMLEXStep3score
100%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
75
3.9
2.8
4%
50%
0% 1
4.0
3
4
Figure O-2
Otolaryngology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=46)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 96%
Interpersonalskills 96%
Interactionswithhousestaffduringinterviewandvisit 96%
Feedbackfromcurrentresidents 96%
USMLEStep1/COMLEXLevel1score
71%
Lettersofrecommendationinthespecialty
80%
USMLEStep2CK/COMLEXLevel2CEscore
31%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
38%
Perceivedcommitmenttospecialty
60%
Evidenceofprofessionalismandethics
64%
Perceivedinterestinprogram
53%
Leadershipqualities
73%
Personalpriorknowledgeoftheapplicant
56%
Classranking/quartile
40%
GraduateofU.S.allopathicmedicalschool
44%
PersonalStatement
42%
Auditionelective/rotationwithinyourdepartment
53%
Gradesinrequiredclerkships
40%
PassingUSMLEStep2CS/COMLEXLevel2PE
4%
Honorsinclinicalclerkships
53%
Honorsinclerkshipindesiredspecialty
51%
Gapsinmedicaleducation
33%
Gradesinclerkshipindesiredspecialty
44%
AlphaOmegaAlpha(AOA)membership
49%
Otherlifeexperience
40%
Consistencyofgrades
22%
Volunteer/extracurricularexperiences
42%
Demonstratedinvolvementandinterestinresearch
64%
GraduateofhighlyregardedU.S.medicalschool
20%
Otherpostinterviewcontact
20%
Interestinacademiccareer
33%
Visastatus*
7%
ApplicantwasflaggedwithMatchviolationbytheNRMP
18%
7%
Fluencyinlanguagespokenbyyourpatientpopulation
16%
GoldSocietymembership
Honorsinbasicsciences
20%
Secondinterview/visit
2%
Awayrotationinyourspecialtyatanotherinstitution
20%
USMLE/COMLEXStep3score
2%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
76
Average Rating
4.9
4.8
4.8
4.7
3.7
4.3
3.7
3.7
4.5
4.2
4.3
4.3
4.7
3.9
4.5
3.6
4.3
4.1
4.0
4.2
4.2
3.4
4.1
3.7
3.8
3.6
4.1
4.2
4.1
4.3
4.2
4.0
4.8
2.5
3.4
3.0
5.0
3.9
3.0
2
Otolaryngology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure O-3
N=46
100%
80%
80%
90%
80%
70%
70%
60%
60%
50%
45%
40%
30%
30%
20%
20%
10%
0%
55%
50%
40%
20%
N=40
100%
90%
10%
0%
Yes, pass only
0%
0%
No
Never
Seldom
Often
Scores required?
N=42
N=27
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
38%
40%
30%
67%
40%
33%
29%
20%
20%
10%
10%
0%
0%
Yes, pass only
33%
30%
No
0%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=32
N=14
N=15
USMLE Step 2 CK
N=8
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
77
Otolaryngology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure O-4
USMLE Step 3
N=39
100%
N=28
100%
90%
90%
80%
80%
70%
70%
62%
60%
75%
60%
50%
50%
38%
40%
40%
30%
30%
20%
20%
N=39
10%
0%
14%
N=28 11%
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=19
80%
74%
70%
60%
60%
50%
50%
40%
40%
30%
30%
16%
20%
11%
10%
0%
79%
80%
70%
20%
N=19
90%
90%
16%
10%
0%
No
5%
Yes, pass only
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=19
90%
79%
80%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
16%
10%
0%
94%
80%
70%
20%
N=16
90%
10%
5%
Yes, pass only
0%
No
78
6%
0%
Yes, pass only
No
Figure O-5
Otolaryngology
Program's Interview Activities
1,000
100%
900
90%
800
80%
700
600
60%
500
50%
400
40%
312
31%
300
30%
200
20%
100
0
67%
70%
46
37
35
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
3
Number of
positions in the
Match
N=46*
Number of
applications
received
N=45
N=45
N=45
10%
0%
Percentage of applications
rejected
N=46*
Percentage of applicants
receiving an in-depth review
N=45
N=45
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
24% of Otolaryngology programs consider all applicant groups
98%
N=46
90%
80%
70%
70%
60%
50%
37%
40%
30%
28%
28%
Osteopathic
Physician
Canadian
28%
24%
20%
10%
0%
U.S. Senior
U.S. Graduate
79
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Pathology
(N=84)
80
Figure PA-1
Pathology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=84)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
Average Rating
94%
4.3
Lettersofrecommendationinthespecialty 98%
4.5
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
83%
4.0
USMLEStep2CK/COMLEXLevel2CEscore
86%
4.0
PersonalStatement
83%
GraduateofU.S.allopathicmedicalschool
68%
Gradesinrequiredclerkships
4.0
60%
Gapsinmedicaleducation
3.8
75%
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
3.8
4.1
57%
3.5
93%
Classranking/quartile
Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment
4.6
57%
63%
Gradesinclerkshipindesiredspecialty
Perceivedinterestinprogram
Consistencyofgrades
4.1
3.9
64%
3.9
54%
4.1
58%
4.1
68%
AlphaOmegaAlpha(AOA)membership
PassUSMLEStep2CS/COMLEXLvl2PE
4.4
57%
Leadershipqualities
Honorsinclerkshipindesiredspecialty
3.8
3.6
54%
4.0
71%
4.4
67%
4.0
58%
Otherlifeexperience
39%
3.5
Volunteer/extracurricularexperiences
40%
3.5
GraduateofhighlyregardedU.S.medicalschool
61%
Demonstratedinvolvementandinterestinresearch
60%
4.1
3.7
Visastatus*
46%
ApplicantwasflaggedwithMatchviolationbytheNRMP
45%
Interestinacademiccareer
Fluencyinlanguagespokenbyyourpatientpopulation
81
3.8
3.3
8%
Awayrotationinyourspecialtyatanotherinstitution
4.2
42%
GoldSocietymembership
4.8
35%
Honorsinbasicsciences
USMLE/COMLEXStep3score
100%
3.9
50%
42%
26%
3.6
36%
3.5
3
0% 1
4.3
2
Figure PA-2
Pathology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=84)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 95%
Interpersonalskills 93%
Interactionswithhousestaffduringinterviewandvisit
89%
Feedbackfromcurrentresidents
89%
USMLEStep1/COMLEXLevel1score
89%
Lettersofrecommendationinthespecialty
85%
USMLEStep2CK/COMLEXLevel2CEscore
79%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
65%
Perceivedcommitmenttospecialty
82%
Evidenceofprofessionalismandethics
64%
Perceivedinterestinprogram
71%
Leadershipqualities
42%
Personalpriorknowledgeoftheapplicant
54%
Classranking/quartile
52%
GraduateofU.S.allopathicmedicalschool
60%
PersonalStatement
55%
Auditionelective/rotationwithinyourdepartment
54%
Gradesinrequiredclerkships
37%
PassingUSMLEStep2CS/COMLEXLevel2PE
61%
Honorsinclinicalclerkships
35%
Honorsinclerkshipindesiredspecialty
36%
Gapsinmedicaleducation
46%
Gradesinclerkshipindesiredspecialty
40%
AlphaOmegaAlpha(AOA)membership
31%
Otherlifeexperience
25%
Consistencyofgrades
37%
Volunteer/extracurricularexperiences
21%
Demonstratedinvolvementandinterestinresearch
45%
GraduateofhighlyregardedU.S.medicalschool
40%
Otherpostinterviewcontact
40%
Interestinacademiccareer
37%
Visastatus*
31%
ApplicantwasflaggedwithMatchviolationbytheNRMP
30%
Fluencyinlanguagespokenbyyourpatientpopulation
27%
GoldSocietymembership
2%
Honorsinbasicsciences
27%
Secondinterview/visit
21%
Awayrotationinyourspecialtyatanotherinstitution
19%
USMLE/COMLEXStep3score
31%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
82
Average Rating
4.8
4.7
4.7
4.7
4.3
4.3
4.1
4.0
4.5
4.5
4.5
4.0
4.2
3.8
4.0
3.8
4.1
3.9
4.0
3.8
3.9
4.2
4.0
4.0
3.2
3.9
3.3
4.0
4.0
4.3
4.1
3.9
4.8
4.5
2.5
3.9
3.9
3.9
3.8
2
Pathology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure PA-3
N=82
100%
90%
80%
63%
70%
60%
60%
50%
50%
35%
40%
30%
30%
20%
20%
10%
10%
0%
79%
80%
70%
40%
N=77
100%
90%
1%
Yes, pass only
14%
6%
0%
No
Never
Seldom
Often
Scores required?
N=77
N=72
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
52%
50%
40%
82%
50%
40%
32%
30%
30%
16%
20%
20%
10%
10%
0%
0%
Yes, pass only
No
13%
6%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=42
N=34
N=33
USMLE Step 2 CK
N=27
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
83
Pathology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PA-4
USMLE Step 3
N=73
100%
90%
90%
84%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
16%
20%
0%
64%
30%
20%
N=73
10%
N=61
100%
N=61 7%
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=62
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
50%
39%
40%
41%
38%
30%
30%
20%
11%
10%
0%
N=56
21%
20%
10%
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=55
90%
90%
80%
80%
70%
70%
60%
60%
55%
50%
55%
50%
40%
40%
27%
30%
18%
20%
32%
30%
20%
13%
10%
10%
0%
N=47
0%
No
84
No
Pathology
Program's Interview Activities
Figure PA-5
1,000
100%
900
90%
800
80%
700
70%
600
60%
500
50%
42%
400
349
40%
300
30%
200
20%
100
0
56%
55
41
32
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
4
Number of
positions in the
Match
N=84*
Number of
applications
received
N=82
N=82
N=82
10%
0%
Percentage of applications
rejected
N=84*
Percentage of applicants
receiving an in-depth review
N=80
N=82
Percentage of Programs that Typically Interview and Rank Each Applicant Group
67% of Pathology programs consider all applicant groups
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
99%
N=81
93%
93%
91%
94%
91%
U.S. IMG
Non-U.S. IMG
68%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
85
Fifth Pathway
Pediatrics
(N=121)
86
Figure P-1
Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=120)
Percent Citing Factor
Average Rating
USMLEStep1/COMLEXLevel1score 98%
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
Gapsinmedicaleducation
Honorsinclinicalclerkships
4.0
77%
3.8
87%
4.1
81%
4.1
70%
77%
4.0
69%
Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment
Leadershipqualities
Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
PassUSMLEStep2CS/COMLEXLvl2PE
4.1
77%
4.0
63%
Perceivedcommitmenttospecialty
Classranking/quartile
3.4
56%
Otherlifeexperience
Volunteer/extracurricularexperiences
4.0
54%
3.9
4.0
63%
4.1
66%
3.9
62%
4.2
64%
3.7
39%
3.8
63%
3.6
52%
3.7
55%
3.7
44%
3.4
23%
3.9
33%
ApplicantwasflaggedwithMatchviolationbytheNRMP
4.8
30%
18%
Interestinacademiccareer
Honorsinbasicsciences
3.6
3.4
24%
GoldSocietymembership
3.7
39%
Awayrotationinyourspecialtyatanotherinstitution
3.5
16%
33%
Fluencyinlanguagespokenbyyourpatientpopulation
87
3.9
57%
Visastatus*
3.8
65%
Demonstratedinvolvementandinterestinresearch
4.4
60%
GraduateofhighlyregardedU.S.medicalschool
USMLE/COMLEXStep3score
100%
4.0
75%
Perceivedinterestinprogram
Consistencyofgrades
4.0
3.4
2.7
16%
50%
0% 1
Figure P-2
Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=120)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 98%
Interpersonalskills 95%
Interactionswithhousestaffduringinterviewandvisit
93%
Feedbackfromcurrentresidents
90%
USMLEStep1/COMLEXLevel1score
90%
Lettersofrecommendationinthespecialty
76%
USMLEStep2CK/COMLEXLevel2CEscore
88%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
82%
Perceivedcommitmenttospecialty
60%
Evidenceofprofessionalismandethics
67%
Perceivedinterestinprogram
56%
Leadershipqualities
66%
Personalpriorknowledgeoftheapplicant
62%
Classranking/quartile
77%
GraduateofU.S.allopathicmedicalschool
68%
PersonalStatement
60%
Auditionelective/rotationwithinyourdepartment
63%
Gradesinrequiredclerkships
69%
PassingUSMLEStep2CS/COMLEXLevel2PE
71%
Honorsinclinicalclerkships
57%
Honorsinclerkshipindesiredspecialty
52%
Gapsinmedicaleducation
56%
Gradesinclerkshipindesiredspecialty
56%
AlphaOmegaAlpha(AOA)membership
52%
Otherlifeexperience
46%
Consistencyofgrades
47%
Volunteer/extracurricularexperiences
57%
Demonstratedinvolvementandinterestinresearch
30%
GraduateofhighlyregardedU.S.medicalschool
36%
Otherpostinterviewcontact
27%
Interestinacademiccareer
21%
Visastatus*
23%
ApplicantwasflaggedwithMatchviolationbytheNRMP
23%
Fluencyinlanguagespokenbyyourpatientpopulation
31%
GoldSocietymembership
35%
Honorsinbasicsciences
21%
Secondinterview/visit
18%
Awayrotationinyourspecialtyatanotherinstitution
13%
USMLE/COMLEXStep3score
11%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
88
Average Rating
4.7
4.8
4.7
4.6
4.2
3.8
4.1
4.2
4.1
4.5
3.8
4.0
4.2
4.1
4.1
3.4
4.0
3.9
4.3
4.1
4.2
4.2
4.2
4.2
3.6
3.9
3.7
3.4
3.7
3.8
3.6
3.7
4.9
3.4
3.8
3.5
3.5
3.7
3.4
2
Pediatrics
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure P-3
N=116
100%
90%
80%
70%
56%
60%
60%
43%
50%
40%
40%
30%
30%
20%
20%
10%
0%
77%
80%
70%
50%
N=113
100%
90%
10%
1%
Yes, pass only
18%
5%
0%
No
Never
Seldom
Often
Scores required?
N=113
N=108
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
40%
38%
50%
42%
40%
30%
30%
20%
20%
27%
20%
6%
10%
10%
0%
67%
0%
Yes, pass only
No
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=54
N=45
N=49
USMLE Step 2 CK
N=40
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
89
Pediatrics
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure P-4
USMLE Step 3
N=111
100%
90%
N=67
100%
90%
82%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
81%
30%
18%
20%
20%
N=111
10%
0%
13%
N=67 6%
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=100
90%
90%
80%
80%
70%
70%
60%
60%
52%
50%
50%
40%
40%
33%
30%
30%
20%
20%
15%
44%
29%
27%
10%
10%
0%
N=97
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=91
90%
90%
80%
80%
70%
60%
79%
70%
60%
60%
50%
50%
40%
40%
30%
30%
30%
20%
20%
10%
10%
0%
N=61
0%
No
15%
7%
10%
90
No
Figure P-5
Pediatrics
Program's Interview Activities
1,000
900
90%
800
80%
700
70%
600
60%
500
50%
400
40%
300
35%
30%
221
192
200
161
20%
100
10%
15
0
Number of
positions in the
Match
N=121*
58%
Number of
applications
received
N=118
Number of
interview
invitations sent
Number of
applicants
interviewed
N=116
N=116
0%
Number of
applicants
ranked
Percentage of applications
rejected
N=121*
Percentage of applicants
receiving an in-depth review
N=114
N=118
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
42% of Pediatrics programs consider all applicant groups
100%
N=118
90%
86%
80%
72%
72%
69%
70%
60%
60%
47%
50%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
91
Fifth Pathway
U.S. IMG
Non-U.S. IMG
92
Figure PMR-1
USMLEStep1/COMLEXLevel1score
91%
Lettersofrecommendationinthespecialty
91%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
Gapsinmedicaleducation
4.0
4.3
88%
4.2
85%
4.0
79%
3.9
64%
Classranking/quartile
Evidenceofprofessionalismandethics
3.9
73%
4.2
55%
4.5
67%
3.8
76%
4.4
55%
4.3
Consistencyofgrades
Otherlifeexperience
Volunteer/extracurricularexperiences
4.0
45%
4.4
58%
AlphaOmegaAlpha(AOA)membership
Perceivedinterestinprogram
4.1
48%
Honorsinclerkshipindesiredspecialty
PassUSMLEStep2CS/COMLEXLvl2PE
3.9
67%
Leadershipqualities
Gradesinclerkshipindesiredspecialty
3.9
76%
Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment
3.7
76%
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
3.5
42%
4.2
73%
4.2
58%
4.2
67%
3.6
55%
3.6
67%
GraduateofhighlyregardedU.S.medicalschool
3.6
33%
Demonstratedinvolvementandinterestinresearch
3.8
42%
Visastatus*
3.6
33%
ApplicantwasflaggedwithMatchviolationbytheNRMP
4.6
39%
Interestinacademiccareer
27%
GoldSocietymembership
6%
Awayrotationinyourspecialtyatanotherinstitution
93
3.4
3.5
3.8
39%
Fluencyinlanguagespokenbyyourpatientpopulation
2.9
21%
Honorsinbasicsciences
USMLE/COMLEXStep3score
100%
Average Rating
3.9
42%
3.8
33%
50%
0% 1
Figure PMR-2
Interactionswithfacultyduringinterviewandvisit 94%
Interpersonalskills 94%
Interactionswithhousestaffduringinterviewandvisit
85%
Feedbackfromcurrentresidents
79%
USMLEStep1/COMLEXLevel1score
82%
Lettersofrecommendationinthespecialty
82%
USMLEStep2CK/COMLEXLevel2CEscore
76%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
76%
Perceivedcommitmenttospecialty
79%
Evidenceofprofessionalismandethics
58%
Perceivedinterestinprogram
58%
Leadershipqualities
48%
Personalpriorknowledgeoftheapplicant
52%
Classranking/quartile
52%
GraduateofU.S.allopathicmedicalschool
39%
PersonalStatement
64%
Auditionelective/rotationwithinyourdepartment
64%
Gradesinrequiredclerkships
58%
PassingUSMLEStep2CS/COMLEXLevel2PE
70%
Honorsinclinicalclerkships
36%
Honorsinclerkshipindesiredspecialty
33%
Gapsinmedicaleducation
45%
Gradesinclerkshipindesiredspecialty
45%
AlphaOmegaAlpha(AOA)membership
39%
Otherlifeexperience
52%
Consistencyofgrades
61%
Volunteer/extracurricularexperiences
36%
Demonstratedinvolvementandinterestinresearch
52%
GraduateofhighlyregardedU.S.medicalschool
24%
Otherpostinterviewcontact
30%
Interestinacademiccareer
15%
Visastatus*
18%
ApplicantwasflaggedwithMatchviolationbytheNRMP
21%
Fluencyinlanguagespokenbyyourpatientpopulation
27%
GoldSocietymembership
9%
Honorsinbasicsciences
18%
Secondinterview/visit
9%
Awayrotationinyourspecialtyatanotherinstitution
33%
USMLE/COMLEXStep3score
27%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
94
Average Rating
4.8
4.7
4.7
4.6
4.0
4.2
4.0
4.2
4.5
4.6
4.2
4.1
4.1
3.9
4.0
3.7
4.7
3.8
4.0
4.1
4.5
3.9
4.3
3.8
3.6
4.1
3.7
3.4
3.8
4.1
4.0
3.8
4.9
3.8
3.7
3.7
3.3
4.4
3.8
2
Figure PMR-3
N=31
100%
90%
80%
80%
70%
48%
60%
48%
50%
40%
40%
30%
30%
20%
20%
10%
0%
67%
70%
60%
50%
N=30
100%
90%
10%
3%
Yes, pass only
20%
13%
0%
No
Never
Seldom
Often
Scores required?
N=31
N=29
100%
100%
90%
90%
80%
80%
70%
70%
60%
50%
60%
45%
40%
50%
40%
32%
30%
30%
23%
20%
20%
10%
10%
0%
83%
0%
Yes, pass only
No
10%
7%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=11
N=12
N=7
USMLE Step 2 CK
N=8
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
95
Figure PMR-4
USMLE Step 3
N=30
100%
N=23
100%
90%
90%
80%
80%
70%
70%
70%
60%
60%
50%
50%
40%
65%
40%
30%
30%
30%
20%
20%
N=30
10%
0%
17%
17%
N=23
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=31
90%
90%
80%
80%
70%
70%
60%
60%
50%
48%
50%
42%
40%
40%
30%
30%
20%
20%
10%
10%
0%
N=31
45%
32%
23%
10%
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=29
90%
90%
80%
80%
70%
60%
70%
57%
60%
55%
50%
50%
40%
34%
40%
30%
30%
26%
17%
20%
20%
10%
10%
0%
N=23
10%
0%
No
96
No
Figure PMR-5
1,000
100%
900
90%
800
80%
700
70%
600
60%
500
400
349
45%
40%
300
30%
200
20%
86
100
0
51%
50%
68
54
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
Number of
applications
received
N=34*
Number of
interview
invitations sent
N=34
N=34
N=34
0%
Percentage of applications
rejected
N=34*
Percentage of applicants
receiving an in-depth review
N=34
N=34
Percentage of Programs that Typically Interview and Rank Each Applicant Type
27% of Physical Medicine and Rehabilitation programs consider all applicant groups
N=33
100%
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
97%
79%
79%
61%
45%
G
M
.S
.I
-U
.S
.I
on
w
th
Pa
Fi
fth
97
ay
n
ad
ia
an
C
O
s
P h teo
y s pat
i c hi
ia c
n
ra
d
.S
.G
U
.S
.S
en
io
r
ua
te
42%
Plastic Surgery
(N=39)
98
Figure PS-1
Plastic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=34)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
94%
Lettersofrecommendationinthespecialty
94%
4.3
4.8
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
62%
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
3.1
65%
4.4
85%
3.6
74%
4.2
Gradesinrequiredclerkships
50%
Gapsinmedicaleducation
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
Personalpriorknowledgeoftheapplicant
Honorsinclerkshipindesiredspecialty
4.2
74%
4.2
59%
3.6
68%
4.2
76%
4.4
4.4
65%
4.1
71%
4.5
74%
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
4.5
56%
4.2
79%
PassUSMLEStep2CS/COMLEXLvl2PE
3.8
53%
Consistencyofgrades
3.6
62%
Volunteer/extracurricularexperiences
3.6
65%
GraduateofhighlyregardedU.S.medicalschool
3.8
62%
4.0
82%
3.0
3.9
24%
3%
Fluencyinlanguagespokenbyyourpatientpopulation
99
3.1
21%
12%
Awayrotationinyourspecialtyatanotherinstitution
4.2
47%
GoldSocietymembership
4.7
29%
Honorsinbasicsciences
USMLE/COMLEXStep3score
100%
3.9
47%
ApplicantwasflaggedwithMatchviolationbytheNRMP
Interestinacademiccareer
4.2
44%
Otherlifeexperience
Visastatus*
4.0
26%
Perceivedinterestinprogram
Demonstratedinvolvementandinterestinresearch
3.6
76%
Auditionelective/rotationwithinyourdepartment
Leadershipqualities
3.9
35%
Classranking/quartile
Evidenceofprofessionalismandethics
Average Rating
3.0
15%
50%
0% 1
4.0
3
4
Figure PS-2
Plastic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=34)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit
88%
Interpersonalskills
91%
Interactionswithhousestaffduringinterviewandvisit
85%
Feedbackfromcurrentresidents
68%
USMLEStep1/COMLEXLevel1score
56%
Lettersofrecommendationinthespecialty
82%
USMLEStep2CK/COMLEXLevel2CEscore
32%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
32%
Perceivedcommitmenttospecialty
62%
Evidenceofprofessionalismandethics
56%
Perceivedinterestinprogram
35%
Leadershipqualities
53%
Personalpriorknowledgeoftheapplicant
53%
Classranking/quartile
26%
GraduateofU.S.allopathicmedicalschool
44%
PersonalStatement
29%
Auditionelective/rotationwithinyourdepartment
62%
Gradesinrequiredclerkships
24%
PassingUSMLEStep2CS/COMLEXLevel2PE
18%
Honorsinclinicalclerkships
44%
Honorsinclerkshipindesiredspecialty
47%
Gapsinmedicaleducation
9%
Gradesinclerkshipindesiredspecialty
26%
AlphaOmegaAlpha(AOA)membership
47%
Otherlifeexperience
38%
Consistencyofgrades
21%
Volunteer/extracurricularexperiences
29%
Demonstratedinvolvementandinterestinresearch
62%
GraduateofhighlyregardedU.S.medicalschool
24%
Otherpostinterviewcontact
9%
Interestinacademiccareer
44%
Visastatus*
21%
15%
ApplicantwasflaggedwithMatchviolationbytheNRMP
3%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
3%
Honorsinbasicsciences
15%
Secondinterview/visit
0%
Awayrotationinyourspecialtyatanotherinstitution
18%
USMLE/COMLEXStep3score
12%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
100
Average Rating
4.8
4.7
4.8
4.7
4.2
4.5
4.0
3.4
4.5
4.5
4.3
4.3
4.5
4.2
4.1
3.7
4.7
3.8
4.2
4.0
4.6
4.3
4.7
4.1
3.7
4.3
4.0
4.0
4.3
4.0
4.3
4.4
4.4
3.0
4.0
3.4
4.3
3.5
2
Plastic Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure PS-3
N=35
100%
90%
90%
80%
80%
70%
60%
50%
50%
40%
40%
30%
33%
30%
14%
20%
10%
0%
67%
70%
60%
20%
N=30
100%
86%
10%
0%
Yes, pass only
0%
0%
No
Never
Seldom
Often
Scores required?
N=35
N=23
100%
100%
90%
90%
80%
80%
70%
70%
57%
60%
50%
50%
40%
40%
30%
30%
23%
20%
20%
10%
0%
0%
Yes, target score
35%
20%
10%
Yes, pass only
65%
60%
No
0%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=21
N=11
N=14
USMLE Step 2 CK
N=8
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
101
Plastic Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PS-4
USMLE Step 3
N=34
100%
N=28
100%
90%
90%
80%
80%
71%
70%
70%
60%
60%
50%
50%
40%
50%
40%
29%
30%
30%
20%
29%
21%
20%
N=34
10%
0%
N=28
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=9
80%
80%
67%
70%
60%
50%
50%
40%
33%
30%
30%
20%
20%
33%
10%
10%
0%
67%
70%
60%
40%
N=9
90%
90%
0%
Yes, pass only
No
0%
0%
Yes, pass only
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=8
90%
90%
80%
80%
70%
63%
70%
50%
50%
38%
40%
30%
30%
20%
20%
38%
10%
10%
0%
63%
60%
60%
40%
N=8
0%
Yes, pass only
No
0%
102
0%
Yes, pass only
No
Plastic Surgery
Program's Interview Activities
Figure PS-5
1,000
100%
900
90%
800
80%
700
600
60%
500
50%
400
40%
300
29%
30%
192
200
20%
100
0
67%
70%
2
Number of
positions in the
Match
Number of
applications
received
N=39*
N=38
10%
35
30
25
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=37
N=37
0%
Percentage of applications
rejected
N=39*
Percentage of applicants
receiving an in-depth review
N=36
N=38
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
18% of Plastic Surgery programs consider all applicant groups
97%
N=33
90%
80%
70%
60%
50%
45%
39%
40%
27%
30%
24%
24%
U.S. IMG
Non-U.S. IMG
18%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
103
Fifth Pathway
Psychiatry
(N=84)
104
Figure PSY-1
Psychiatry
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=83)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
87%
Lettersofrecommendationinthespecialty
84%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
Average Rating
3.7
4.1
94%
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
4.2
84%
92%
4.1
84%
Gradesinrequiredclerkships
Gapsinmedicaleducation
3.9
70%
3.9
89%
4.3
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
3.7
66%
3.7
88%
4.5
Classranking/quartile
58%
Evidenceofprofessionalismandethics
71%
Personalpriorknowledgeoftheapplicant
70%
3.6
4.6
4.0
Auditionelective/rotationwithinyourdepartment
65%
4.1
Leadershipqualities
65%
4.1
Honorsinclerkshipindesiredspecialty
67%
4.1
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
Consistencyofgrades
Otherlifeexperience
4.2
71%
3.4
51%
4.0
82%
4.2
60%
4.0
51%
3.8
65%
Volunteer/extracurricularexperiences
57%
3.6
GraduateofhighlyregardedU.S.medicalschool
58%
3.6
Demonstratedinvolvementandinterestinresearch
45%
Visastatus*
43%
ApplicantwasflaggedwithMatchviolationbytheNRMP
3.3
3.9
4.8
54%
Interestinacademiccareer
Honorsinbasicsciences
105
3.4
40%
Awayrotationinyourspecialtyatanotherinstitution
USMLE/COMLEXStep3score
100%
2.8
22%
GoldSocietymembership
Fluencyinlanguagespokenbyyourpatientpopulation
3.4
30%
3.1
24%
4.0
51%
29%
50%
0% 1
3.4
3
Figure PSY-2
Psychiatry
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=83)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 98%
Interpersonalskills 99%
Interactionswithhousestaffduringinterviewandvisit 95%
Feedbackfromcurrentresidents
89%
USMLEStep1/COMLEXLevel1score
73%
Lettersofrecommendationinthespecialty
78%
USMLEStep2CK/COMLEXLevel2CEscore
73%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
71%
Perceivedcommitmenttospecialty
84%
Evidenceofprofessionalismandethics
77%
Perceivedinterestinprogram
62%
Leadershipqualities
61%
Personalpriorknowledgeoftheapplicant
61%
Classranking/quartile
51%
GraduateofU.S.allopathicmedicalschool
66%
PersonalStatement
74%
Auditionelective/rotationwithinyourdepartment
59%
Gradesinrequiredclerkships
48%
PassingUSMLEStep2CS/COMLEXLevel2PE
61%
Honorsinclinicalclerkships
44%
Honorsinclerkshipindesiredspecialty
48%
Gapsinmedicaleducation
66%
Gradesinclerkshipindesiredspecialty
52%
AlphaOmegaAlpha(AOA)membership
45%
Otherlifeexperience
54%
Consistencyofgrades
40%
Volunteer/extracurricularexperiences
39%
Demonstratedinvolvementandinterestinresearch
35%
GraduateofhighlyregardedU.S.medicalschool
45%
Otherpostinterviewcontact
39%
Interestinacademiccareer
32%
Visastatus*
33%
ApplicantwasflaggedwithMatchviolationbytheNRMP
34%
Fluencyinlanguagespokenbyyourpatientpopulation
48%
GoldSocietymembership
29%
Honorsinbasicsciences
17%
Secondinterview/visit
17%
Awayrotationinyourspecialtyatanotherinstitution
11%
USMLE/COMLEXStep3score
27%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
106
Average Rating
4.9
5.0
4.9
4.8
3.8
3.9
3.9
4.2
4.4
4.8
4.2
4.1
4.1
3.6
4.1
3.7
4.2
3.8
4.1
3.8
3.9
4.2
4.0
3.7
3.9
4.2
3.8
3.6
3.8
3.8
3.7
4.1
4.9
4.2
3.7
3.3
3.6
3.6
3.3
2
Psychiatry
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure PSY-3
N=83
100%
90%
80%
70%
80%
69%
70%
60%
56%
60%
50%
50%
40%
41%
40%
30%
30%
30%
20%
20%
10%
0%
N=71
100%
90%
10%
1%
Yes, pass only
3%
0%
No
Never
Seldom
Often
Scores required?
N=83
N=70
100%
100%
90%
90%
80%
80%
70%
60%
70%
60%
64%
60%
50%
50%
40%
40%
30%
16%
20%
20%
10%
10%
0%
0%
Yes, pass only
30%
30%
24%
No
6%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=17
N=14
N=14
USMLE Step 2 CK
N=12
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
107
Psychiatry
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PSY-4
USMLE Step 3
N=80
100%
N=63
100%
90%
90%
80%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
20%
0%
30%
20%
N=80
10%
59%
N=63 11%
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=72
80%
80%
70%
67%
70%
60%
60%
50%
50%
31%
30%
58%
40%
40%
30%
24%
18%
20%
20%
10%
0%
N=71
90%
90%
3%
Yes, pass only
No
10%
0%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=70
90%
80%
70%
80%
67%
70%
60%
60%
50%
50%
40%
40%
30%
23%
53%
33%
30%
20%
20%
10%
10%
0%
N=49
90%
No
0%
14%
10%
108
No
Figure PSY-5
Psychiatry
Program's Interview Activities
900
858
90%
800
80%
700
70%
61%
600
60%
500
50%
400
40%
300
200
20%
100
100
0
30%
30%
79
61
Number of
applicants
interviewed
Number of
applicants
ranked
10%
7
Number of
positions in the
Match
N=84*
Number of
applications
received
N=81
Number of
interview
invitations sent
N=81
N=83
0%
Percentage of applications
rejected
N=84*
Percentage of applicants
receiving an in-depth review
N=77
N=81
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
40% of Psychiatry programs consider all applicant groups
98%
90%
86%
89%
N=83
80%
80%
67%
70%
63%
60%
46%
50%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
109
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Radiation Oncology
(N=44)
110
Figure RO-1
Radiation Oncology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=43)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
Average Rating
95%
4.3
Lettersofrecommendationinthespecialty 100%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
4.5
86%
4.0
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
51%
84%
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
3.8
65%
4.2
77%
3.9
Gapsinmedicaleducation
Honorsinclinicalclerkships
47%
3.8
72%
4.2
Perceivedcommitmenttospecialty
67%
Classranking/quartile
65%
Evidenceofprofessionalismandethics
63%
Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment
4.1
4.5
4.0
4.6
56%
4.3
4.3
72%
Leadershipqualities
60%
4.3
Honorsinclerkshipindesiredspecialty
60%
4.3
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
4.1
70%
60%
Otherlifeexperience
58%
Volunteer/extracurricularexperiences
4.3
3.7
3.9
53%
GraduateofhighlyregardedU.S.medicalschool
4.0
63%
4.4
86%
Visastatus*
21%
ApplicantwasflaggedwithMatchviolationbytheNRMP
23%
Interestinacademiccareer
Fluencyinlanguagespokenbyyourpatientpopulation
111
4.0
3.9
3.7
14%
44%
12%
Awayrotationinyourspecialtyatanotherinstitution
4.7
28%
GoldSocietymembership
3.6
53%
Honorsinbasicsciences
USMLE/COMLEXStep3score
100%
4.3
21%
Consistencyofgrades
Demonstratedinvolvementandinterestinresearch
3.8
60%
PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
4.3
56%
3.8
3.4
9%
50%
0% 1
4.5
4
Figure RO-2
Radiation Oncology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=43)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit
84%
Interpersonalskills
86%
Interactionswithhousestaffduringinterviewandvisit
70%
Feedbackfromcurrentresidents
70%
USMLEStep1/COMLEXLevel1score
57%
Lettersofrecommendationinthespecialty
77%
USMLEStep2CK/COMLEXLevel2CEscore
23%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
45%
Perceivedcommitmenttospecialty
57%
Evidenceofprofessionalismandethics
39%
Perceivedinterestinprogram
61%
Leadershipqualities
39%
Personalpriorknowledgeoftheapplicant
45%
Classranking/quartile
39%
GraduateofU.S.allopathicmedicalschool
27%
PersonalStatement
45%
Auditionelective/rotationwithinyourdepartment
39%
Gradesinrequiredclerkships
41%
PassingUSMLEStep2CS/COMLEXLevel2PE
2%
Honorsinclinicalclerkships
41%
Honorsinclerkshipindesiredspecialty
23%
Gapsinmedicaleducation
11%
Gradesinclerkshipindesiredspecialty
25%
AlphaOmegaAlpha(AOA)membership
18%
Otherlifeexperience
32%
Consistencyofgrades
23%
Volunteer/extracurricularexperiences
20%
Demonstratedinvolvementandinterestinresearch
61%
GraduateofhighlyregardedU.S.medicalschool
30%
Otherpostinterviewcontact
25%
Interestinacademiccareer
41%
Visastatus*
2%
ApplicantwasflaggedwithMatchviolationbytheNRMP
5%
7%
Fluencyinlanguagespokenbyyourpatientpopulation
0%
GoldSocietymembership
Honorsinbasicsciences
14%
Secondinterview/visit
7%
Awayrotationinyourspecialtyatanotherinstitution
30%
USMLE/COMLEXStep3score
2%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
112
Average Rating
4.9
4.9
4.8
4.6
3.8
4.4
4.2
4.2
4.4
4.6
4.4
4.2
4.4
4.0
4.0
4.0
4.4
3.7
4.0
3.8
4.3
3.4
4.0
4.0
3.6
4.2
3.7
4.4
3.8
4.5
4.2
4.0
5.0
3.3
3.5
4.3
4.0
4.0
2
Radiation Oncology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure RO-3
N=41
100%
90%
80%
73%
80%
70%
70%
60%
60%
50%
44%
40%
27%
30%
20%
20%
10%
0%
54%
50%
40%
30%
N=39
100%
90%
10%
0%
Yes, pass only
3%
0%
No
Never
Seldom
Often
Scores required?
N=35
N=28
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
37%
43%
40%
30%
23%
20%
20%
10%
10%
0%
0%
Yes, pass only
54%
No
4%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=24
N=10
N=11
USMLE Step 2 CK
N=6
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
113
Radiation Oncology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure RO-4
USMLE Step 3
N=36
100%
90%
90%
80%
80%
70%
70%
61%
60%
N=23
100%
74%
60%
50%
50%
39%
40%
40%
30%
30%
20%
20%
N=36
10%
0%
22%
N=23
10%
Yes
0%
No
4%
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=20
80%
80%
70%
70%
60%
50%
50%
40%
40%
30%
30%
20%
20%
10%
10%
0%
70%
70%
60%
20%
N=20
90%
90%
20%
10%
10%
No
0%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=20
90%
80%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
10%
Yes, pass only
22%
20%
10%
0%
78%
80%
70%
70%
20%
N=18
90%
10%
No
0%
114
0%
Yes, pass only
No
Figure RO-5
Radiation Oncology
Program's Interview Activities
1,000
100%
900
90%
800
80%
73%
700
70%
600
60%
500
50%
400
40%
300
30%
169
200
100
0
2
Number of
positions in the
Match
N=44*
Number of
applications
received
N=43
26%
20%
10%
32
25
22
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=44
N=44
0%
Percentage of applications
rejected
N=44*
Percentage of applicants
receiving an in-depth review
N=42
N=43
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
12% of Radiation Oncology programs consider all applicant groups
100%
N=42
90%
80%
70%
60%
55%
50%
45%
40%
30%
19%
20%
19%
12%
14%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
115
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Radiology-Diagnostic
(N=75)
116
Figure RD-1
Radiology-Diagnostic
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=74)
Percent Citing Factor
Average Rating
USMLEStep1/COMLEXLevel1score 99%
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
4.2
77%
91%
4.5
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
Gapsinmedicaleducation
Honorsinclinicalclerkships
66%
3.9
74%
3.3
82%
4.2
76%
4.5
72%
4.1
81%
Perceivedcommitmenttospecialty
Classranking/quartile
3.9
4.1
62%
3.9
85%
4.3
Evidenceofprofessionalismandethics
64%
Personalpriorknowledgeoftheapplicant
64%
4.2
4.1
Auditionelective/rotationwithinyourdepartment
59%
Leadershipqualities
58%
Honorsinclerkshipindesiredspecialty
3.7
4.2
47%
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
3.9
4.2
50%
3.9
77%
PassUSMLEStep2CS/COMLEXLvl2PE
4.4
31%
Perceivedinterestinprogram
65%
4.0
Consistencyofgrades
64%
4.1
Otherlifeexperience
Volunteer/extracurricularexperiences
GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch
3.6
61%
3.3
50%
3.9
57%
3.5
47%
Visastatus*
42%
ApplicantwasflaggedwithMatchviolationbytheNRMP
42%
Interestinacademiccareer
3.9
3.2
15%
14%
Fluencyinlanguagespokenbyyourpatientpopulation
117
3.8
22%
Awayrotationinyourspecialtyatanotherinstitution
3.3
41%
GoldSocietymembership
4.6
27%
Honorsinbasicsciences
USMLE/COMLEXStep3score
100%
4.1
3.0
18%
50%
0% 1
3.5
3
4
Figure RD-2
Radiology-Diagnostic
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=74)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 95%
Interpersonalskills 97%
Interactionswithhousestaffduringinterviewandvisit
85%
Feedbackfromcurrentresidents
82%
USMLEStep1/COMLEXLevel1score
85%
Lettersofrecommendationinthespecialty
65%
USMLEStep2CK/COMLEXLevel2CEscore
53%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
78%
Perceivedcommitmenttospecialty
61%
Evidenceofprofessionalismandethics
51%
Perceivedinterestinprogram
64%
Leadershipqualities
57%
Personalpriorknowledgeoftheapplicant
55%
Classranking/quartile
73%
GraduateofU.S.allopathicmedicalschool
62%
PersonalStatement
49%
Auditionelective/rotationwithinyourdepartment
50%
Gradesinrequiredclerkships
59%
PassingUSMLEStep2CS/COMLEXLevel2PE
24%
Honorsinclinicalclerkships
50%
Honorsinclerkshipindesiredspecialty
32%
Gapsinmedicaleducation
42%
Gradesinclerkshipindesiredspecialty
27%
AlphaOmegaAlpha(AOA)membership
53%
Otherlifeexperience
50%
Consistencyofgrades
45%
Volunteer/extracurricularexperiences
34%
Demonstratedinvolvementandinterestinresearch
39%
GraduateofhighlyregardedU.S.medicalschool
42%
Otherpostinterviewcontact
38%
Interestinacademiccareer
31%
Visastatus*
27%
ApplicantwasflaggedwithMatchviolationbytheNRMP
22%
8%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
19%
Honorsinbasicsciences
26%
Secondinterview/visit
12%
Awayrotationinyourspecialtyatanotherinstitution
8%
USMLE/COMLEXStep3score
11%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
118
Average Rating
4.7
4.7
4.7
4.6
4.1
3.9
3.8
4.3
4.1
4.4
4.2
4.1
4.2
4.4
4.3
3.3
4.3
4.3
3.9
4.2
4.3
4.3
4.3
4.0
3.7
4.2
3.5
3.7
4.1
3.7
3.6
4.0
4.9
3.3
4.1
3.7
3.8
3.2
3.9
2
Radiology-Diagnostic
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure RD-3
N=71
100%
90%
80%
80%
70%
70%
60%
60%
50%
45%
40%
30%
30%
20%
14%
10%
0%
52%
50%
40%
20%
N=62
100%
86%
90%
10%
0%
Yes, pass only
3%
0%
No
Never
Seldom
Often
Scores required?
N=66
N=44
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
44%
36%
40%
30%
20%
40%
30%
20%
20%
10%
10%
0%
0%
Yes, pass only
50%
48%
No
2%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=53
N=26
N=33
USMLE Step 2 CK
N=15
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
119
Radiology-Diagnostic
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure RD-4
USMLE Step 3
N=62
100%
N=39
100%
90%
90%
80%
80%
70%
69%
70%
60%
60%
60%
50%
50%
40%
40%
40%
30%
30%
20%
20%
N=62
10%
0%
23%
N=39 8%
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=29
90%
90%
80%
80%
70%
70%
48%
50%
50%
40%
40%
28%
24%
30%
20%
20%
10%
10%
0%
67%
60%
60%
30%
N=27
No
0%
19%
15%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=28
90%
80%
70%
60%
60%
50%
50%
40%
40%
30%
21%
20%
20%
11%
10%
0%
76%
80%
68%
70%
30%
N=25
90%
No
0%
16%
8%
10%
120
No
Figure RD-5
Radiology-Diagnostic
Program's Interview Activities
1,000
100%
900
90%
800
80%
700
70%
600
60%
500
50%
426
400
39%
40%
300
30%
200
20%
106
100
0
56%
84
76
Number of
applicants
interviewed
Number of
applicants
ranked
10%
7
Number of
positions in the
Match
N=75*
Number of
applications
received
N=74
Number of
interview
invitations sent
N=71
N=73
0%
Percentage of applications
rejected
N=75*
Percentage of applicants
receiving an in-depth review
N=73
N=74
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
28% of Radiology-Diagnostic programs consider all applicant groups
99%
N=74
90%
78%
80%
70%
64%
60%
50%
50%
45%
36%
40%
30%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
121
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Surgery
(N=121)
122
Figure GS-1
Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=115)
Percent Citing Factor
Average Rating
USMLEStep1/COMLEXLevel1score 97%
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
4.4
92%
4.3
79%
3.8
87%
4.3
72%
3.5
76%
4.3
Gradesinrequiredclerkships
70%
Gapsinmedicaleducation
69%
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
Classranking/quartile
Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant
Honorsinclerkshipindesiredspecialty
4.0
65%
4.0
58%
4.5
62%
4.1
4.0
53%
4.2
68%
4.4
73%
69%
AlphaOmegaAlpha(AOA)membership
70%
Perceivedinterestinprogram
4.3
70%
Gradesinclerkshipindesiredspecialty
PassUSMLEStep2CS/COMLEXLvl2PE
4.1
78%
Auditionelective/rotationwithinyourdepartment
Leadershipqualities
3.9
4.2
3.9
4.2
47%
3.9
55%
Consistencyofgrades
3.9
39%
Otherlifeexperience
52%
3.6
Volunteer/extracurricularexperiences
50%
3.6
GraduateofhighlyregardedU.S.medicalschool
3.8
Demonstratedinvolvementandinterestinresearch
47%
Visastatus*
45%
ApplicantwasflaggedwithMatchviolationbytheNRMP
3.5
3.9
29%
Awayrotationinyourspecialtyatanotherinstitution
3.5
21%
10%
Fluencyinlanguagespokenbyyourpatientpopulation
123
3.8
21%
GoldSocietymembership
4.8
33%
Honorsinbasicsciences
3.9
27%
Interestinacademiccareer
USMLE/COMLEXStep3score
100%
3.9
43%
3.3
3.9
10%
50%
0% 1
Figure GS-2
Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=115)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit
91%
Interpersonalskills
89%
Interactionswithhousestaffduringinterviewandvisit
86%
Feedbackfromcurrentresidents
76%
USMLEStep1/COMLEXLevel1score
82%
Lettersofrecommendationinthespecialty
79%
USMLEStep2CK/COMLEXLevel2CEscore
78%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
58%
Perceivedcommitmenttospecialty
69%
Evidenceofprofessionalismandethics
53%
Perceivedinterestinprogram
64%
Leadershipqualities
59%
Personalpriorknowledgeoftheapplicant
53%
Classranking/quartile
55%
GraduateofU.S.allopathicmedicalschool
62%
PersonalStatement
51%
Auditionelective/rotationwithinyourdepartment
48%
Gradesinrequiredclerkships
41%
PassingUSMLEStep2CS/COMLEXLevel2PE
38%
Honorsinclinicalclerkships
46%
Honorsinclerkshipindesiredspecialty
59%
Gapsinmedicaleducation
38%
Gradesinclerkshipindesiredspecialty
44%
AlphaOmegaAlpha(AOA)membership
48%
Otherlifeexperience
42%
Consistencyofgrades
33%
Volunteer/extracurricularexperiences
36%
Demonstratedinvolvementandinterestinresearch
34%
GraduateofhighlyregardedU.S.medicalschool
35%
Otherpostinterviewcontact
36%
Interestinacademiccareer
31%
Visastatus*
24%
ApplicantwasflaggedwithMatchviolationbytheNRMP
14%
Fluencyinlanguagespokenbyyourpatientpopulation
10%
GoldSocietymembership
18%
Honorsinbasicsciences
17%
Secondinterview/visit
23%
Awayrotationinyourspecialtyatanotherinstitution
12%
USMLE/COMLEXStep3score
8%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
124
Average Rating
4.8
4.7
4.8
4.6
4.4
4.2
4.2
3.8
4.3
4.5
4.1
4.2
4.3
4.0
4.3
3.4
4.2
4.0
4.2
4.1
4.2
4.1
4.2
4.1
3.6
3.9
3.5
3.9
4.0
4.1
3.9
4.1
4.3
3.7
3.9
3.6
4.0
3.7
3.9
2
Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure GS-3
N=112
100%
91%
90%
90%
80%
80%
70%
70%
60%
60%
50%
45%
40%
30%
30%
20%
0%
53%
50%
40%
10%
N=104
100%
20%
9%
10%
0%
Yes, pass only
2%
0%
No
Never
Seldom
Often
Scores required?
N=107
N=92
100%
100%
90%
90%
80%
74%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
10%
0%
16%
10%
36%
20%
10%
0%
62%
No
2%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=94
N=76
N=72
USMLE Step 2 CK
N=58
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
125
Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure GS-4
USMLE Step 3
N=102
100%
N=62
100%
90%
90%
80%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
74%
30%
20%
20%
0%
10%
Yes
16%
20%
N=102
10%
0%
No
10%
N=62
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=54
90%
90%
80%
80%
70%
70%
60%
52%
37%
40%
40%
0%
30%
30%
30%
10%
57%
60%
50%
50%
20%
N=53
20%
11%
13%
10%
No
0%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=50
90%
90%
80%
80%
70%
64%
60%
50%
50%
40%
40%
26%
30%
20%
20%
10%
10%
0%
80%
70%
60%
30%
N=40
10%
No
0%
126
10%
10%
No
Figure GS-5
Surgery
Program's Interview Activities
1,000
100%
900
90%
800
80%
731
700
70%
62%
600
60%
500
50%
400
40%
300
200
20%
92
100
0
33%
30%
74
55
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
N=121*
Number of
applications
received
N=118
Number of
interview
invitations sent
N=115
N=117
0%
Percentage of applications
rejected
N=121*
Percentage of applicants
receiving an in-depth review
N=115
N=118
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
19% of Surgery programs consider all applicant groups
100%
N=113
90%
80%
66%
70%
60%
50%
50%
48%
39%
37%
40%
30%
23%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
127
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Thoracic Surgery
(N=12)
128
Figure TS-1
Thoracic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=12)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
92%
Lettersofrecommendationinthespecialty
92%
Average Rating
4.1
4.7
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
83%
4.0
USMLEStep2CK/COMLEXLevel2CEscore
83%
4.0
PersonalStatement
83%
3.6
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
33%
83%
Gapsinmedicaleducation
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
4.1
50%
4.0
83%
4.0
50%
Classranking/quartile
Evidenceofprofessionalismandethics
4.0
33%
4.6
42%
Auditionelective/rotationwithinyourdepartment
42%
Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
4.3
4.6
4.4
67%
4.0
58%
4.5
4.2
50%
4.0
58%
5.0
42%
ApplicantwasflaggedwithMatchviolationbytheNRMP
5.0
17%
3.7
50%
Honorsinbasicsciences
3.7
25%
GoldSocietymembership
0%
Awayrotationinyourspecialtyatanotherinstitution
Fluencyinlanguagespokenbyyourpatientpopulation
129
4.0
25%
17%
Visastatus*
3.8
42%
Volunteer/extracurricularexperiences
4.0
33%
Otherlifeexperience
USMLE/COMLEXStep3score
100%
3.6
42%
Consistencyofgrades
Interestinacademiccareer
3.6
58%
Perceivedinterestinprogram
Demonstratedinvolvementandinterestinresearch
3.4
50%
PassUSMLEStep2CS/COMLEXLvl2PE
GraduateofhighlyregardedU.S.medicalschool
3.5
58%
Personalpriorknowledgeoftheapplicant
Leadershipqualities
4.3
50%
17%
8%
3.5
17%
3.5
3
5.0
0% 1
Figure TS-2
Thoracic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=12)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit
92%
Interpersonalskills
92%
Interactionswithhousestaffduringinterviewandvisit
83%
Feedbackfromcurrentresidents
83%
USMLEStep1/COMLEXLevel1score
75%
Lettersofrecommendationinthespecialty
92%
USMLEStep2CK/COMLEXLevel2CEscore
67%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
58%
Perceivedcommitmenttospecialty
75%
Evidenceofprofessionalismandethics
75%
Perceivedinterestinprogram
42%
Leadershipqualities
67%
Personalpriorknowledgeoftheapplicant
50%
Classranking/quartile
8%
GraduateofU.S.allopathicmedicalschool
33%
PersonalStatement
67%
Auditionelective/rotationwithinyourdepartment
25%
Gradesinrequiredclerkships
67%
PassingUSMLEStep2CS/COMLEXLevel2PE
33%
Honorsinclinicalclerkships
67%
Honorsinclerkshipindesiredspecialty
67%
Gapsinmedicaleducation
25%
Gradesinclerkshipindesiredspecialty
67%
AlphaOmegaAlpha(AOA)membership
50%
Otherlifeexperience
33%
Consistencyofgrades
42%
Volunteer/extracurricularexperiences
17%
Demonstratedinvolvementandinterestinresearch
67%
GraduateofhighlyregardedU.S.medicalschool
58%
Otherpostinterviewcontact
58%
Interestinacademiccareer
50%
Visastatus*
17%
ApplicantwasflaggedwithMatchviolationbytheNRMP
25%
Fluencyinlanguagespokenbyyourpatientpopulation
17%
0%
GoldSocietymembership
Honorsinbasicsciences
17%
Secondinterview/visit
17%
Awayrotationinyourspecialtyatanotherinstitution
8%
USMLE/COMLEXStep3score
0%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
130
Average Rating
4.8
4.6
4.8
4.6
4.2
4.6
4.3
3.3
4.2
4.3
4.4
4.1
4.0
5.0
4.5
3.4
4.3
3.9
4.0
4.3
4.3
4.0
4.3
4.3
3.5
4.0
3.0
3.5
4.0
4.1
3.8
4.5
4.0
4.5
3.0
4.0
4.0
2
Thoracic Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure TS-3
N=12
100%
90%
80%
80%
70%
60%
50%
50%
33%
40%
30%
33%
30%
20%
20%
8%
10%
0%
67%
70%
58%
60%
40%
N=6
100%
90%
10%
0%
No
0%
Never
Seldom
Often
Scores required?
N=12
N=5
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
42%
80%
50%
42%
40%
40%
30%
30%
17%
20%
20%
10%
10%
0%
0%
Yes, pass only
No
20%
0%
Never
Seldom
often
260
250
240
230
USMLE Step 2 CK
not reported
because of low
response rate
220
210
USMLE Step 2 CK
not reported
because of low
response rate
200
190
180
170
USMLE Step 1
N=5
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
131
Thoracic Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure TS-4
USMLE Step 3
N=11
100%
91%
90%
N=6
100%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
67%
33%
20%
N=11
10%
0%
9%
Yes
N=6
10%
0%
No
0%
Yes, pass only
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=7
90%
90%
80%
80%
70%
70%
60%
60%
50%
43%
30%
29%
29%
20%
10%
10%
Yes, pass only
33%
30%
20%
0%
50%
50%
40%
40%
N=6
No
0%
17%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 3*
N=4
100%
N=5
90%
80%
70%
60%
60%
50%
40%
40%
30%
20%
10%
0%
132
0%
Yes, pass only
No
Figure TS-5
Thoracic Surgery
Program's Interview Activities
1,000
100%
900
90%
800
80%
700
70%
62%
600
60%
500
50%
400
40%
300
30%
200
20%
108
100
0
36%
1
Number of
positions in the
Match
N=12*
Number of
applications
received
N=12
10%
33
28
23
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=12
N=12
0%
Percentage of applications
rejected
N=12*
Percentage of applicants
receiving an in-depth review
N=12
N=12
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
17% of Thoracic Surgery programs consider all applicant groups
100%
N=12
90%
80%
70%
58%
60%
58%
50%
50%
42%
40%
30%
25%
25%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
133
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Transitional Year
(N=47)
134
Figure TY-1
Transitional Year
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=47)
Percent Citing Factor
Average Rating
USMLEStep1/COMLEXLevel1score 98%
4.2
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
53%
3.9
85%
4.2
89%
4.1
PersonalStatement
70%
GraduateofU.S.allopathicmedicalschool
68%
Gradesinrequiredclerkships
3.9
4.4
53%
Gapsinmedicaleducation
68%
Honorsinclinicalclerkships
70%
4.4
4.4
4.3
Perceivedcommitmenttospecialty
Classranking/quartile
28%
72%
4.3
Evidenceofprofessionalismandethics
66%
Personalpriorknowledgeoftheapplicant
68%
4.7
4.3
Auditionelective/rotationwithinyourdepartment
66%
PassUSMLEStep2CS/COMLEXLvl2PE
64%
3.8
4.2
4.4
74%
4.0
53%
3.9
47%
3.8
60%
GraduateofhighlyregardedU.S.medicalschool
3.6
36%
Demonstratedinvolvementandinterestinresearch
4.3
32%
ApplicantwasflaggedwithMatchviolationbytheNRMP
4.6
40%
Interestinacademiccareer
Honorsinbasicsciences
17%
26%
GoldSocietymembership
23%
Awayrotationinyourspecialtyatanotherinstitution
6%
15%
Fluencyinlanguagespokenbyyourpatientpopulation
135
3.8
28%
Visastatus*
USMLE/COMLEXStep3score
100%
4.2
23%
AlphaOmegaAlpha(AOA)membership
Volunteer/extracurricularexperiences
4.1
28%
Gradesinclerkshipindesiredspecialty
Otherlifeexperience
4.2
45%
Honorsinclerkshipindesiredspecialty
Consistencyofgrades
3.9
40%
Leadershipqualities
Perceivedinterestinprogram
4.1
3.9
3.9
3.5
4.0
4.4
9%
50%
0% 1
3.3
3
Figure TY-2
Transitional Year
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=47)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit
89%
Interpersonalskills
89%
Interactionswithhousestaffduringinterviewandvisit
74%
Feedbackfromcurrentresidents
83%
USMLEStep1/COMLEXLevel1score
91%
Lettersofrecommendationinthespecialty
40%
USMLEStep2CK/COMLEXLevel2CEscore
79%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
72%
Perceivedcommitmenttospecialty
21%
Evidenceofprofessionalismandethics
72%
Perceivedinterestinprogram
79%
Leadershipqualities
53%
Personalpriorknowledgeoftheapplicant
57%
Classranking/quartile
66%
GraduateofU.S.allopathicmedicalschool
60%
PersonalStatement
68%
Auditionelective/rotationwithinyourdepartment
36%
Gradesinrequiredclerkships
60%
PassingUSMLEStep2CS/COMLEXLevel2PE
60%
Honorsinclinicalclerkships
64%
Honorsinclerkshipindesiredspecialty
23%
Gapsinmedicaleducation
49%
Gradesinclerkshipindesiredspecialty
19%
AlphaOmegaAlpha(AOA)membership
57%
Otherlifeexperience
45%
Consistencyofgrades
40%
Volunteer/extracurricularexperiences
47%
Demonstratedinvolvementandinterestinresearch
28%
GraduateofhighlyregardedU.S.medicalschool
34%
Otherpostinterviewcontact
45%
Interestinacademiccareer
15%
Visastatus*
23%
ApplicantwasflaggedwithMatchviolationbytheNRMP
26%
Fluencyinlanguagespokenbyyourpatientpopulation
19%
GoldSocietymembership
15%
Honorsinbasicsciences
28%
Secondinterview/visit
15%
Awayrotationinyourspecialtyatanotherinstitution
13%
USMLE/COMLEXStep3score
15%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
136
Average Rating
4.7
4.8
4.6
4.3
4.0
3.9
4.2
4.3
4.1
4.6
4.4
4.2
4.4
4.2
4.2
3.9
4.3
4.2
4.2
4.1
3.9
4.3
4.1
4.0
4.0
4.3
3.9
3.8
4.0
4.0
4.0
4.5
4.8
4.4
3.9
4.1
3.7
3.8
3.7
2
Transitional Year
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure TY-3
N=47
100%
80%
90%
74%
80%
70%
70%
60%
50%
40%
40%
28%
30%
23%
20%
20%
10%
0%
65%
60%
50%
30%
N=43
100%
90%
7%
10%
2%
0%
No
Never
Seldom
Often
Scores required?
N=44
N=36
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
40%
50%
41%
40%
32%
27%
30%
30%
20%
20%
10%
10%
0%
0%
Yes, pass only
69%
No
28%
3%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=26
N=16
N=19
USMLE Step 2 CK
N=10
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
137
Transitional Year
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure TY-4
USMLE Step 3
N=44
100%
90%
90%
80%
80%
68%
70%
N=19
100%
84%
70%
60%
60%
50%
50%
40%
40%
32%
30%
30%
20%
20%
N=44
10%
0%
16%
N=19
10%
Yes
0%
No
0%
Yes, pass only
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=27
90%
90%
80%
80%
70%
70%
60%
60%
48%
50%
40%
50%
40%
33%
30%
30%
19%
20%
38%
31%
31%
20%
10%
10%
0%
N=26
No
0%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=25
90%
90%
80%
80%
70%
70%
60%
80%
60%
52%
50%
50%
40%
40%
40%
30%
30%
20%
20%
8%
10%
0%
N=15
10%
No
0%
20%
138
0%
Yes, pass only
No
Figure TY-5
Transitional Year
Program's Interview Activities
1,000
100%
900
90%
800
80%
700
70%
600
60%
541
500
55%
50%
400
40%
300
34%
30%
200
20%
99
100
78
78
Number of
applicants
interviewed
Number of
applicants
ranked
10%
10
0
Number of
positions in the
Match
N=47*
Number of
applications
received
N=46
Number of
interview
invitations sent
N=46
N=45
0%
Percentage of applications
rejected
N=47*
Percentage of applicants
receiving an in-depth review
N=45
N=46
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
17% of Transitional Year programs consider all applicant groups
100%
N=47
90%
80%
74%
70%
60%
50%
40%
38%
34%
30%
30%
23%
19%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
139
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Vascular Surgery
(N=22)
140
Figure VS-1
Vascular Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=20)
Percent Citing Factor
USMLEStep1/COMLEXLevel1score
Average Rating
95%
3.8
Lettersofrecommendationinthespecialty 100%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
4.7
70%
USMLEStep2CK/COMLEXLevel2CEscore
80%
PersonalStatement
80%
3.9
3.6
3.9
GraduateofU.S.allopathicmedicalschool
55%
Gradesinrequiredclerkships
3.9
50%
Gapsinmedicaleducation
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
30%
4.1
80%
4.8
55%
Evidenceofprofessionalismandethics
55%
Honorsinclerkshipindesiredspecialty
4.0
4.2
65%
PassUSMLEStep2CS/COMLEXLvl2PE
4.2
3.8
4.5
65%
3.7
50%
Otherlifeexperience
3.7
50%
GraduateofhighlyregardedU.S.medicalschool
3.8
55%
4.0
75%
3.9
45%
3.5
10%
10%
GoldSocietymembership
Awayrotationinyourspecialtyatanotherinstitution
3.0
3.7
30%
15%
Fluencyinlanguagespokenbyyourpatientpopulation
141
4.6
25%
Honorsinbasicsciences
3.7
45%
ApplicantwasflaggedwithMatchviolationbytheNRMP
3.9
40%
Volunteer/extracurricularexperiences
USMLE/COMLEXStep3score
100%
3.6
45%
Consistencyofgrades
Interestinacademiccareer
4.0
75%
AlphaOmegaAlpha(AOA)membership
Visastatus*
3.3
60%
65%
Demonstratedinvolvementandinterestinresearch
4.5
45%
Gradesinclerkshipindesiredspecialty
Perceivedinterestinprogram
4.0
60%
Auditionelective/rotationwithinyourdepartment
Leadershipqualities
3.5
70%
Classranking/quartile
Personalpriorknowledgeoftheapplicant
4.0
3.3
15%
50%
0% 1
4.3
4
Figure VS-2
Vascular Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=20)
Percent Citing Factor
Interactionswithfacultyduringinterviewandvisit 95%
Interpersonalskills 100%
Interactionswithhousestaffduringinterviewandvisit
85%
Feedbackfromcurrentresidents
60%
USMLEStep1/COMLEXLevel1score
75%
Lettersofrecommendationinthespecialty 95%
USMLEStep2CK/COMLEXLevel2CEscore
70%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
55%
Perceivedcommitmenttospecialty
60%
Evidenceofprofessionalismandethics
55%
Perceivedinterestinprogram
60%
Leadershipqualities
40%
Personalpriorknowledgeoftheapplicant
50%
Classranking/quartile
50%
GraduateofU.S.allopathicmedicalschool
35%
PersonalStatement
40%
Auditionelective/rotationwithinyourdepartment
30%
Gradesinrequiredclerkships
40%
PassingUSMLEStep2CS/COMLEXLevel2PE
35%
Honorsinclinicalclerkships
50%
Honorsinclerkshipindesiredspecialty
40%
Gapsinmedicaleducation
10%
Gradesinclerkshipindesiredspecialty
45%
AlphaOmegaAlpha(AOA)membership
50%
Otherlifeexperience
40%
Consistencyofgrades
35%
Volunteer/extracurricularexperiences
25%
Demonstratedinvolvementandinterestinresearch
60%
GraduateofhighlyregardedU.S.medicalschool
40%
Otherpostinterviewcontact
40%
Interestinacademiccareer
45%
Visastatus*
20%
ApplicantwasflaggedwithMatchviolationbytheNRMP
5%
0%
Fluencyinlanguagespokenbyyourpatientpopulation
10%
GoldSocietymembership
Honorsinbasicsciences
25%
Secondinterview/visit
5%
Awayrotationinyourspecialtyatanotherinstitution
15%
USMLE/COMLEXStep3score
20%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
142
Average Rating
4.9
4.7
4.7
4.2
3.9
4.7
3.9
3.8
4.7
4.5
4.6
3.9
3.9
3.8
4.3
3.6
4.0
4.1
3.7
3.7
4.0
3.0
4.1
4.1
3.6
4.2
2.8
3.9
3.9
3.6
4.2
3.5
5.0
2.5
3.4
3.0
4.0
4.0
2
Vascular Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure VS-3
N=21
100%
81%
80%
90%
80%
70%
60%
50%
50%
40%
40%
30%
32%
30%
19%
20%
10%
0%
68%
70%
60%
20%
N=19
100%
90%
10%
0%
Yes, pass only
0%
0%
No
Never
Seldom
Often
Scores required?
N=21
N=15
100%
100%
90%
90%
80%
80%
71%
70%
60%
50%
50%
40%
40%
30%
30%
20%
67%
70%
60%
14%
20%
14%
10%
10%
0%
0%
Yes, pass only
33%
No
0%
Never
Seldom
often
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=11
N=8
N=8
USMLE Step 2 CK
N=6
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
143
Vascular Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure VS-4
USMLE Step 3
N=21
100%
N=15
100%
90%
90%
76%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
20%
20%
N=21
0%
33%
30%
24%
10%
53%
13%
N=15
10%
Yes
0%
No
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
N=13
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
38%
40%
30%
38%
50%
40%
33%
30%
23%
20%
20%
10%
10%
0%
N=12
No
0%
17%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=11
90%
90%
80%
80%
70%
70%
60%
60%
50%
45%
27%
27%
20%
10%
10%
Yes, pass only
No
0%
30%
30%
20%
0%
50%
50%
40%
40%
30%
N=10
144
20%
No
Vascular Surgery
Program's Interview Activities
Figure VS-5
1,000
100%
900
90%
800
80%
700
600
60%
500
50%
400
40%
300
27%
30%
200
20%
100
0
69%
70%
54
1
Number of
positions in the
Match
Number of
applications
received
N=22*
N=21
10%
22
17
14
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=22
N=22
0%
Percentage of applications
rejected
N=22*
Percentage of applicants
receiving an in-depth review
N=21
N=21
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
38% of Vascular Surgery programs consider all applicant groups
95%
N=21
90%
80%
71%
70%
62%
60%
48%
50%
52%
43%
43%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
145
Fifth Pathway
U.S. IMG
Non-U.S. IMG