Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                

PD Survey Report 2014

Download as pdf or txt
Download as pdf or txt
You are on page 1of 148

Results of the 2014 NRMP

Program Director Survey

All rights reserved. Permission to use, copy and/or distribute any


documentation and/or related images from this publication shall be
expressly obtained from the NRMP.

June 2014
www.nrmp.org

Requests for permission to use these data as well as questions about the content of this
publication or the National Resident Matching Program data and reports may be directed to
Mei Liang, Director of Research, NRMP, at datarequest@nrmp.org.
Questions about the NRMP should be directed to Mona M. Signer, Executive Director, NRMP,
at support@nrmp.org.
Suggested Citation
National Resident Matching Program, Data Release and Research Committee: Results of the
2014 NRMP Program Director Survey. National Resident Matching Program, Washington, DC.
2014.
Copyright 2014 National Resident Matching Program.

Table of Contents

Introduction .................................................................................................................................................................. 1
All Specialties............................................................................................................................................................... 2
Charts for Individual Specialties
Anesthesiology ....................................................................................................................................................... 8
Child Neurology ................................................................................................................................................... 14
Dermatology ......................................................................................................................................................... 20
Emergency Medicine ........................................................................................................................................... 26
Family Medicine ................................................................................................................................................... 32
Internal Medicine.................................................................................................................................................. 38
Internal Medicine/Pediatrics ................................................................................................................................. 44
Neurological Surgery............................................................................................................................................ 50
Neurology ............................................................................................................................................................. 56
Obstetrics and Gynecology .................................................................................................................................. 62
Orthopaedic Surgery ............................................................................................................................................. 68
Otolaryngology ..................................................................................................................................................... 74
Pathology .............................................................................................................................................................. 80
Pediatrics .............................................................................................................................................................. 86
Physical Medicine and Rehabilitation .................................................................................................................. 92
Plastic Surgery ...................................................................................................................................................... 98
Psychiatry ........................................................................................................................................................... 104
Radiation Oncology ............................................................................................................................................ 110
Radiology-Diagnostic ......................................................................................................................................... 116
Surgery ............................................................................................................................................................... 122
Thoracic Surgery ................................................................................................................................................ 128
Transitional Year ................................................................................................................................................ 134
Vascular Surgery ................................................................................................................................................ 140

Introduction
In March 2014, the National Resident Matching Program
(NRMP) conducted its biennial survey of the directors of all
programs participating in the Main Residency Match. The
primary purpose of the survey was to shed light on the factors
that program directors use to (1) select applicants to interview
and (2) rank applicants for the Match.

Several changes were made to the 2014 questionnaire. In the


past, program directors were asked to indicate factors they
used in selecting applicants to interview and to rate the
importance of each factor in ranking. In this survey, program
directors were asked to indicate factors they used in selecting
applicants to interview and rank respectively. They were
asked to rate the importance on a scale of 1 to 5 only for the
factors they used in their selection process. In addition, this
survey asked program directors how they handled unfilled
positions after the 2013 Match and SOAP. Because the
number of responses for that question was small, the results
are only reported in the "All Specialties" section.

The survey was fielded during the 18 days between the rank
order list deadline and Match Week so that program match
outcomes would not influence respondents' answers.
The survey solicited information on:
the number of applications received, screened, and
reviewed, as well as the number of applicants interviewed
and ranked
whether the program typically interviews and ranks specific
applicant groups
use of test scores in considering which applicants to
interview, and
the factors used for both interview selection and for ranking
applicants.

Numbers of responses are presented in most of the graphs.


Some graphs use data from multiple survey questions. In
those cases, different N's are listed. Numbers of applicants
ranked and positions in the Match are extracted from the
NRMP database. Graphs are suppressed for questions with
fewer than five responses.

The overall response rate for all specialties in this report was
52.7 percent. Transitional Year and 22 specialties with 10 or
more responses are included in this report. Their response rates
are listed in the table below. Response rates for those
specialties ranged from a high of 65.4 percent for Emergency
Medicine and Pediatrics to a low of 42.6 for Radiology.

_______________

Specialty
Anesthesiology
ChildNeurology
Dermatology
EmergencyMedicine
FamilyMedicine
InternalMedicine
InternalMedicine/Pediatrics
NeurologicalSurgery
Neurology
ObstetricsandGynecology
OrthopaedicSurgery
Otolaryngology
Pathology
Pediatrics
PhysicalMedicineandRehabilitation
PlasticSurgery
Psychiatry
RadiationOncology
RadiologyDiagnostic
Surgery
ThoracicSurgery
TransitionalYear
VascularSurgery
Allothers
Total

NRMP Program Director Survey Results, 2014

This report presents results by specialty on selected items


from the survey. The NRMP hopes that program directors,
medical school officials, and applicants find these data
useful as they prepare for and participate in the Main
Residency Match.
The NRMP's data reporting and research activities are guided by
its Data Release and Research Committee. NRMP data and
reports can be found at: www.nrmp.org/match-data/.

Surveys Sent Num ber Responding Response Rate


127
72
110
159
429
379
80
102
129
230
147
100
134
185
77
63
180
84
176
275
25
91
44
101
3,499

71
41
60
104
236
197
35
55
60
123
87
46
84
121
34
39
84
44
75
121
12
47
22
46
1,844

55.9%
56.9%
54.5%
65.4%
55.0%
52.0%
43.8%
53.9%
46.5%
53.5%
59.2%
46.0%
62.7%
65.4%
44.2%
61.9%
46.7%
52.4%
42.6%
44.0%
48.0%
51.6%
50.0%
45.5%
52.7%

All Specialties Combined


(N=1,844)

Figure 1

All Specialties
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=1,793)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

Average Rating

4.1

Lettersofrecommendationinthespecialty

94%
86%

MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

84%

4.0

USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool

4.2

80%
78%

4.1
3.6

75%

4.1

Gradesinrequiredclerkships

70%

4.0

Gapsinmedicaleducation

70%

4.1

Honorsinclinicalclerkships

69%

4.0

Perceivedcommitmenttospecialty

69%
69%

Classranking/quartile

4.3
3.9

Evidenceofprofessionalismandethics

65%

Personalpriorknowledgeoftheapplicant

65%

4.1

Auditionelective/rotationwithinyourdepartment

4.0

Leadershipqualities

63%
63%

Honorsinclerkshipindesiredspecialty

61%

4.3

Gradesinclerkshipindesiredspecialty

61%
61%

4.3

AlphaOmegaAlpha(AOA)membership

4.5

4.0

3.8

PassUSMLEStep2CS/COMLEXLvl2PE

57%

4.1

Perceivedinterestinprogram

4.1

Consistencyofgrades

57%
56%

Otherlifeexperience

56%

3.6

Volunteer/extracurricularexperiences

54%

3.6

GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch

4.0

3.8

48%
43%

Visastatus*

3.7
4.0

39%
34%

ApplicantwasflaggedwithMatchviolationbytheNRMP

4.8
3.7

Interestinacademiccareer

28%

Honorsinbasicsciences

27%

GoldSocietymembership

3.7

Awayrotationinyourspecialtyatanotherinstitution

27%
25%

Fluencyinlanguagespokenbyyourpatientpopulation

25%

3.6

USMLE/COMLEXStep3score
100%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

3.5
3.7

18%
50%

0% 1

3.5
3

Figure 2

All Specialties
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=1,799)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 93%
Interpersonalskills 93%
Interactionswithhousestaffduringinterviewandvisit
88%
Feedbackfromcurrentresidents
82%
USMLEStep1/COMLEXLevel1score
80%
Lettersofrecommendationinthespecialty
74%
USMLEStep2CK/COMLEXLevel2CEscore
71%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
68%
Perceivedcommitmenttospecialty
67%
Evidenceofprofessionalismandethics
64%
Perceivedinterestinprogram
62%
Leadershipqualities
60%
Personalpriorknowledgeoftheapplicant
58%
Classranking/quartile
57%
GraduateofU.S.allopathicmedicalschool
57%
PersonalStatement
55%
Auditionelective/rotationwithinyourdepartment
55%
Gradesinrequiredclerkships
51%
PassingUSMLEStep2CS/COMLEXLevel2PE
50%
Honorsinclinicalclerkships
49%
Honorsinclerkshipindesiredspecialty
45%
Gapsinmedicaleducation
45%
Gradesinclerkshipindesiredspecialty
45%
AlphaOmegaAlpha(AOA)membership
45%
Otherlifeexperience
44%
Consistencyofgrades
40%
Volunteer/extracurricularexperiences
40%
Demonstratedinvolvementandinterestinresearch
36%
GraduateofhighlyregardedU.S.medicalschool
36%
Otherpostinterviewcontact
33%
Interestinacademiccareer
26%
Visastatus*
23%
ApplicantwasflaggedwithMatchviolationbytheNRMP
22%
Fluencyinlanguagespokenbyyourpatientpopulation
20%
GoldSocietymembership
20%
Honorsinbasicsciences
20%
Secondinterview/visit
19%
Awayrotationinyourspecialtyatanotherinstitution
17%
USMLE/COMLEXStep3score
15%
0% 1
100%
50%

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

NRMP Program Director Survey Results, 2014

Average Rating

4.8
4.8
4.7
4.6
4.1
4.1
4.1
4.0
4.3
4.5
4.1
4.1
4.3
4.0
4.1
3.6
4.3
4.0
4.1
4.0
4.2
4.1
4.2
4.0
3.7
4.0
3.7
3.7
3.9
4.0
3.8
4.0
4.7
3.8
3.8
3.5
3.7
3.9
3.7
3
4
5

All Specialties
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure 3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?
100%

Would your program consider applicants who fail the


exam on the first attempt?

N=1,746

N=1,601

100%
80%
80%

68%

63%

60%

40%

60%
40%

31%

26%
20%

0%

20%

1%
Yes, pass only

Yes, target score

0%

No

11%
Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

100%
N=1,672

N=1,417

100%

80%
80%
60%

40%

58%

60%

50%

40%

31%
19%

20%

35%

20%

6%
0%

Yes, pass only

Yes, target score

0%

No

Never

Seldom

often

USMLE Step 1 and Step 2 CK Scores


Programs Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

USMLE Step 1
N=989

170

USMLE Step 2 CK
N=688

USMLE Step 1
N=684

USMLE Step 2 CK
N=508

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol in the box represents the mean.
NRMP Program Director Survey Results, 2014

All Specialties
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure 4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 Clinical Skills (CS)

USMLE Step 3

N=1,604

100%

90%

90%
80%

N=1,049

100%

78%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

22%

20%

20%
10%

18%
11%

10%

N=61

0%

71%

Yes

0%

No

N=41
Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*

90%

90%

80%

80%

70%

70%

60%

60%

50%
40%

50%
41%

40%

36%

30%

23%

20%

10%

10%
Yes, pass only

Yes, target score

33%

33%

34%

Yes, pass only

Yes, target score

No

30%

20%

0%

N=1,102

100%

N=1,140

0%

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*

COMLEX-USA Level 3*

N=1,057

100%
90%

90%

80%

80%

70%

70%

60%
50%

73%

60%
50%

50%
38%

40%

40%

30%

30%

20%

20%

12%

10%
0%

N=789

100%

17%
10%

10%
Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

Yes, pass only

Yes, target score

No

All Specialties
Program's Interview Activities

Figure 5

Average Percentage of Applicants Rejected and Reviewed

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked
900

100%

856

90%

800

80%

700

70%

600

60%

500

50%

51%
44%

40%

400

30%

300
20%

200

119

10%

96

100

77
0%

Percentage of applications rejected

0
Number of
positions in the
Match

Number of
applications
received

N=1,844*

N=1,799

Number of
interview
invitations sent

Number of
applicants
interviewed

N=1,776

Number of
applicants ranked

N=1,791

N=1,844*

Percentage of applicants receiving


an in-depth review

N=1,733

N=1,799

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
100%

99%

31% of all programs consider all applicant groups

90%
80%

71%

69%

70%

60%

60%

51%

50%
40%

48%
35%

30%
20%
10%
0%
U.S. Senior

U.S. Graduate

Osteopathic
Physician

Canadian

Fifth Pathway

U.S. IMG

Non-U.S. IMG

N=1,772

Preferred Type of Communication About Applicants During SOAP


100%
90%
80%
70%
60%

59%

50%
40%
30%

24%

20%

15%

10%

2%

0%

We want to receive only the


ERAS application

We want to be contacted by
the applicants medical
school after we have initiated
contact with the applicant

We will initiate contact with


references and/or the
medical school, but we do
not wish to be contacted
N=1,582

NRMP Program Director Survey Results, 2014

Other

Anesthesiology
(N=71)

NRMP Program Director Survey Results, 2014

Figure AN-1

Anesthesiology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=67)
Percent Citing Factor

Average Rating

USMLEStep1/COMLEXLevel1score 99%
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships

4.5
81%

3.9

87%

4.2

82%

4.1

78%

3.4

85%

4.1

69%

Gapsinmedicaleducation

75%

Honorsinclinicalclerkships

75%

Perceivedcommitmenttospecialty
Classranking/quartile
Evidenceofprofessionalismandethics

4.2
4.0

60%

4.1

70%
75%

Auditionelective/rotationwithinyourdepartment

75%

4.5
4.2
4.0

67%

Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership

Volunteer/extracurricularexperiences

4.2

69%

3.8
46%

4.0

69%

4.2

60%

3.6

57%

3.6

52%

Demonstratedinvolvementandinterestinresearch

51%

3.7
3.4

Visastatus*

45%

ApplicantwasflaggedwithMatchviolationbytheNRMP

45%

Interestinacademiccareer

3.2
3.3

36%

Awayrotationinyourspecialtyatanotherinstitution

3.8

25%
13%

Fluencyinlanguagespokenbyyourpatientpopulation

4.9

40%

GoldSocietymembership

NRMP Program Director Survey Results, 2014

3.8
27%

Honorsinbasicsciences

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

3.9

51%

GraduateofhighlyregardedU.S.medicalschool

USMLE/COMLEXStep3score
100%

4.2

52%

Perceivedinterestinprogram
Otherlifeexperience

4.2
48%

PassUSMLEStep2CS/COMLEXLvl2PE
Consistencyofgrades

4.2

81%

Personalpriorknowledgeoftheapplicant
Leadershipqualities

4.1

2.9
3.8

15%
50%

0% 1

3.1
3

Figure AN-2

Anesthesiology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=67)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 96%
Interpersonalskills
91%
Interactionswithhousestaffduringinterviewandvisit
85%
Feedbackfromcurrentresidents
81%
USMLEStep1/COMLEXLevel1score
88%
Lettersofrecommendationinthespecialty
65%
USMLEStep2CK/COMLEXLevel2CEscore
69%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
74%
Perceivedcommitmenttospecialty
72%
Evidenceofprofessionalismandethics
76%
Perceivedinterestinprogram
69%
Leadershipqualities
75%
Personalpriorknowledgeoftheapplicant
66%
Classranking/quartile
75%
GraduateofU.S.allopathicmedicalschool
59%
PersonalStatement
60%
Auditionelective/rotationwithinyourdepartment
68%
Gradesinrequiredclerkships
59%
PassingUSMLEStep2CS/COMLEXLevel2PE
43%
Honorsinclinicalclerkships
54%
Honorsinclerkshipindesiredspecialty
37%
Gapsinmedicaleducation
49%
Gradesinclerkshipindesiredspecialty
41%
AlphaOmegaAlpha(AOA)membership
56%
Otherlifeexperience
51%
Consistencyofgrades
59%
Volunteer/extracurricularexperiences
41%
Demonstratedinvolvementandinterestinresearch
38%
GraduateofhighlyregardedU.S.medicalschool
43%
Otherpostinterviewcontact
28%
Interestinacademiccareer
19%
Visastatus*
21%
ApplicantwasflaggedwithMatchviolationbytheNRMP
21%
7%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
26%
Honorsinbasicsciences
29%
Secondinterview/visit
16%
Awayrotationinyourspecialtyatanotherinstitution
10%
USMLE/COMLEXStep3score
13%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

10

Average Rating

4.8
4.8
4.7
4.6
4.2
3.8
4.2
4.2
4.2
4.4
4.0
4.1
4.3
4.1
4.3
3.3
4.1
4.1
4.1
4.0
4.0
3.9
3.9
3.8
3.7
4.0
3.6
3.5
3.9
3.7
3.2
3.9
4.7
3.4
3.8
3.7
3.3
3.7
3.4
2

Anesthesiology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure AN-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=68

100%
90%

90%

80%

80%

70%

70%

60%

50%

40%

43%

40%

30%

30%

15%

20%

10%
0%

57%

60%

50%

20%

N=63

100%

85%

10%

0%
Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=64

N=53

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

48%

50%

50%

40%
30%

55%
45%

40%

28%

23%

30%

20%

20%

10%

10%

0%

0%
Yes, pass only

Yes, target score

No

0%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=53

N=30

N=42

USMLE Step 2 CK
N=26

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

11

Anesthesiology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure AN-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=61

100%
90%

90%

80%

80%

70%

N=41

100%

73%

70%

64%

60%

60%

50%

50%

36%

40%

40%

30%

30%

20%

20%

N=61

10%
0%

20%

N=41 7%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=45

90%

90%

80%

80%

70%

70%

60%

60%

53%

50%

50%

40%

40%

30%

24%

22%

30%

20%

20%

10%

10%

0%

Yes, pass only

Yes, target score

N=43

0%

No

42%
33%
26%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=38

90%

90%

80%

80%

70%

70%

47%

45%

50%

40%

40%

30%

30%
20%

20%

8%

10%
0%

73%

60%

60%
50%

N=30

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

13%

13%

Yes, pass only

Yes, target score

10%

12

No

Figure AN-5

Anesthesiology
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

704

700

70%

600

60%

500
400

46%

Percentage of applications
rejected

Percentage of applicants
receiving an in-depth review

40%

300

30%

200

152

142

100
0

47%

50%

20%

102

10%

7
Number of
positions in the
Match

N=71*

Number of
applications
received

N=68

Number of
interview
invitations sent

Number of
applicants
interviewed

N=67

N=68

0%

Number of
applicants
ranked

N=71*

N=66

N=68

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
30% of Anesthesiology programs consider all applicant groups
100%
N=67

90%

85%

84%

80%
70%
60%

55%

52%

50%
40%

51%

31%

30%
20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

13

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Child Neurology
(N=41)

NRMP Program Director Survey Results, 2014

14

Figure CN-1

Child Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=40)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

Average Rating

93%

3.9

Lettersofrecommendationinthespecialty 98%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

4.3

95%

USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement

4.2

80%
83%

GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships

3.9
3.7

65%
80%

4.1

Gapsinmedicaleducation

57%

Honorsinclinicalclerkships

83%

Perceivedcommitmenttospecialty

83%

Classranking/quartile
Evidenceofprofessionalismandethics

Leadershipqualities

4.2

73%

3.9

70%

3.9

78%

Consistencyofgrades
Otherlifeexperience
Volunteer/extracurricularexperiences

4.1
4.3
4.0

73%

4.3

57%

4.0

55%

3.5

60%

3.7

63%

3.6

60%

3.8

35%

3.6

28%

Awayrotationinyourspecialtyatanotherinstitution

3.4

23%
28%

Fluencyinlanguagespokenbyyourpatientpopulation

15

4.7

18%

GoldSocietymembership

NRMP Program Director Survey Results, 2014

4.0

40%

Honorsinbasicsciences

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

3.9

45%

ApplicantwasflaggedwithMatchviolationbytheNRMP

USMLE/COMLEXStep3score
100%

3.5

53%

Visastatus*
Interestinacademiccareer

3.6

57%

GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch

3.5

68%

Gradesinclerkshipindesiredspecialty

Perceivedinterestinprogram

4.2

57%

78%

PassUSMLEStep2CS/COMLEXLvl2PE

3.8

63%

Honorsinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership

4.1
4.1

Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment

4.0

3.5
3.8

53%
50%

0% 1

Figure CN-2

Child Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=40)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 95%
Interpersonalskills
93%
Interactionswithhousestaffduringinterviewandvisit
90%
Feedbackfromcurrentresidents
75%
USMLEStep1/COMLEXLevel1score
83%
Lettersofrecommendationinthespecialty
90%
USMLEStep2CK/COMLEXLevel2CEscore
75%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
83%
Perceivedcommitmenttospecialty
75%
Evidenceofprofessionalismandethics
68%
Perceivedinterestinprogram
78%
Leadershipqualities
60%
Personalpriorknowledgeoftheapplicant
57%
Classranking/quartile
50%
GraduateofU.S.allopathicmedicalschool
48%
PersonalStatement
70%
Auditionelective/rotationwithinyourdepartment
60%
Gradesinrequiredclerkships
57%
PassingUSMLEStep2CS/COMLEXLevel2PE
73%
Honorsinclinicalclerkships
57%
Honorsinclerkshipindesiredspecialty
57%
Gapsinmedicaleducation
38%
Gradesinclerkshipindesiredspecialty
55%
AlphaOmegaAlpha(AOA)membership
35%
Otherlifeexperience
45%
Consistencyofgrades
33%
Volunteer/extracurricularexperiences
43%
Demonstratedinvolvementandinterestinresearch
65%
GraduateofhighlyregardedU.S.medicalschool
43%
Otherpostinterviewcontact
45%
Interestinacademiccareer
50%
Visastatus*
20%
ApplicantwasflaggedwithMatchviolationbytheNRMP
20%
Fluencyinlanguagespokenbyyourpatientpopulation
20%
10%
GoldSocietymembership
Honorsinbasicsciences
25%
Secondinterview/visit
30%
Awayrotationinyourspecialtyatanotherinstitution
18%
45%
USMLE/COMLEXStep3score
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

16

Average Rating

4.7
4.7
4.6
4.5
3.9
4.1
4.0
4.1
4.5
4.3
4.2
4.0
4.1
4.2
4.1
3.9
4.1
4.1
4.0
4.2
4.3
4.1
4.2
3.9
3.7
4.1
4.1
3.7
4.1
4.2
3.9
3.8
4.6
3.8
3.8
4.2
3.9
4.4
4.0
2

Child Neurology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure CN-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=39

100%

90%

80%

62%

70%

60%

60%

50%

50%

38%

40%

30%

30%

20%

20%

10%
0%

76%

80%

70%

40%

N=37

100%

90%

10%

0%
Yes, pass only

Yes, target score

22%
3%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=38

N=34

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%
40%

65%

50%

37%

40%

30%

32%

30%

20%

20%

13%

10%

10%

0%

0%
Yes, pass only

Yes, target score

No

3%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=16

N=11

N=11

USMLE Step 2 CK
N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

17

Child Neurology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure CN-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=37

100%

89%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

0%

Yes

39%
29%

32%

20%

11%

N=37

10%

N=31

100%

N=31

10%
0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=26

90%

90%

80%

80%

70%

70%

60%

60%

50%
40%

50%

42%

38%

40%

42%
35%

30%

30%

19%

20%

23%

20%
10%

10%
0%

N=26

Yes, pass only

Yes, target score

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=23

90%

90%

80%

80%

70%

70%

60%

60%

50%
40%

50%

39%

39%

30%

40%

22%

30%

20%

20%

10%

10%

0%

N=20

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

18

35%

40%

25%

Yes, pass only

Yes, target score

No

Figure CN-5

Child Neurology
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

600
500

49%

50%

400

40%

300

30%

200

20%

85

100
0

58%

60%

2
Number of
positions in the
Match

N=41*

Number of
applications
received

N=39

10%

25

18

13

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

N=39

N=39

0%

Percentage of applications
rejected

N=41*

Percentage of applicants
receiving an in-depth review

N=39

N=39

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
43% of Child Neurology programs consider all applicant groups
100%
N=40

90%
80%

73%

78%
68%

70%

68%
60%

60%
50%

45%

40%
30%
20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

19

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Dermatology
(N=60)

NRMP Program Director Survey Results, 2014

20

Figure D-1

Dermatology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=59)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

92%

Lettersofrecommendationinthespecialty

93%

MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

4.3
4.5

83%

USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships

4.0
64%

4.1

85%

4.0
59%

Perceivedcommitmenttospecialty
Classranking/quartile
Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant

4.2

64%

4.2

Gapsinmedicaleducation
Honorsinclinicalclerkships

Average Rating

42%

3.6

76%

4.3

73%

4.5

59%

4.3

64%

4.6

75%

4.5

Auditionelective/rotationwithinyourdepartment

64%

4.4

Leadershipqualities

63%

4.3

Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership

4.5

69%

4.4

58%

4.0

64%

PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
Consistencyofgrades
Otherlifeexperience
Volunteer/extracurricularexperiences
GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch

4.2

61%

4.3

68%

3.8

54%

3.9

53%

4.1

49%

3.9

39%

4.2

22%

Awayrotationinyourspecialtyatanotherinstitution

3.9

29%
15%

Fluencyinlanguagespokenbyyourpatientpopulation

21

4.9

17%

GoldSocietymembership

NRMP Program Director Survey Results, 2014

4.1

24%

Honorsinbasicsciences

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

3.8

46%

ApplicantwasflaggedwithMatchviolationbytheNRMP

USMLE/COMLEXStep3score
100%

3.7

51%

Visastatus*
Interestinacademiccareer

4.1

25%

3.1

10%
50%

0% 1

4.0
3
4

Figure D-2

Dermatology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=59)
Percent Citing Factor

Average Rating

Interactionswithfacultyduringinterviewandvisit 97%
Interpersonalskills 95%
Interactionswithhousestaffduringinterviewandvisit 95%
Feedbackfromcurrentresidents
80%
USMLEStep1/COMLEXLevel1score
59%
Lettersofrecommendationinthespecialty
71%
USMLEStep2CK/COMLEXLevel2CEscore
39%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
51%
Perceivedcommitmenttospecialty
64%
Evidenceofprofessionalismandethics
68%
Perceivedinterestinprogram
63%
Leadershipqualities
54%
Personalpriorknowledgeoftheapplicant
49%
Classranking/quartile
34%
GraduateofU.S.allopathicmedicalschool
34%
PersonalStatement
46%
Auditionelective/rotationwithinyourdepartment
47%
Gradesinrequiredclerkships
37%
PassingUSMLEStep2CS/COMLEXLevel2PE
20%
Honorsinclinicalclerkships
49%
Honorsinclerkshipindesiredspecialty
34%
Gapsinmedicaleducation
20%
Gradesinclerkshipindesiredspecialty
34%
AlphaOmegaAlpha(AOA)membership
36%
Otherlifeexperience
39%
Consistencyofgrades
34%
Volunteer/extracurricularexperiences
37%
Demonstratedinvolvementandinterestinresearch
39%
GraduateofhighlyregardedU.S.medicalschool
22%
Otherpostinterviewcontact
22%
Interestinacademiccareer
39%
Visastatus*
5%
ApplicantwasflaggedwithMatchviolationbytheNRMP
14%
7%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
15%
Honorsinbasicsciences
27%
Secondinterview/visit
3%
2.0
Awayrotationinyourspecialtyatanotherinstitution
20%
USMLE/COMLEXStep3score
7%
100%
50%
0% 1 2
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

22

4.9
4.9
4.9
4.8
4.1
4.2
3.9
4.0
4.4
4.6
4.1
4.3
4.6
4.2
4.2
3.9
4.7
4.3
3.8
4.2
4.5
4.0
4.3
3.9
4.0
4.3
4.0
4.1
3.7
3.6
4.1
4.3
4.6
3.8
3.8
3.6
3.9
3.8
3

Dermatology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure D-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=57

100%

82%

90%

80%

80%

70%

70%

60%

50%

40%

43%

40%

30%

30%

18%

20%

10%
0%

57%

60%

50%

20%

N=51

100%

90%

10%

0%
Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=51

N=38

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

47%

50%

50%

40%
30%

39%

40%

29%

30%

24%

20%

20%

10%

10%

0%

0%
Yes, pass only

58%

Yes, target score

No

3%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=43

N=19

N=13

USMLE Step 2 CK
N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

23

Dermatology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure D-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=46

100%

N=24

100%
90%

90%
80%

80%

74%

70%

70%

60%

60%

50%

50%

40%

40%

26%

30%

30%

20%

20%

N=46

10%
0%

71%

17%

N=24

10%

Yes

0%

No

Yes, pass only

13%

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=17

90%

90%

80%

80%

70%

65%

80%

70%

60%

60%

50%

50%

40%

40%
30%

30%
20%

N=15

18%

18%

20%

10%

10%

0%

0%

Yes, pass only

Yes, target score

No

13%
7%
Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=15

90%

80%

80%

70%

60%

60%

50%

50%

40%

40%

30%

30%
20%

13%
7%

10%
0%

92%

80%

70%

20%

N=12

90%

Yes, pass only

Yes, target score

10%
0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

24

8%
0%
Yes, pass only

Yes, target score

No

Figure D-5

Dermatology
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

600
500

50%

412
400

40%

300

33%

30%

200

20%

100
0

58%

60%

4
Number of
positions in the
Match

N=60*

Number of
applications
received

N=59

43

36

32

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

N=59

N=59

10%
0%

Percentage of applications
rejected

N=60*

Percentage of applicants
receiving an in-depth review

N=54

N=59

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
18% of Dermatology programs consider all applicant groups
100%
N=57

90%
80%

74%

70%
60%
50%
40%

35%

30%

30%

26%

26%

U.S. IMG

Non-U.S. IMG

19%

20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

25

Fifth Pathway

Emergency Medicine
(N=104)

NRMP Program Director Survey Results, 2014

26

Figure EM-1

Emergency Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=101)
Percent Citing Factor

Average Rating

USMLEStep1/COMLEXLevel1score 97%

3.9

Lettersofrecommendationinthespecialty 99%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore

4.8

91%

3.9

94%

4.0

PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
Gapsinmedicaleducation

67%

3.0
4.0

83%

3.8

88%

3.8

72%

Honorsinclinicalclerkships

82%

4.0

Perceivedcommitmenttospecialty

81%

4.1

Classranking/quartile

83%

3.7

Evidenceofprofessionalismandethics

69%

4.4

Personalpriorknowledgeoftheapplicant

68%

4.3

Auditionelective/rotationwithinyourdepartment
Leadershipqualities
Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership

4.4

87%

3.9

80%

4.6

86%

4.6

90%

PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram

3.9

50%

3.9

65%

Consistencyofgrades
Otherlifeexperience

3.7

75%

3.8

52%

3.5

72%

Volunteer/extracurricularexperiences

63%

GraduateofhighlyregardedU.S.medicalschool

61%

Demonstratedinvolvementandinterestinresearch

3.6
3.4
3.1

43%

Visastatus*

3.9

37%

ApplicantwasflaggedwithMatchviolationbytheNRMP

29%

Interestinacademiccareer

30%

Honorsinbasicsciences

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

NRMP Program Director Survey Results, 2014

27

3.0
3.3

39%

4.3

78%

Fluencyinlanguagespokenbyyourpatientpopulation
USMLE/COMLEXStep3score
100%

3.5

22%

GoldSocietymembership
Awayrotationinyourspecialtyatanotherinstitution

4.6

3.2

22%
18%
50%

0% 1

3.4
3

Figure EM-2

Emergency Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=101)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit
89%
Interpersonalskills 93%
Interactionswithhousestaffduringinterviewandvisit
91%
Feedbackfromcurrentresidents
88%
USMLEStep1/COMLEXLevel1score
86%
Lettersofrecommendationinthespecialty
87%
USMLEStep2CK/COMLEXLevel2CEscore
80%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
75%
Perceivedcommitmenttospecialty
66%
Evidenceofprofessionalismandethics
61%
Perceivedinterestinprogram
62%
Leadershipqualities
74%
Personalpriorknowledgeoftheapplicant
63%
Classranking/quartile
63%
GraduateofU.S.allopathicmedicalschool
62%
PersonalStatement
43%
Auditionelective/rotationwithinyourdepartment
75%
Gradesinrequiredclerkships
60%
PassingUSMLEStep2CS/COMLEXLevel2PE
44%
Honorsinclinicalclerkships
57%
Honorsinclerkshipindesiredspecialty
71%
Gapsinmedicaleducation
41%
Gradesinclerkshipindesiredspecialty
71%
AlphaOmegaAlpha(AOA)membership
50%
Otherlifeexperience
58%
Consistencyofgrades
31%
Volunteer/extracurricularexperiences
51%
Demonstratedinvolvementandinterestinresearch
28%
GraduateofhighlyregardedU.S.medicalschool
41%
Otherpostinterviewcontact
36%
Interestinacademiccareer
23%
Visastatus*
23%
ApplicantwasflaggedwithMatchviolationbytheNRMP
23%
20%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
28%
16%
Honorsinbasicsciences
Secondinterview/visit
26%
Awayrotationinyourspecialtyatanotherinstitution
63%
USMLE/COMLEXStep3score
11%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

28

Average Rating

4.8
4.8
4.7
4.6
3.8
4.7
4.0
3.8
4.1
4.5
4.0
4.1
4.4
3.8
4.1
3.0
4.5
3.8
3.9
4.0
4.4
3.6
4.4
3.9
3.7
3.8
3.8
3.4
3.8
3.9
3.6
4.0
4.5
3.6
3.6
2.9
3.4
4.3
3.5
2

Emergency Medicine
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure EM-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=97

100%

90%

80%

80%

69%

70%

60%

50%

30%

50%
40%

31%

30%

20%

19%

20%

10%
0%

76%

70%

60%

40%

N=94

100%

90%

10%

0%
Yes, pass only

Yes, target score

5%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=96

N=85

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

54%

50%

50%

40%

40%

30%
20%

20%

10%

10%

0%

0%
Yes, pass only

Yes, target score

48%

30%

24%

22%

52%

No

Never

0%
often

Seldom

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=62

N=46

N=41

USMLE Step 2 CK
N=34

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

29

Emergency Medicine
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure EM-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=88

100%

N=55

100%
90%

90%

80%

80%

66%

70%

73%

70%

60%

60%

50%

50%

40%

40%

34%

30%

30%

20%

20%

N=88

10%
0%

15%

Yes

0%

No

13%

N=55

10%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=68

90%

90%

80%

80%

70%

70%

60%

60%

40%

40%

37%

40%
30%

24%

20%

20%

10%

10%

0%

48%

50%

50%

30%

N=66

Yes, pass only

Yes, target score

0%

No

29%
23%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=58

90%

90%

80%

80%

70%

50%

30%

60%
50%
40%

31%

30%
20%

20%

10%

10%
0%

78%

70%

59%

60%

40%

N=45

Yes, pass only

Yes, target score

10%
0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

30

11%

11%

Yes, pass only

Yes, target score

No

Figure EM-5

Emergency Medicine
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked
1,000

Average Percentage of Applicants Rejected and


Reviewed
100%

900

90%

830

800

80%

700

70%

600

60%

500

56%

50%

41%

400

40%

300

30%

174

200

138

20%

123

100

10%

11
0
Number of
positions in the
Match

N=104*

Number of
applications
received

N=104

Number of
interview
invitations sent

Number of
applicants
interviewed

N=101

N=103

0%

Number of
applicants
ranked

Percentage of applications
rejected

N=104*

Percentage of applicants
receiving an in-depth review

N=99

N=104

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
20% of Emergency Medicine programs consider all applicant groups
100%
N=101

90%
80%

72%

77%

70%
60%
47%

50%
40%

35%

30%

24%

22%

20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

31

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Family Medicine
(N=236)

NRMP Program Director Survey Results, 2014

32

Figure FM-1

Family Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=227)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

91%

3.8

83%
87%

PersonalStatement

87%

4.0
4.1
3.9

78%

Gradesinrequiredclerkships
Gapsinmedicaleducation

4.0

80%

USMLEStep2CK/COMLEXLevel2CEscore
GraduateofU.S.allopathicmedicalschool

4.1

68%

3.9

81%

4.3

Honorsinclinicalclerkships
Perceivedcommitmenttospecialty

52%

4.5
56%

Evidenceofprofessionalismandethics

70%

Personalpriorknowledgeoftheapplicant

69%

Auditionelective/rotationwithinyourdepartment

70%

Leadershipqualities

3.5
4.6
4.2
4.0
3.9

60%

Honorsinclerkshipindesiredspecialty

Otherlifeexperience
Volunteer/extracurricularexperiences

4.2

81%

4.2

65%

3.7

63%

3.8

65%

4.3

56%

4.8

38%
3.2

8%
20%

Honorsinbasicsciences
GoldSocietymembership

2.9
3.5

25%

Awayrotationinyourspecialtyatanotherinstitution

3.2

12%
42%

Fluencyinlanguagespokenbyyourpatientpopulation

33

3.3

10%

Interestinacademiccareer

NRMP Program Director Survey Results, 2014

3.6

40%

ApplicantwasflaggedwithMatchviolationbytheNRMP

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

3.8

54%

Demonstratedinvolvementandinterestinresearch

USMLE/COMLEXStep3score
100%

3.4

31%

GraduateofhighlyregardedU.S.medicalschool
Visastatus*

4.1

51%

AlphaOmegaAlpha(AOA)membership

Consistencyofgrades

3.9

44%

Gradesinclerkshipindesiredspecialty

Perceivedinterestinprogram

3.7

87%

Classranking/quartile

PassUSMLEStep2CS/COMLEXLvl2PE

Average Rating

3.7

24%
50%

0% 1

3.4
3

Figure FM-2

Family Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=227)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 93%
Interpersonalskills 94%
Interactionswithhousestaffduringinterviewandvisit
91%
Feedbackfromcurrentresidents
84%
USMLEStep1/COMLEXLevel1score
79%
Lettersofrecommendationinthespecialty
67%
USMLEStep2CK/COMLEXLevel2CEscore
82%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
69%
Perceivedcommitmenttospecialty
84%
Evidenceofprofessionalismandethics
69%
Perceivedinterestinprogram
67%
Leadershipqualities
59%
Personalpriorknowledgeoftheapplicant
64%
Classranking/quartile
53%
GraduateofU.S.allopathicmedicalschool
62%
PersonalStatement
68%
Auditionelective/rotationwithinyourdepartment
61%
Gradesinrequiredclerkships
50%
PassingUSMLEStep2CS/COMLEXLevel2PE
77%
Honorsinclinicalclerkships
36%
Honorsinclerkshipindesiredspecialty
30%
Gapsinmedicaleducation
61%
Gradesinclerkshipindesiredspecialty
41%
AlphaOmegaAlpha(AOA)membership
27%
Otherlifeexperience
52%
Consistencyofgrades
45%
Volunteer/extracurricularexperiences
53%
Demonstratedinvolvementandinterestinresearch
12%
GraduateofhighlyregardedU.S.medicalschool
31%
Otherpostinterviewcontact
43%
8%
Interestinacademiccareer
Visastatus*
29%
ApplicantwasflaggedwithMatchviolationbytheNRMP
25%
Fluencyinlanguagespokenbyyourpatientpopulation
34%
GoldSocietymembership
21%
Honorsinbasicsciences
13%
Secondinterview/visit
36%
Awayrotationinyourspecialtyatanotherinstitution
8%
USMLE/COMLEXStep3score
17%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

34

Average Rating

4.8
4.8
4.8
4.8
3.9
3.8
4.0
4.0
4.5
4.6
4.2
4.1
4.3
3.7
4.0
3.8
4.4
3.9
4.2
3.8
4.0
4.2
4.0
3.7
3.8
3.8
4.0
3.1
3.7
4.1
3.5
4.4
4.9
3.9
3.8
3.4
3.8
3.7
3.7
2

Family Medicine
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure FM-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=219

100%

90%

80%

80%

70%
60%

70%

57%

60%

60%

50%

42%

50%

40%

40%

30%

30%

20%

20%

10%
0%

N=205

100%

90%

10%

0%
Yes, pass only

Yes, target score

35%

5%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=213

N=194

100%

100%

90%

90%

80%

80%

70%

70%

60%
50%

60%

50%

50%

41%

40%

40%

30%

30%

20%

20%

8%

10%
0%

68%

10%
0%

Yes, pass only

Yes, target score

19%

13%

No

Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=71

N=65

N=63

USMLE Step 2 CK
N=59

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

35

Family Medicine
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure FM-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=208

100%

89%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

0%

20%

11%

N=208

10%

N=126

100%

Yes

80%

13%

N=126 6%

10%
0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=200

90%

90%

80%

80%

70%
60%

70%

61%

60%

56%

50%

50%
40%

40%

36%

30%

30%

20%

20%

10%
0%

N=193

4%
Yes, pass only

Yes, target score

32%
12%

10%
0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=191

90%
80%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

16%
9%

10%
Yes, pass only

77%

80%

75%

70%

0%

N=117

90%

Yes, target score

20%

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

16%
7%

10%

36

Yes, pass only

Yes, target score

No

Figure FM-5

Family Medicine
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked
1,149

1,000

Average Percentage of Applicants Rejected and


Reviewed
100%

900

90%

800

80%

700

70%

600

60%

500

50%

400

40%

300

30%

200

80

64

Number of
applicants
interviewed

Number of
applicants
ranked

10%

7
Number of
positions in the
Match

N=236*

Number of
applications
received

N=228

Number of
interview
invitations sent

29%

20%

106

100

68%

N=223

N=225

0%

Percentage of applications
rejected

N=236*

Percentage of applicants
receiving an in-depth review

N=215

N=228

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
36% of Family Medicine programs consider all applicant groups
100%
95%

N=224

90%
79%

80%

77%

70%

63%

60%

53%
47%

50%
40%
30%
20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

37

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Internal Medicine
(N=197)

NRMP Program Director Survey Results, 2014

38

Figure IM-1

Internal Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=194)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score
Lettersofrecommendationinthespecialty

Average Rating

92%

4.1
73%

3.8

MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

90%

4.3

USMLEStep2CK/COMLEXLevel2CEscore

89%

4.2

PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
Gapsinmedicaleducation
Honorsinclinicalclerkships

66%
79%

4.0

70%

4.1

73%

4.1

65%

Perceivedcommitmenttospecialty
Classranking/quartile

3.3

4.0

51%

3.7

74%

4.0

Evidenceofprofessionalismandethics

64%

Personalpriorknowledgeoftheapplicant

64%

4.4
3.8

Auditionelective/rotationwithinyourdepartment

54%

Leadershipqualities

53%

3.6
3.8

Honorsinclerkshipindesiredspecialty

57%

4.1

Gradesinclerkshipindesiredspecialty

59%

4.2

AlphaOmegaAlpha(AOA)membership

58%

PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
Consistencyofgrades
Otherlifeexperience

4.3

75%
3.7

47%

4.0

55%
3.4

46%

Volunteer/extracurricularexperiences
GraduateofhighlyregardedU.S.medicalschool

3.9

3.8

45%

Demonstratedinvolvementandinterestinresearch

3.7

40%

ApplicantwasflaggedwithMatchviolationbytheNRMP

4.9

44%

Interestinacademiccareer

29%

Awayrotationinyourspecialtyatanotherinstitution

9%
31%

Fluencyinlanguagespokenbyyourpatientpopulation

39

3.2

24%

GoldSocietymembership

NRMP Program Director Survey Results, 2014

3.5

21%

Honorsinbasicsciences

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

3.5

28%

Visastatus*

USMLE/COMLEXStep3score
100%

3.5

38%

4.0
3.1
3.7

21%
50%

0% 1

3.5
3

Figure IM-2

Internal Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=194)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit
92%
Interpersonalskills 95%
Interactionswithhousestaffduringinterviewandvisit
82%
Feedbackfromcurrentresidents
73%
USMLEStep1/COMLEXLevel1score
83%
Lettersofrecommendationinthespecialty
65%
USMLEStep2CK/COMLEXLevel2CEscore
86%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
79%
Perceivedcommitmenttospecialty
55%
Evidenceofprofessionalismandethics
64%
Perceivedinterestinprogram
55%
Leadershipqualities
55%
Personalpriorknowledgeoftheapplicant
59%
Classranking/quartile
71%
GraduateofU.S.allopathicmedicalschool
69%
PersonalStatement
52%
Auditionelective/rotationwithinyourdepartment
47%
Gradesinrequiredclerkships
55%
PassingUSMLEStep2CS/COMLEXLevel2PE
71%
Honorsinclinicalclerkships
51%
Honorsinclerkshipindesiredspecialty
52%
Gapsinmedicaleducation
54%
Gradesinclerkshipindesiredspecialty
52%
AlphaOmegaAlpha(AOA)membership
51%
Otherlifeexperience
36%
Consistencyofgrades
46%
Volunteer/extracurricularexperiences
29%
Demonstratedinvolvementandinterestinresearch
27%
GraduateofhighlyregardedU.S.medicalschool
40%
Otherpostinterviewcontact
21%
Interestinacademiccareer
21%
Visastatus*
36%
ApplicantwasflaggedwithMatchviolationbytheNRMP
36%
28%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
25%
Honorsinbasicsciences
17%
Secondinterview/visit
13%
Awayrotationinyourspecialtyatanotherinstitution
7%
USMLE/COMLEXStep3score
24%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

40

Average Rating

4.7
4.7
4.6
4.4
4.1
3.7
4.2
4.2
4.0
4.6
3.9
3.9
4.1
4.1
4.1
3.3
3.8
4.1
4.2
4.1
4.2
4.1
4.3
4.1
3.5
3.9
3.6
3.4
3.9
3.6
3.6
3.7
4.8
4.0
4.1
3.5
3.3
3.1
3.4
2

Internal Medicine
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure IM-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=184

100%

90%

80%

71%

70%

70%
60%

50%

50%

40%

40%

29%

30%

20%

20%

10%

10%

0%

77%

80%

60%

30%

N=173

100%

90%

1%
Yes, pass only

Yes, target score

16%
6%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=178

N=167

100%

100%

90%

90%

80%

80%

70%

65%

70%

60%

60%

50%

50%

40%
30%

40%
20%

11%

10%

10%
0%

Yes, pass only

33%

30%

25%

20%
0%

65%

Yes, target score

No

2%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=112

N=100

N=81

USMLE Step 2 CK
N=72

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

41

Internal Medicine
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure IM-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=172

100%

86%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

0%

20%

14%

N=172

10%

N=119

100%

76%

13%

N=119 12%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=132

90%

90%

80%

80%

70%

70%

60%

60%

55%

40%

40%

28%

30%

17%

20%

27%

23%

20%
10%

10%
0%

50%

50%

50%

30%

N=130

Yes, pass only

Yes, target score

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=131

90%

90%

80%

80%

70%

70%

60%

57%

74%

60%

50%

50%
40%

40%

27%

30%
20%

30%
20%

15%

14%

12%

Yes, pass only

Yes, target score

10%

10%
0%

N=94

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

42

No

Figure IM-5

Internal Medicine
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked
2,864

1,000

Average Percentage of Applicants Rejected and


Reviewed
100%

900

90%

800

80%

700

70%

600

60%

500

50%

61%

400

40%

309
300

178

200

20%

100

10%

18
0
Number of
positions in the
Match

N=197*

30%

30%

251

Number of
applications
received

N=190

Number of
interview
invitations sent

Number of
applicants
interviewed

N=187

N=189

0%

Number of
applicants
ranked

Percentage of applications
rejected

N=197*

Percentage of applicants
receiving an in-depth review

N=178

N=190

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
39% of Internal Medicine programs consider all applicant groups
97%
N=190

90%

85%

82%

80%

76%

74%

70%

63%

60%
50%

44%

40%
30%
20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

43

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Internal Medicine/Pediatrics
(N=35)

NRMP Program Director Survey Results, 2014

44

Figure IMP-1

Internal Medicine/Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=34)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

94%

4.1

Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships

4.1

74%

3.9

85%

3.6

71%

4.2

74%

4.2

82%
68%

Honorsinclinicalclerkships

68%

Perceivedcommitmenttospecialty
Classranking/quartile

4.0

65%

Gapsinmedicaleducation

4.2
3.9
4.3

59%

4.2

74%

Evidenceofprofessionalismandethics

56%

Personalpriorknowledgeoftheapplicant

56%

Auditionelective/rotationwithinyourdepartment
Leadershipqualities
Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
PassUSMLEStep2CS/COMLEXLvl2PE
Consistencyofgrades

4.4

65%

4.6

68%
4.0

71%

3.8

59%

3.3

47%

3.5

62%

3.9

47%
2.9

24%

3.9

29%

ApplicantwasflaggedwithMatchviolationbytheNRMP

4.8

24%

Interestinacademiccareer

3.0

18%

Honorsinbasicsciences

3.4

24%

3.8

68%

Awayrotationinyourspecialtyatanotherinstitution

3.0

9%
15%

Fluencyinlanguagespokenbyyourpatientpopulation

45

4.1

41%

Visastatus*

NRMP Program Director Survey Results, 2014

4.2

53%

Demonstratedinvolvementandinterestinresearch

USMLE/COMLEXStep3score
100%

3.2
3.7

GraduateofhighlyregardedU.S.medicalschool

GoldSocietymembership

3.7

71%

Otherlifeexperience
Volunteer/extracurricularexperiences

4.4
38%

Perceivedinterestinprogram

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

Average Rating

3.2

21%
50%

0% 1

3.6
3
4

Figure IMP-2

Internal Medicine/Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=34)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 94%
Interpersonalskills
86%
Interactionswithhousestaffduringinterviewandvisit
91%
Feedbackfromcurrentresidents
86%
USMLEStep1/COMLEXLevel1score
89%
Lettersofrecommendationinthespecialty
71%
USMLEStep2CK/COMLEXLevel2CEscore
83%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
71%
Perceivedcommitmenttospecialty
77%
Evidenceofprofessionalismandethics
77%
Perceivedinterestinprogram
49%
Leadershipqualities
80%
Personalpriorknowledgeoftheapplicant
49%
Classranking/quartile
83%
GraduateofU.S.allopathicmedicalschool
54%
PersonalStatement
57%
Auditionelective/rotationwithinyourdepartment
34%
Gradesinrequiredclerkships
71%
PassingUSMLEStep2CS/COMLEXLevel2PE
60%
Honorsinclinicalclerkships
60%
Honorsinclerkshipindesiredspecialty
57%
Gapsinmedicaleducation
60%
Gradesinclerkshipindesiredspecialty
57%
AlphaOmegaAlpha(AOA)membership
71%
Otherlifeexperience
51%
Consistencyofgrades
46%
Volunteer/extracurricularexperiences
66%
Demonstratedinvolvementandinterestinresearch
31%
GraduateofhighlyregardedU.S.medicalschool
37%
Otherpostinterviewcontact
26%
Interestinacademiccareer
11%
Visastatus*
17%
ApplicantwasflaggedwithMatchviolationbytheNRMP
11%
9%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
40%
Honorsinbasicsciences
31%
Secondinterview/visit
11%
Awayrotationinyourspecialtyatanotherinstitution
9%
USMLE/COMLEXStep3score
11%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

46

Average Rating

4.7
4.7
4.7
4.6
4.1
3.6
4.2
4.1
4.3
4.2
4.3
3.9
3.6
4.1
4.3
3.4
3.7
4.0
4.4
4.2
4.3
3.8
4.2
3.7
3.4
3.8
3.8
3.3
4.2
3.3
3.8
4.3
4.3
2.3
3.9
3.3
2.8
3.7
4.5
2

Internal Medicine/Pediatrics
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure IMP-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=34

100%

90%

76%

80%

80%

70%

60%

50%

50%

40%

40%

24%

29%

30%

20%

20%

10%
0%

71%

70%

60%

30%

N=31

100%

90%

10%

0%
Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=33

N=27

100%

100%

90%

90%

80%

80%

70%

70%

58%

60%

60%

50%
40%
30%

50%
40%

30%

30%

20%

20%

12%

10%

10%

0%

0%
Yes, pass only

52%

48%

Yes, target score

No

Never

0%
often

Seldom

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=23

N=18

N=20

USMLE Step 2 CK
N=14

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

47

Internal Medicine/Pediatrics
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure IMP-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=32

100%

88%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

0%

10%

Yes

79%

16%

20%

13%

N=32

10%

N=19

100%

0%

No

N=19

5%
Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=22

90%

90%

80%

80%

70%

70%

64%

60%

60%

50%

50%

40%

40%

30%

50%
32%

30%

23%

20%

14%

18%

20%
10%

10%
0%

N=22

Yes, pass only

Yes, target score

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=21

90%

90%

80%

80%

70%

70%

60%

57%

50%

40%

40%

30%

24%

20%

30%

19%

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

20%

20%
10%

10%
Yes, pass only

73%

60%

50%

0%

N=15

48

7%
Yes, pass only

Yes, target score

No

Figure IMP-5

Internal Medicine/Pediatrics
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

500

42%

400

40%

300

245

30%

200

20%

100
0

48%

50%

69

53

49

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

10%

5
Number of
positions in the
Match

N=35*

Number of
applications
received

N=34

N=35

N=35

0%

Percentage of applications
rejected

N=35*

Percentage of applicants
receiving an in-depth review

N=34

N=34

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
15% of Internal Medicine/Pediatrics programs consider all applicant groups
100%
N=34

90%
80%
70%

62%

60%
47%

50%
40%

35%

35%
26%

30%

21%

20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

49

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Neurological Surgery
(N=55)

NRMP Program Director Survey Results, 2014

50

Figure NS-1

Neurological Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=54)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

Average Rating

93%

4.4

Lettersofrecommendationinthespecialty 98%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool

4.7

81%

3.8

65%

4.0

78%

3.7

72%

4.3

Gradesinrequiredclerkships

59%

Gapsinmedicaleducation

61%

Honorsinclinicalclerkships
Perceivedcommitmenttospecialty

Leadershipqualities

4.6
59%

3.9

74%

4.5

63%

4.3
4.2

67%

4.3

74%

Honorsinclerkshipindesiredspecialty

4.3

61%

Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership

4.2

80%

Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment

3.9

69%

Classranking/quartile
Evidenceofprofessionalismandethics

4.3

4.3

44%
3.8

81%

PassUSMLEStep2CS/COMLEXLvl2PE

3.9

39%

Perceivedinterestinprogram

61%

Consistencyofgrades

61%

4.3
4.0

Otherlifeexperience

57%

3.6

Volunteer/extracurricularexperiences

56%

3.5

GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch

3.8

65%

4.1

80%

Visastatus*
ApplicantwasflaggedwithMatchviolationbytheNRMP
Interestinacademiccareer

4.1

59%

NRMP Program Director Survey Results, 2014

51

3.4

15%

3.9

56%
20%

Fluencyinlanguagespokenbyyourpatientpopulation

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

3.4

41%

GoldSocietymembership

USMLE/COMLEXStep3score
100%

4.6

22%

Honorsinbasicsciences
Awayrotationinyourspecialtyatanotherinstitution

4.0

39%

3.7

4%
50%

0% 1

4.5
4

Figure NS-2

Neurological Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=54)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 94%
Interpersonalskills
85%
Interactionswithhousestaffduringinterviewandvisit
87%
Feedbackfromcurrentresidents
85%
USMLEStep1/COMLEXLevel1score
70%
Lettersofrecommendationinthespecialty
89%
USMLEStep2CK/COMLEXLevel2CEscore
44%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
70%
Perceivedcommitmenttospecialty
78%
Evidenceofprofessionalismandethics
74%
Perceivedinterestinprogram
74%
Leadershipqualities
65%
Personalpriorknowledgeoftheapplicant
56%
Classranking/quartile
33%
GraduateofU.S.allopathicmedicalschool
46%
PersonalStatement
56%
Auditionelective/rotationwithinyourdepartment
65%
Gradesinrequiredclerkships
43%
PassingUSMLEStep2CS/COMLEXLevel2PE
26%
Honorsinclinicalclerkships
50%
Honorsinclerkshipindesiredspecialty
43%
Gapsinmedicaleducation
28%
Gradesinclerkshipindesiredspecialty
39%
AlphaOmegaAlpha(AOA)membership
48%
Otherlifeexperience
31%
Consistencyofgrades
37%
Volunteer/extracurricularexperiences
33%
Demonstratedinvolvementandinterestinresearch
63%
GraduateofhighlyregardedU.S.medicalschool
43%
Otherpostinterviewcontact
46%
Interestinacademiccareer
52%
Visastatus*
20%
ApplicantwasflaggedwithMatchviolationbytheNRMP
13%
Fluencyinlanguagespokenbyyourpatientpopulation
13%
GoldSocietymembership
6%
Honorsinbasicsciences
19%
Secondinterview/visit
31%
Awayrotationinyourspecialtyatanotherinstitution
37%
USMLE/COMLEXStep3score
2%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

52

Average Rating

4.8
4.8
4.9
4.7
4.4
4.5
4.2
3.5
4.5
4.6
4.4
4.4
4.6
3.6
4.3
3.8
4.6
3.8
4.1
4.0
4.0
3.9
4.0
4.0
3.9
4.0
3.9
4.1
4.0
4.2
4.2
3.5
4.6
3.7
3.3
3.4
3.9
3.9
5.0
2

Neurological Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure NS-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=52

100%

90%

79%

80%

80%

70%

70%

60%

50%

40%

42%

40%

30%

30%

19%

20%

10%
0%

58%

60%

50%

20%

N=48

100%

90%

10%

2%
Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=47

N=33

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

47%

50%
40%

50%

39%

40%

32%

30%

30%

21%

20%

20%

10%

10%

0%

0%
Yes, pass only

61%

Yes, target score

No

Never

0%
often

Seldom

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=35

N=19

N=24

USMLE Step 2 CK
N=13

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

53

Neurological Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure NS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=46

100%

N=28

100%
90%

90%

76%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

24%

20%

75%

21%

20%

N=46

10%
0%

N=28

10%

Yes

0%

No

Yes, pass only

4%

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=17

90%

90%

80%

80%

70%

65%

78%

70%

60%

60%

50%

50%

40%

40%

30%

N=18

30%

24%

20%

20%

12%

10%

10%

0%

0%

Yes, pass only

Yes, target score

No

17%
6%
Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=17

90%

82%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

18%

20%
10%

10%
0%

94%

30%

30%
20%

N=16

90%

0%
Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

54

6%
0%
Yes, pass only

Yes, target score

No

Neurological Surgery
Program's Interview Activities

Figure NS-5

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

600
500

50%

400

40%

40%

300

30%

202

200

20%

100
0

57%

60%

50

38

27

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

2
Number of
positions in the
Match

Number of
applications
received

N=55*

N=53

N=53

N=53

10%
0%

Percentage of applications
rejected

N=55*

Percentage of applicants
receiving an in-depth review

N=52

N=53

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
21% of Neurological Surgery programs consider all applicant groups

96%

N=53

90%
80%
70%
60%

53%

50%
40%

40%
26%

30%

40%

42%

U.S. IMG

Non-U.S. IMG

23%

20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

55

Fifth Pathway

Neurology
(N=60)

NRMP Program Director Survey Results, 2014

56

Figure N-1

Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=59)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

90%

Lettersofrecommendationinthespecialty

92%

MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore

4.0
4.3

85%

4.2

75%

4.0

PersonalStatement

71%

GraduateofU.S.allopathicmedicalschool

71%

Gradesinrequiredclerkships
Gapsinmedicaleducation
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
Classranking/quartile

3.7
4.2

63%

4.2

76%

4.1

61%

4.1

71%

4.2

75%

4.0

Evidenceofprofessionalismandethics

63%

Personalpriorknowledgeoftheapplicant

63%

Auditionelective/rotationwithinyourdepartment

4.3
4.0
4.0

59%

Leadershipqualities

56%

Honorsinclerkshipindesiredspecialty

58%

Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
Consistencyofgrades

GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch

4.1
4.1
4.0

56%
3.4

44%

3.4

53%

3.9

58%

3.3

49%

4.0

39%

4.7

34%
3.3

39%

Honorsinbasicsciences

3.4

22%

GoldSocietymembership

3.6

31%

Awayrotationinyourspecialtyatanotherinstitution

3.5

22%
27%

Fluencyinlanguagespokenbyyourpatientpopulation

57

3.9

49%

Interestinacademiccareer

NRMP Program Director Survey Results, 2014

4.4

64%

ApplicantwasflaggedwithMatchviolationbytheNRMP

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

4.2

56%

Visastatus*

USMLE/COMLEXStep3score
100%

3.9

61%

Otherlifeexperience
Volunteer/extracurricularexperiences

Average Rating

3.4
3.7

25%
50%

0% 1

Figure N-2

Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=59)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 97%
Interpersonalskills 98%
Interactionswithhousestaffduringinterviewandvisit 93%
Feedbackfromcurrentresidents
73%
USMLEStep1/COMLEXLevel1score
80%
Lettersofrecommendationinthespecialty
81%
USMLEStep2CK/COMLEXLevel2CEscore
68%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
73%
Perceivedcommitmenttospecialty
75%
Evidenceofprofessionalismandethics
61%
Perceivedinterestinprogram
56%
Leadershipqualities
59%
Personalpriorknowledgeoftheapplicant
61%
Classranking/quartile
68%
GraduateofU.S.allopathicmedicalschool
51%
PersonalStatement
54%
Auditionelective/rotationwithinyourdepartment
47%
Gradesinrequiredclerkships
49%
PassingUSMLEStep2CS/COMLEXLevel2PE
53%
Honorsinclinicalclerkships
49%
Honorsinclerkshipindesiredspecialty
47%
Gapsinmedicaleducation
47%
Gradesinclerkshipindesiredspecialty
46%
AlphaOmegaAlpha(AOA)membership
44%
Otherlifeexperience
41%
Consistencyofgrades
46%
Volunteer/extracurricularexperiences
37%
Demonstratedinvolvementandinterestinresearch
44%
GraduateofhighlyregardedU.S.medicalschool
44%
Otherpostinterviewcontact
37%
Interestinacademiccareer
39%
Visastatus*
22%
ApplicantwasflaggedwithMatchviolationbytheNRMP
22%
Fluencyinlanguagespokenbyyourpatientpopulation
25%
GoldSocietymembership
25%
Honorsinbasicsciences
20%
22%
Secondinterview/visit
20%
Awayrotationinyourspecialtyatanotherinstitution
19%
USMLE/COMLEXStep3score
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

58

Average Rating

4.9
4.8
4.7
4.5
3.9
4.2
3.8
4.1
4.3
4.4
4.0
4.1
4.2
4.1
4.1
3.6
4.1
4.0
4.0
4.0
4.2
4.1
4.2
4.1
3.5
4.0
3.3
3.3
4.0
4.0
3.6
3.8
4.7
3.7
3.9
3.4
4.0
3.9
4.0
2

Neurology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure N-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=58

100%

90%

80%

70%

60%

60%

60%

50%

50%

40%

40%

30%

30%

20%

20%

10%
0%

76%

80%

70%

40%

N=51

100%

90%

10%

0%
Yes, pass only

Yes, target score

22%
2%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=58

N=49

100%

100%

90%

90%

80%

80%

70%

70%

60%
40%

60%

50%

50%

50%
40%

34%

30%

30%

16%

20%

10%

0%

0%
Yes, target score

24%

20%

10%
Yes, pass only

73%

No

2%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=28

N=23

N=20

USMLE Step 2 CK
N=16

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

59

Neurology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure N-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=57

100%

N=40

100%
90%

90%

77%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

23%

20%

20%

N=57

10%
0%

68%

20%
13%

N=40

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=41

90%

90%

80%

80%

70%

70%

60%

60%

51%

50%

50%

40%

40%

30%

27%

22%

30%

20%

20%

10%

10%

0%

Yes, pass only

Yes, target score

N=40

0%

No

40%

38%

Yes, target score

No

23%

Yes, pass only

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=36

90%

90%

80%

80%

70%

70%

47%

50%

50%
40%

40%

28%

30%

25%

20%

20%

10%

10%

0%

68%

60%

60%

30%

N=28

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

60

25%
7%
Yes, pass only

Yes, target score

No

Neurology
Program's Interview Activities

Figure N-5

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

500
400

50%

Percentage of applications
rejected

Percentage of applicants
receiving an in-depth review

40%

300

30%

200

20%

100
0

48%

50%

443

73

59

51

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

10%

5
Number of
positions in the
Match

Number of
applications
received

N=60*

N=60

N=59

N=59

0%

N=60*

N=59

N=60

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
53% of Neurology programs consider all applicant groups

97%

N=59

90%

81%

80%

80%

71%

70%

85%

71%

60%

53%

50%
40%
30%
20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

61

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Obstetrics and Gynecology


(N=123)

NRMP Program Director Survey Results, 2014

62

Figure OG-1

Obstetrics and Gynecology


Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=117)
Percent Citing Factor

Average Rating

USMLEStep1/COMLEXLevel1score 97%
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships

4.2

92%

4.1

76%

3.9

84%

4.1

81%

3.5

68%

4.2

75%

4.1

Gapsinmedicaleducation

72%

4.2

Honorsinclinicalclerkships

72%

4.2

Perceivedcommitmenttospecialty
Classranking/quartile
Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment

58%
72%

4.0

64%

4.1
3.9

62%
65%

Honorsinclerkshipindesiredspecialty

67%

Gradesinclerkshipindesiredspecialty

62%

AlphaOmegaAlpha(AOA)membership

62%

Perceivedinterestinprogram

4.4

69%

Leadershipqualities

PassUSMLEStep2CS/COMLEXLvl2PE

4.0
4.4
4.4
3.7
4.0

57%

4.0

50%

Consistencyofgrades

57%

Otherlifeexperience

57%

Volunteer/extracurricularexperiences

4.2

4.0
3.6
3.7

51%

GraduateofhighlyregardedU.S.medicalschool

3.6

38%

Demonstratedinvolvementandinterestinresearch

3.6

43%

Visastatus*

33%

ApplicantwasflaggedwithMatchviolationbytheNRMP

33%

4.2
4.8

Interestinacademiccareer

22%

Honorsinbasicsciences

21%

GoldSocietymembership

NRMP Program Director Survey Results, 2014

63

3.6
3.7

13%
21%

Fluencyinlanguagespokenbyyourpatientpopulation

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

3.2

35%

Awayrotationinyourspecialtyatanotherinstitution
USMLE/COMLEXStep3score
100%

3.5

3.5

14%
50%

0% 1

3.7
3
4

Figure OG-2

Obstetrics and Gynecology


Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=117)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 96%
Interpersonalskills
91%
Interactionswithhousestaffduringinterviewandvisit
91%
Feedbackfromcurrentresidents
86%
USMLEStep1/COMLEXLevel1score
79%
Lettersofrecommendationinthespecialty
72%
USMLEStep2CK/COMLEXLevel2CEscore
74%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
58%
Perceivedcommitmenttospecialty
67%
Evidenceofprofessionalismandethics
61%
Perceivedinterestinprogram
57%
Leadershipqualities
60%
Personalpriorknowledgeoftheapplicant
60%
Classranking/quartile
53%
GraduateofU.S.allopathicmedicalschool
54%
PersonalStatement
49%
Auditionelective/rotationwithinyourdepartment
53%
Gradesinrequiredclerkships
46%
PassingUSMLEStep2CS/COMLEXLevel2PE
45%
Honorsinclinicalclerkships
48%
Honorsinclerkshipindesiredspecialty
54%
Gapsinmedicaleducation
42%
Gradesinclerkshipindesiredspecialty
46%
AlphaOmegaAlpha(AOA)membership
47%
Otherlifeexperience
42%
Consistencyofgrades
36%
Volunteer/extracurricularexperiences
34%
Demonstratedinvolvementandinterestinresearch
28%
GraduateofhighlyregardedU.S.medicalschool
29%
Otherpostinterviewcontact
35%
Interestinacademiccareer
20%
Visastatus*
16%
ApplicantwasflaggedwithMatchviolationbytheNRMP
17%
Fluencyinlanguagespokenbyyourpatientpopulation
15%
GoldSocietymembership
25%
Honorsinbasicsciences
12%
Secondinterview/visit
22%
Awayrotationinyourspecialtyatanotherinstitution
10%
USMLE/COMLEXStep3score
11%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

64

Average Rating

4.8
4.8
4.8
4.7
4.1
3.9
4.0
3.7
4.2
4.5
4.2
4.2
4.1
3.9
4.1
3.4
4.2
4.0
4.2
4.1
4.1
4.2
4.0
4.0
3.7
4.0
3.6
3.7
4.1
4.0
3.7
3.9
4.7
3.8
3.9
3.1
3.5
3.6
4.2
2

Obstetrics and Gynecology


Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure OG-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=114

100%

80%

90%

75%

80%

70%

60%

50%

50%

40%

40%

25%

30%

20%

19%

20%

10%
0%

75%

70%

60%

30%

N=104

100%

90%

Yes, pass only

Yes, target score

6%

10%

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=112

N=97

100%

100%

90%

90%

80%

80%

70%

70%

60%

54%

60%

50%

50%

40%
30%

40%

27%

30%

19%

20%

20%

6%

10%

10%
0%

53%
41%

0%
Yes, pass only

Yes, target score

No

Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=71

N=46

N=50

USMLE Step 2 CK
N=34

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

65

Obstetrics and Gynecology


Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure OG-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=109

100%

N=60

100%
90%

90%

79%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

21%

20%

0%

23%

20%

N=109

10%

72%

N=60 5%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=72

90%

90%

80%

80%

70%

70%
60%

60%

50%

50%

50%

29%
21%

20%

30%

35%
25%

20%
10%

10%
0%

41%

40%

40%
30%

N=69

Yes, pass only

Yes, target score

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=63

90%

90%

80%

80%

70%

70%

60%

60%

50%

44%

44%

40%

30%

30%

10%
0%

20%

11%
Yes, pass only

Yes, target score

20%

10%
0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

76%

50%

40%
20%

N=45

66

4%
Yes, pass only

Yes, target score

No

Obstetrics and Gynecology


Program's Interview Activities

Figure OG-5

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

52%

500

50%

425
400
300

30%

200

20%

89

100
0

44%

40%

72

63

Number of
applicants
interviewed

Number of
applicants
ranked

10%

5
Number of
positions in the
Match

N=123*

Number of
applications
received

N=122

Number of
interview
invitations sent

N=119

N=122

0%

Percentage of applications
rejected

N=123*

Percentage of applicants
receiving an in-depth review

N=117

N=122

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
15% of Obstetrics and Gynecology programs consider all applicant groups

97%

N=116

90%
80%

75%

70%
60%

54%
48%

50%
40%

34%

30%

30%
18%

20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

67

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Orthopaedic Surgery
(N=87)

NRMP Program Director Survey Results, 2014

68

Figure OS-1

Orthopaedic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=85)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

95%

Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

4.4

92%

4.2

79%

USMLEStep2CK/COMLEXLevel2CEscore

82%

GraduateofU.S.allopathicmedicalschool

81%

Gradesinrequiredclerkships

4.0

64%

PersonalStatement

Honorsinclinicalclerkships

4.5

74%

4.2
52%

Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant

4.3
53%

Honorsinclerkshipindesiredspecialty

4.2

75%

4.5

67%

4.4
4.6

64%

4.1

74%

4.5

69%

Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership

4.1

72%

Auditionelective/rotationwithinyourdepartment
Leadershipqualities

3.8

87%

Perceivedcommitmenttospecialty
Classranking/quartile

4.0
3.3

Gapsinmedicaleducation

4.4

58%

3.9

84%

PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
Otherlifeexperience

64%

4.2
3.6
3.6

59%

GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch

3.9

55%
66%

Volunteer/extracurricularexperiences

3.9

46%

3.7

69%

Visastatus*

19%

ApplicantwasflaggedwithMatchviolationbytheNRMP

20%

Interestinacademiccareer

3.8
3.8

12%

Awayrotationinyourspecialtyatanotherinstitution

32%

Fluencyinlanguagespokenbyyourpatientpopulation

9%

69

4.8

40%

GoldSocietymembership

NRMP Program Director Survey Results, 2014

4.0

25%

Honorsinbasicsciences

USMLE/COMLEXStep3score
100%

3.6

19%

Consistencyofgrades

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

Average Rating

3.4
3.7
3.9

0%
50%

0% 1

Figure OS-2

Orthopaedic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=85)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit
89%
Interpersonalskills
88%
Interactionswithhousestaffduringinterviewandvisit
86%
Feedbackfromcurrentresidents
82%
USMLEStep1/COMLEXLevel1score
70%
Lettersofrecommendationinthespecialty
73%
USMLEStep2CK/COMLEXLevel2CEscore
48%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
57%
Perceivedcommitmenttospecialty
46%
Evidenceofprofessionalismandethics
64%
Perceivedinterestinprogram
57%
Leadershipqualities
57%
Personalpriorknowledgeoftheapplicant
54%
Classranking/quartile
50%
GraduateofU.S.allopathicmedicalschool
61%
PersonalStatement
46%
Auditionelective/rotationwithinyourdepartment
62%
Gradesinrequiredclerkships
48%
PassingUSMLEStep2CS/COMLEXLevel2PE
11%
Honorsinclinicalclerkships
52%
Honorsinclerkshipindesiredspecialty
48%
Gapsinmedicaleducation
33%
Gradesinclerkshipindesiredspecialty
37%
AlphaOmegaAlpha(AOA)membership
55%
Otherlifeexperience
39%
Consistencyofgrades
38%
Volunteer/extracurricularexperiences
38%
Demonstratedinvolvementandinterestinresearch
48%
GraduateofhighlyregardedU.S.medicalschool
30%
Otherpostinterviewcontact
15%
Interestinacademiccareer
23%
Visastatus*
10%
ApplicantwasflaggedwithMatchviolationbytheNRMP
12%
2%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
11%
Honorsinbasicsciences
25%
Secondinterview/visit
12%
Awayrotationinyourspecialtyatanotherinstitution
21%
USMLE/COMLEXStep3score
1%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

70

Average Rating

4.6
4.6
4.6
4.6
4.2
4.3
4.0
3.9
4.1
4.5
4.0
4.1
4.5
4.0
4.4
3.5
4.7
4.0
4.3
4.1
4.1
4.0
4.2
3.9
3.7
4.0
3.7
3.9
4.0
3.9
3.9
4.0
4.7
3.0
3.8
3.6
3.7
3.5
4.0
2

Orthopaedic Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure OS-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?
N=84

100%

Would your program consider applicants who fail the


exam on the first attempt?

93%

90%

80%

80%

70%

70%

60%

50%

40%

37%

40%

30%

30%

20%

0%

61%

60%

50%

10%

N=71

100%

90%

20%

7%

10%

0%
Yes, pass only

Yes, target score

3%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=75

N=55

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

52%

50%

50%

40%
30%
20%

65%

40%

28%
20%

20%

10%

10%

0%

0%
Yes, pass only

33%

30%

Yes, target score

No

2%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=65

N=30

N=27

USMLE Step 2 CK
N=15

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

71

Orthopaedic Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure OS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=65

100%

N=41

100%
90%

90%

80%

80%

66%

70%
60%

60%

50%

50%

40%

40%

34%

30%

30%

20%

20%

N=65

10%
0%

73%

70%

22%

N=41 5%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=27

90%

90%

80%

80%

74%

70%

70%

60%

60%

50%

50%

40%

40%

19%

20%

0%

84%

30%

30%

10%

N=25

20%

7%

10%

Yes, pass only

Yes, target score

0%

No

8%

8%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=26

88%

90%
80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

0%

92%

20%

20%
10%

N=26

90%

8%
Yes, pass only

10%

4%
Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

72

4%

4%

Yes, pass only

Yes, target score

No

Figure OS-5

Orthopaedic Surgery
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

549

60%

500

50%

400

40%

300

30%

200

20%

100
0

49%

46%

72

59

51

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

10%

5
Number of
positions in the
Match

N=87*

Number of
applications
received

N=84

N=83

N=83

0%

Percentage of applications
rejected

N=87*

Percentage of applicants
receiving an in-depth review

N=81

N=84

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
13% of Orthopaedic Surgery programs consider all applicant groups
99%
N=83

90%
80%
70%
60%

51%

50%
40%

27%

30%

23%

20%

20%

16%

14%

10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

73

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Otolaryngology
(N=46)

NRMP Program Director Survey Results, 2014

74

Figure O-1

Otolaryngology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=46)
Percent Citing Factor

Average Rating

USMLEStep1/COMLEXLevel1score 98%

4.3

Lettersofrecommendationinthespecialty 100%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

4.6
74%

USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement

59%

Perceivedcommitmenttospecialty

4.2

61%

3.6

85%

4.4
67%

4.3

59%

Evidenceofprofessionalismandethics

4.0

65%

4.4

70%

Auditionelective/rotationwithinyourdepartment

4.4
4.3

63%

Leadershipqualities

76%

Honorsinclerkshipindesiredspecialty

76%

Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership

4.4

74%

Classranking/quartile
Personalpriorknowledgeoftheapplicant

3.7

67%

Gapsinmedicaleducation
Honorsinclinicalclerkships

4.0

74%

GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships

3.5

4.4
4.6
4.5

61%

4.0

83%

PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram

4.2

46%

Otherlifeexperience

3.7

59%

3.8

72%

GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch

4.3

54%

Consistencyofgrades
Volunteer/extracurricularexperiences

4.1

20%

3.9

48%

4.3

80%

Visastatus*

4.0

17%
24%

ApplicantwasflaggedwithMatchviolationbytheNRMP

4.8
4.2

Interestinacademiccareer

35%

Honorsinbasicsciences

33%
17%

3.7

39%
13%

3.8

GoldSocietymembership
Awayrotationinyourspecialtyatanotherinstitution
Fluencyinlanguagespokenbyyourpatientpopulation
USMLE/COMLEXStep3score
100%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

75

3.9
2.8

4%
50%

0% 1

4.0
3
4

Figure O-2

Otolaryngology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=46)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 96%
Interpersonalskills 96%
Interactionswithhousestaffduringinterviewandvisit 96%
Feedbackfromcurrentresidents 96%
USMLEStep1/COMLEXLevel1score
71%
Lettersofrecommendationinthespecialty
80%
USMLEStep2CK/COMLEXLevel2CEscore
31%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
38%
Perceivedcommitmenttospecialty
60%
Evidenceofprofessionalismandethics
64%
Perceivedinterestinprogram
53%
Leadershipqualities
73%
Personalpriorknowledgeoftheapplicant
56%
Classranking/quartile
40%
GraduateofU.S.allopathicmedicalschool
44%
PersonalStatement
42%
Auditionelective/rotationwithinyourdepartment
53%
Gradesinrequiredclerkships
40%
PassingUSMLEStep2CS/COMLEXLevel2PE
4%
Honorsinclinicalclerkships
53%
Honorsinclerkshipindesiredspecialty
51%
Gapsinmedicaleducation
33%
Gradesinclerkshipindesiredspecialty
44%
AlphaOmegaAlpha(AOA)membership
49%
Otherlifeexperience
40%
Consistencyofgrades
22%
Volunteer/extracurricularexperiences
42%
Demonstratedinvolvementandinterestinresearch
64%
GraduateofhighlyregardedU.S.medicalschool
20%
Otherpostinterviewcontact
20%
Interestinacademiccareer
33%
Visastatus*
7%
ApplicantwasflaggedwithMatchviolationbytheNRMP
18%
7%
Fluencyinlanguagespokenbyyourpatientpopulation
16%
GoldSocietymembership
Honorsinbasicsciences
20%
Secondinterview/visit
2%
Awayrotationinyourspecialtyatanotherinstitution
20%
USMLE/COMLEXStep3score
2%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

76

Average Rating

4.9
4.8
4.8
4.7
3.7
4.3
3.7
3.7
4.5
4.2
4.3
4.3
4.7
3.9
4.5
3.6
4.3
4.1
4.0
4.2
4.2
3.4
4.1
3.7
3.8
3.6
4.1
4.2
4.1
4.3
4.2
4.0
4.8
2.5
3.4
3.0
5.0
3.9
3.0
2

Otolaryngology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure O-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=46

100%

80%

80%

90%
80%

70%

70%

60%

60%

50%

45%

40%

30%

30%

20%

20%

10%
0%

55%

50%

40%

20%

N=40

100%

90%

10%

0%
Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=42

N=27

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

38%

40%
30%

67%

40%

33%

29%

20%

20%

10%

10%

0%

0%
Yes, pass only

33%

30%

Yes, target score

No

0%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=32

N=14

N=15

USMLE Step 2 CK
N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

77

Otolaryngology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure O-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=39

100%

N=28

100%

90%

90%

80%

80%

70%

70%

62%

60%

75%

60%

50%

50%

38%

40%

40%

30%

30%

20%

20%

N=39

10%
0%

14%

N=28 11%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=19

80%

74%

70%

60%

60%

50%

50%

40%

40%
30%

30%

16%

20%

11%

10%
0%

79%

80%

70%

20%

N=19

90%

90%

Yes, pass only

Yes, target score

16%

10%
0%

No

5%
Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=19

90%

79%

80%

70%

60%

60%

50%

50%

40%

40%

30%

30%
20%

16%

10%
0%

94%

80%

70%

20%

N=16

90%

10%

5%
Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

78

6%
0%
Yes, pass only

Yes, target score

No

Figure O-5

Otolaryngology
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700
600

60%

500

50%

400

40%

312

31%

300

30%

200

20%

100
0

67%

70%

46

37

35

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

3
Number of
positions in the
Match

N=46*

Number of
applications
received

N=45

N=45

N=45

10%
0%

Percentage of applications
rejected

N=46*

Percentage of applicants
receiving an in-depth review

N=45

N=45

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
24% of Otolaryngology programs consider all applicant groups
98%
N=46

90%
80%
70%

70%
60%
50%

37%

40%
30%

28%

28%

Osteopathic
Physician

Canadian

28%

24%

20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

79

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Pathology
(N=84)

NRMP Program Director Survey Results, 2014

80

Figure PA-1

Pathology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=84)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

Average Rating

94%

4.3

Lettersofrecommendationinthespecialty 98%

4.5

MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

83%

4.0

USMLEStep2CK/COMLEXLevel2CEscore

86%

4.0

PersonalStatement

83%

GraduateofU.S.allopathicmedicalschool

68%

Gradesinrequiredclerkships

4.0

60%

Gapsinmedicaleducation

3.8

75%

Honorsinclinicalclerkships
Perceivedcommitmenttospecialty

3.8

4.1
57%

3.5

93%

Classranking/quartile
Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment

4.6
57%
63%

Gradesinclerkshipindesiredspecialty

Perceivedinterestinprogram
Consistencyofgrades

4.1
3.9

64%

3.9

54%

4.1

58%

4.1

68%

AlphaOmegaAlpha(AOA)membership
PassUSMLEStep2CS/COMLEXLvl2PE

4.4

57%

Leadershipqualities
Honorsinclerkshipindesiredspecialty

3.8

3.6

54%

4.0

71%

4.4

67%

4.0

58%

Otherlifeexperience

39%

3.5

Volunteer/extracurricularexperiences

40%

3.5

GraduateofhighlyregardedU.S.medicalschool

61%

Demonstratedinvolvementandinterestinresearch

60%

4.1
3.7

Visastatus*

46%

ApplicantwasflaggedwithMatchviolationbytheNRMP

45%

Interestinacademiccareer

Fluencyinlanguagespokenbyyourpatientpopulation

81

3.8
3.3

8%

Awayrotationinyourspecialtyatanotherinstitution

NRMP Program Director Survey Results, 2014

4.2

42%

GoldSocietymembership

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

4.8

35%

Honorsinbasicsciences

USMLE/COMLEXStep3score
100%

3.9

50%

42%
26%

3.6

36%

3.5
3

0% 1

4.3
2

Figure PA-2

Pathology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=84)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 95%
Interpersonalskills 93%
Interactionswithhousestaffduringinterviewandvisit
89%
Feedbackfromcurrentresidents
89%
USMLEStep1/COMLEXLevel1score
89%
Lettersofrecommendationinthespecialty
85%
USMLEStep2CK/COMLEXLevel2CEscore
79%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
65%
Perceivedcommitmenttospecialty
82%
Evidenceofprofessionalismandethics
64%
Perceivedinterestinprogram
71%
Leadershipqualities
42%
Personalpriorknowledgeoftheapplicant
54%
Classranking/quartile
52%
GraduateofU.S.allopathicmedicalschool
60%
PersonalStatement
55%
Auditionelective/rotationwithinyourdepartment
54%
Gradesinrequiredclerkships
37%
PassingUSMLEStep2CS/COMLEXLevel2PE
61%
Honorsinclinicalclerkships
35%
Honorsinclerkshipindesiredspecialty
36%
Gapsinmedicaleducation
46%
Gradesinclerkshipindesiredspecialty
40%
AlphaOmegaAlpha(AOA)membership
31%
Otherlifeexperience
25%
Consistencyofgrades
37%
Volunteer/extracurricularexperiences
21%
Demonstratedinvolvementandinterestinresearch
45%
GraduateofhighlyregardedU.S.medicalschool
40%
Otherpostinterviewcontact
40%
Interestinacademiccareer
37%
Visastatus*
31%
ApplicantwasflaggedwithMatchviolationbytheNRMP
30%
Fluencyinlanguagespokenbyyourpatientpopulation
27%
GoldSocietymembership
2%
Honorsinbasicsciences
27%
Secondinterview/visit
21%
Awayrotationinyourspecialtyatanotherinstitution
19%
USMLE/COMLEXStep3score
31%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

82

Average Rating

4.8
4.7
4.7
4.7
4.3
4.3
4.1
4.0
4.5
4.5
4.5
4.0
4.2
3.8
4.0
3.8
4.1
3.9
4.0
3.8
3.9
4.2
4.0
4.0
3.2
3.9
3.3
4.0
4.0
4.3
4.1
3.9
4.8
4.5
2.5
3.9
3.9
3.9
3.8
2

Pathology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure PA-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=82

100%

90%

80%

63%

70%

60%

60%

50%

50%

35%

40%

30%

30%

20%

20%

10%

10%

0%

79%

80%

70%

40%

N=77

100%

90%

1%
Yes, pass only

Yes, target score

14%
6%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=77

N=72

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

52%

50%
40%

82%

50%
40%

32%

30%

30%

16%

20%

20%

10%

10%

0%

0%
Yes, pass only

Yes, target score

No

13%
6%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=42

N=34

N=33

USMLE Step 2 CK
N=27

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

83

Pathology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PA-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=73

100%
90%

90%

84%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

16%

20%

0%

64%

30%

20%

N=73

10%

N=61

100%

N=61 7%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=62

90%

90%

80%

80%

70%

70%
60%

60%

50%

50%
40%

50%

39%

40%

41%

38%

30%

30%
20%

11%

10%
0%

N=56

Yes, pass only

Yes, target score

21%

20%
10%
0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=55

90%

90%

80%

80%

70%

70%

60%

60%

55%

50%

55%

50%
40%

40%

27%

30%

18%

20%

32%

30%
20%

13%

10%

10%
0%

N=47

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

84

Yes, pass only

Yes, target score

No

Pathology
Program's Interview Activities

Figure PA-5

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

500

50%

42%

400

349

40%

300

30%

200

20%

100
0

56%

55

41

32

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

4
Number of
positions in the
Match

N=84*

Number of
applications
received

N=82

N=82

N=82

10%
0%

Percentage of applications
rejected

N=84*

Percentage of applicants
receiving an in-depth review

N=80

N=82

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Group
67% of Pathology programs consider all applicant groups
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%

99%

N=81

93%

93%

91%

94%

91%

U.S. IMG

Non-U.S. IMG

68%

U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

85

Fifth Pathway

Pediatrics
(N=121)

NRMP Program Director Survey Results, 2014

86

Figure P-1

Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=120)
Percent Citing Factor

Average Rating

USMLEStep1/COMLEXLevel1score 98%
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
Gapsinmedicaleducation
Honorsinclinicalclerkships

4.0
77%

3.8

87%

4.1

81%

4.1

70%
77%

4.0

69%

Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment
Leadershipqualities
Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
PassUSMLEStep2CS/COMLEXLvl2PE

4.1

77%

4.0

63%

Perceivedcommitmenttospecialty
Classranking/quartile

3.4

56%

Otherlifeexperience
Volunteer/extracurricularexperiences

4.0
54%

3.9
4.0

63%

4.1

66%

3.9

62%

4.2

64%

3.7

39%

3.8

63%

3.6

52%

3.7

55%

3.7

44%

3.4

23%

3.9

33%

ApplicantwasflaggedwithMatchviolationbytheNRMP

4.8

30%
18%

Interestinacademiccareer
Honorsinbasicsciences

3.6
3.4

24%

GoldSocietymembership

3.7

39%

Awayrotationinyourspecialtyatanotherinstitution

3.5

16%
33%

Fluencyinlanguagespokenbyyourpatientpopulation

87

3.9

57%

Visastatus*

NRMP Program Director Survey Results, 2014

3.8

65%

Demonstratedinvolvementandinterestinresearch

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

4.4

60%

GraduateofhighlyregardedU.S.medicalschool

USMLE/COMLEXStep3score
100%

4.0

75%

Perceivedinterestinprogram
Consistencyofgrades

4.0

3.4
2.7

16%
50%

0% 1

Figure P-2

Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=120)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 98%
Interpersonalskills 95%
Interactionswithhousestaffduringinterviewandvisit
93%
Feedbackfromcurrentresidents
90%
USMLEStep1/COMLEXLevel1score
90%
Lettersofrecommendationinthespecialty
76%
USMLEStep2CK/COMLEXLevel2CEscore
88%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
82%
Perceivedcommitmenttospecialty
60%
Evidenceofprofessionalismandethics
67%
Perceivedinterestinprogram
56%
Leadershipqualities
66%
Personalpriorknowledgeoftheapplicant
62%
Classranking/quartile
77%
GraduateofU.S.allopathicmedicalschool
68%
PersonalStatement
60%
Auditionelective/rotationwithinyourdepartment
63%
Gradesinrequiredclerkships
69%
PassingUSMLEStep2CS/COMLEXLevel2PE
71%
Honorsinclinicalclerkships
57%
Honorsinclerkshipindesiredspecialty
52%
Gapsinmedicaleducation
56%
Gradesinclerkshipindesiredspecialty
56%
AlphaOmegaAlpha(AOA)membership
52%
Otherlifeexperience
46%
Consistencyofgrades
47%
Volunteer/extracurricularexperiences
57%
Demonstratedinvolvementandinterestinresearch
30%
GraduateofhighlyregardedU.S.medicalschool
36%
Otherpostinterviewcontact
27%
Interestinacademiccareer
21%
Visastatus*
23%
ApplicantwasflaggedwithMatchviolationbytheNRMP
23%
Fluencyinlanguagespokenbyyourpatientpopulation
31%
GoldSocietymembership
35%
Honorsinbasicsciences
21%
Secondinterview/visit
18%
Awayrotationinyourspecialtyatanotherinstitution
13%
USMLE/COMLEXStep3score
11%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

88

Average Rating

4.7
4.8
4.7
4.6
4.2
3.8
4.1
4.2
4.1
4.5
3.8
4.0
4.2
4.1
4.1
3.4
4.0
3.9
4.3
4.1
4.2
4.2
4.2
4.2
3.6
3.9
3.7
3.4
3.7
3.8
3.6
3.7
4.9
3.4
3.8
3.5
3.5
3.7
3.4
2

Pediatrics
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure P-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=116

100%

90%

80%

70%

56%

60%

60%

43%

50%

40%

40%

30%

30%

20%

20%

10%
0%

77%

80%

70%

50%

N=113

100%

90%

10%

1%
Yes, pass only

Yes, target score

18%
5%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=113

N=108

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%
40%

38%

50%

42%

40%

30%

30%

20%

20%

27%

20%

6%

10%

10%
0%

67%

0%
Yes, pass only

Yes, target score

No

Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=54

N=45

N=49

USMLE Step 2 CK
N=40

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

89

Pediatrics
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure P-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=111

100%
90%

N=67

100%
90%

82%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

81%

30%

18%

20%

20%

N=111

10%
0%

13%

N=67 6%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=100

90%

90%

80%

80%

70%

70%

60%

60%

52%

50%

50%

40%

40%

33%

30%

30%

20%

20%

15%

44%
29%

27%

10%

10%
0%

N=97

Yes, pass only

Yes, target score

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=91

90%

90%

80%

80%

70%
60%

79%

70%

60%

60%

50%

50%
40%

40%

30%

30%

30%
20%

20%

10%

10%
0%

N=61

Yes, pass only

Yes, target score

0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

15%
7%

10%

90

Yes, pass only

Yes, target score

No

Figure P-5

Pediatrics
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked
1,124

1,000

Average Percentage of Applicants Rejected and


Reviewed
100%

900

90%

800

80%

700

70%

600

60%

500

50%

400

40%

300

35%

30%

221

192

200

161

20%

100

10%

15
0
Number of
positions in the
Match

N=121*

58%

Number of
applications
received

N=118

Number of
interview
invitations sent

Number of
applicants
interviewed

N=116

N=116

0%

Number of
applicants
ranked

Percentage of applications
rejected

N=121*

Percentage of applicants
receiving an in-depth review

N=114

N=118

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
42% of Pediatrics programs consider all applicant groups
100%
N=118

90%

86%

80%

72%

72%

69%

70%

60%

60%
47%

50%
40%
30%
20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

91

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Physical Medicine and Rehabilitation


(N=34)

NRMP Program Director Survey Results, 2014

92

Figure PMR-1

Physical Medicine and Rehabilitation


Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=33)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

91%

Lettersofrecommendationinthespecialty

91%

MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
Gapsinmedicaleducation

4.0
4.3

88%

4.2

85%

4.0

79%

3.9

64%

Classranking/quartile
Evidenceofprofessionalismandethics

3.9

73%

4.2
55%

4.5

67%

3.8

76%

4.4
55%

4.3

Consistencyofgrades
Otherlifeexperience
Volunteer/extracurricularexperiences

4.0

45%

4.4

58%

AlphaOmegaAlpha(AOA)membership
Perceivedinterestinprogram

4.1

48%

Honorsinclerkshipindesiredspecialty

PassUSMLEStep2CS/COMLEXLvl2PE

3.9

67%

Leadershipqualities
Gradesinclerkshipindesiredspecialty

3.9

76%

Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment

3.7

76%

Honorsinclinicalclerkships
Perceivedcommitmenttospecialty

3.5

42%

4.2

73%

4.2

58%

4.2

67%
3.6

55%

3.6

67%

GraduateofhighlyregardedU.S.medicalschool

3.6

33%

Demonstratedinvolvementandinterestinresearch

3.8

42%

Visastatus*

3.6

33%

ApplicantwasflaggedwithMatchviolationbytheNRMP

4.6

39%

Interestinacademiccareer

27%

GoldSocietymembership

6%

Awayrotationinyourspecialtyatanotherinstitution

NRMP Program Director Survey Results, 2014

93

3.4
3.5
3.8

39%

Fluencyinlanguagespokenbyyourpatientpopulation

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

2.9

21%

Honorsinbasicsciences

USMLE/COMLEXStep3score
100%

Average Rating

3.9

42%

3.8

33%
50%

0% 1

Figure PMR-2

Physical Medicine and Rehabilitation


Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=33)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 94%
Interpersonalskills 94%
Interactionswithhousestaffduringinterviewandvisit
85%
Feedbackfromcurrentresidents
79%
USMLEStep1/COMLEXLevel1score
82%
Lettersofrecommendationinthespecialty
82%
USMLEStep2CK/COMLEXLevel2CEscore
76%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
76%
Perceivedcommitmenttospecialty
79%
Evidenceofprofessionalismandethics
58%
Perceivedinterestinprogram
58%
Leadershipqualities
48%
Personalpriorknowledgeoftheapplicant
52%
Classranking/quartile
52%
GraduateofU.S.allopathicmedicalschool
39%
PersonalStatement
64%
Auditionelective/rotationwithinyourdepartment
64%
Gradesinrequiredclerkships
58%
PassingUSMLEStep2CS/COMLEXLevel2PE
70%
Honorsinclinicalclerkships
36%
Honorsinclerkshipindesiredspecialty
33%
Gapsinmedicaleducation
45%
Gradesinclerkshipindesiredspecialty
45%
AlphaOmegaAlpha(AOA)membership
39%
Otherlifeexperience
52%
Consistencyofgrades
61%
Volunteer/extracurricularexperiences
36%
Demonstratedinvolvementandinterestinresearch
52%
GraduateofhighlyregardedU.S.medicalschool
24%
Otherpostinterviewcontact
30%
Interestinacademiccareer
15%
Visastatus*
18%
ApplicantwasflaggedwithMatchviolationbytheNRMP
21%
Fluencyinlanguagespokenbyyourpatientpopulation
27%
GoldSocietymembership
9%
Honorsinbasicsciences
18%
Secondinterview/visit
9%
Awayrotationinyourspecialtyatanotherinstitution
33%
USMLE/COMLEXStep3score
27%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

94

Average Rating

4.8
4.7
4.7
4.6
4.0
4.2
4.0
4.2
4.5
4.6
4.2
4.1
4.1
3.9
4.0
3.7
4.7
3.8
4.0
4.1
4.5
3.9
4.3
3.8
3.6
4.1
3.7
3.4
3.8
4.1
4.0
3.8
4.9
3.8
3.7
3.7
3.3
4.4
3.8
2

Physical Medicine and Rehabilitation


Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure PMR-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=31

100%

90%

80%

80%

70%

48%

60%

48%

50%

40%

40%

30%

30%

20%

20%

10%
0%

67%

70%

60%
50%

N=30

100%

90%

10%

3%
Yes, pass only

Yes, target score

20%
13%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=31

N=29

100%

100%

90%

90%

80%

80%

70%

70%

60%
50%

60%

45%

40%

50%
40%

32%

30%

30%

23%

20%

20%

10%

10%

0%

83%

0%
Yes, pass only

Yes, target score

No

10%

7%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=11

N=12

N=7

USMLE Step 2 CK
N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

95

Physical Medicine and Rehabilitation


Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PMR-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=30

100%

N=23

100%
90%

90%

80%

80%

70%

70%

70%

60%

60%

50%

50%

40%

65%

40%

30%

30%

30%

20%

20%

N=30

10%
0%

17%

17%

N=23

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=31

90%

90%

80%

80%

70%

70%
60%

60%
50%

48%

50%

42%

40%

40%

30%

30%

20%

20%

10%

10%
0%

N=31

Yes, pass only

Yes, target score

45%
32%
23%

10%
0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=29

90%

90%

80%

80%

70%
60%

70%

57%

60%

55%

50%

50%

40%

34%

40%
30%

30%

26%
17%

20%

20%

10%

10%
0%

N=23

Yes, pass only

Yes, target score

10%
0%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

96

Yes, pass only

Yes, target score

No

Physical Medicine and Rehabilitation


Program's Interview Activities

Figure PMR-5

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

500
400

349

45%

40%

300

30%

200

20%

86

100
0

51%

50%

68

54

Number of
applicants
interviewed

Number of
applicants
ranked

10%

5
Number of
positions in the
Match

Number of
applications
received

N=34*

Number of
interview
invitations sent

N=34

N=34

N=34

0%

Percentage of applications
rejected

N=34*

Percentage of applicants
receiving an in-depth review

N=34

N=34

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
27% of Physical Medicine and Rehabilitation programs consider all applicant groups
N=33

100%

100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%

97%
79%

79%
61%
45%

NRMP Program Director Survey Results, 2014

G
M
.S
.I

-U

.S
.I

on

w
th
Pa
Fi
fth

97

ay

n
ad
ia
an
C

O
s
P h teo
y s pat
i c hi
ia c
n

ra
d
.S
.G
U

.S
.S

en

io
r

ua
te

42%

Plastic Surgery
(N=39)

NRMP Program Director Survey Results, 2014

98

Figure PS-1

Plastic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=34)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

94%

Lettersofrecommendationinthespecialty

94%

4.3
4.8

MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

62%

USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool

3.1

65%

4.4

85%

3.6

74%

4.2

Gradesinrequiredclerkships

50%

Gapsinmedicaleducation
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty

Personalpriorknowledgeoftheapplicant

Honorsinclerkshipindesiredspecialty

4.2

74%

4.2

59%

3.6

68%

4.2

76%

4.4
4.4

65%

4.1

71%

4.5

74%

Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership

4.5

56%

4.2

79%

PassUSMLEStep2CS/COMLEXLvl2PE

3.8

53%

Consistencyofgrades

3.6

62%

Volunteer/extracurricularexperiences

3.6

65%

GraduateofhighlyregardedU.S.medicalschool

3.8

62%

4.0

82%

3.0
3.9

24%
3%

Fluencyinlanguagespokenbyyourpatientpopulation

99

3.1

21%
12%

Awayrotationinyourspecialtyatanotherinstitution

NRMP Program Director Survey Results, 2014

4.2

47%

GoldSocietymembership

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

4.7

29%

Honorsinbasicsciences

USMLE/COMLEXStep3score
100%

3.9

47%

ApplicantwasflaggedwithMatchviolationbytheNRMP
Interestinacademiccareer

4.2

44%

Otherlifeexperience

Visastatus*

4.0

26%

Perceivedinterestinprogram

Demonstratedinvolvementandinterestinresearch

3.6

76%

Auditionelective/rotationwithinyourdepartment
Leadershipqualities

3.9

35%

Classranking/quartile
Evidenceofprofessionalismandethics

Average Rating

3.0

15%
50%

0% 1

4.0
3
4

Figure PS-2

Plastic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=34)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit
88%
Interpersonalskills
91%
Interactionswithhousestaffduringinterviewandvisit
85%
Feedbackfromcurrentresidents
68%
USMLEStep1/COMLEXLevel1score
56%
Lettersofrecommendationinthespecialty
82%
USMLEStep2CK/COMLEXLevel2CEscore
32%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
32%
Perceivedcommitmenttospecialty
62%
Evidenceofprofessionalismandethics
56%
Perceivedinterestinprogram
35%
Leadershipqualities
53%
Personalpriorknowledgeoftheapplicant
53%
Classranking/quartile
26%
GraduateofU.S.allopathicmedicalschool
44%
PersonalStatement
29%
Auditionelective/rotationwithinyourdepartment
62%
Gradesinrequiredclerkships
24%
PassingUSMLEStep2CS/COMLEXLevel2PE
18%
Honorsinclinicalclerkships
44%
Honorsinclerkshipindesiredspecialty
47%
Gapsinmedicaleducation
9%
Gradesinclerkshipindesiredspecialty
26%
AlphaOmegaAlpha(AOA)membership
47%
Otherlifeexperience
38%
Consistencyofgrades
21%
Volunteer/extracurricularexperiences
29%
Demonstratedinvolvementandinterestinresearch
62%
GraduateofhighlyregardedU.S.medicalschool
24%
Otherpostinterviewcontact
9%
Interestinacademiccareer
44%
Visastatus*
21%
15%
ApplicantwasflaggedwithMatchviolationbytheNRMP
3%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
3%
Honorsinbasicsciences
15%
Secondinterview/visit
0%
Awayrotationinyourspecialtyatanotherinstitution
18%
USMLE/COMLEXStep3score
12%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

100

Average Rating

4.8
4.7
4.8
4.7
4.2
4.5
4.0
3.4
4.5
4.5
4.3
4.3
4.5
4.2
4.1
3.7
4.7
3.8
4.2
4.0
4.6
4.3
4.7
4.1
3.7
4.3
4.0
4.0
4.3
4.0
4.3
4.4
4.4
3.0
4.0
3.4
4.3
3.5
2

Plastic Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure PS-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=35

100%
90%

90%

80%

80%

70%

60%

50%

50%

40%

40%

30%

33%

30%

14%

20%

10%
0%

67%

70%

60%

20%

N=30

100%

86%

10%

0%
Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=35

N=23

100%

100%

90%

90%

80%

80%

70%

70%

57%

60%
50%

50%

40%

40%

30%

30%

23%

20%

20%

10%

0%

0%
Yes, target score

35%

20%

10%
Yes, pass only

65%

60%

No

0%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=21

N=11

N=14

USMLE Step 2 CK
N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

101

Plastic Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=34

100%

N=28

100%
90%

90%

80%

80%

71%

70%

70%

60%

60%

50%

50%

40%

50%

40%

29%

30%

30%

20%

29%
21%

20%

N=34

10%
0%

N=28

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=9

80%

80%

67%

70%

60%

50%

50%
40%

33%

30%

30%

20%

20%

33%

10%

10%
0%

67%

70%

60%

40%

N=9

90%

90%

0%
Yes, pass only

Yes, target score

No

0%

0%
Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=8

90%

90%

80%

80%

70%

63%

70%

50%

50%

38%

40%

30%

30%

20%

20%

38%

10%

10%
0%

63%

60%

60%

40%

N=8

0%
Yes, pass only

Yes, target score

No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

102

0%
Yes, pass only

Yes, target score

No

Plastic Surgery
Program's Interview Activities

Figure PS-5

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700
600

60%

500

50%

400

40%

300

29%

30%

192

200

20%

100
0

67%

70%

2
Number of
positions in the
Match

Number of
applications
received

N=39*

N=38

10%

35

30

25

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

N=37

N=37

0%

Percentage of applications
rejected

N=39*

Percentage of applicants
receiving an in-depth review

N=36

N=38

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
18% of Plastic Surgery programs consider all applicant groups

97%

N=33

90%
80%
70%
60%
50%

45%
39%

40%

27%

30%

24%

24%

U.S. IMG

Non-U.S. IMG

18%

20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

103

Fifth Pathway

Psychiatry
(N=84)

NRMP Program Director Survey Results, 2014

104

Figure PSY-1

Psychiatry
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=83)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

87%

Lettersofrecommendationinthespecialty

84%

MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

Average Rating

3.7
4.1

94%

USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool

4.2

84%
92%

4.1

84%

Gradesinrequiredclerkships
Gapsinmedicaleducation

3.9

70%

3.9

89%

4.3

Honorsinclinicalclerkships
Perceivedcommitmenttospecialty

3.7

66%

3.7

88%

4.5

Classranking/quartile

58%

Evidenceofprofessionalismandethics

71%

Personalpriorknowledgeoftheapplicant

70%

3.6
4.6
4.0

Auditionelective/rotationwithinyourdepartment

65%

4.1

Leadershipqualities

65%

4.1

Honorsinclerkshipindesiredspecialty

67%

4.1

Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership
PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram
Consistencyofgrades
Otherlifeexperience

4.2

71%
3.4

51%

4.0

82%

4.2

60%

4.0

51%

3.8

65%

Volunteer/extracurricularexperiences

57%

3.6

GraduateofhighlyregardedU.S.medicalschool

58%

3.6

Demonstratedinvolvementandinterestinresearch

45%

Visastatus*

43%

ApplicantwasflaggedwithMatchviolationbytheNRMP

3.3
3.9
4.8

54%

Interestinacademiccareer
Honorsinbasicsciences

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

NRMP Program Director Survey Results, 2014

105

3.4

40%

Awayrotationinyourspecialtyatanotherinstitution
USMLE/COMLEXStep3score
100%

2.8

22%

GoldSocietymembership
Fluencyinlanguagespokenbyyourpatientpopulation

3.4

30%

3.1

24%

4.0

51%
29%
50%

0% 1

3.4
3

Figure PSY-2

Psychiatry
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=83)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 98%
Interpersonalskills 99%
Interactionswithhousestaffduringinterviewandvisit 95%
Feedbackfromcurrentresidents
89%
USMLEStep1/COMLEXLevel1score
73%
Lettersofrecommendationinthespecialty
78%
USMLEStep2CK/COMLEXLevel2CEscore
73%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
71%
Perceivedcommitmenttospecialty
84%
Evidenceofprofessionalismandethics
77%
Perceivedinterestinprogram
62%
Leadershipqualities
61%
Personalpriorknowledgeoftheapplicant
61%
Classranking/quartile
51%
GraduateofU.S.allopathicmedicalschool
66%
PersonalStatement
74%
Auditionelective/rotationwithinyourdepartment
59%
Gradesinrequiredclerkships
48%
PassingUSMLEStep2CS/COMLEXLevel2PE
61%
Honorsinclinicalclerkships
44%
Honorsinclerkshipindesiredspecialty
48%
Gapsinmedicaleducation
66%
Gradesinclerkshipindesiredspecialty
52%
AlphaOmegaAlpha(AOA)membership
45%
Otherlifeexperience
54%
Consistencyofgrades
40%
Volunteer/extracurricularexperiences
39%
Demonstratedinvolvementandinterestinresearch
35%
GraduateofhighlyregardedU.S.medicalschool
45%
Otherpostinterviewcontact
39%
Interestinacademiccareer
32%
Visastatus*
33%
ApplicantwasflaggedwithMatchviolationbytheNRMP
34%
Fluencyinlanguagespokenbyyourpatientpopulation
48%
GoldSocietymembership
29%
Honorsinbasicsciences
17%
Secondinterview/visit
17%
Awayrotationinyourspecialtyatanotherinstitution
11%
USMLE/COMLEXStep3score
27%
0% 1
100%
50%
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

106

Average Rating

4.9
5.0
4.9
4.8
3.8
3.9
3.9
4.2
4.4
4.8
4.2
4.1
4.1
3.6
4.1
3.7
4.2
3.8
4.1
3.8
3.9
4.2
4.0
3.7
3.9
4.2
3.8
3.6
3.8
3.8
3.7
4.1
4.9
4.2
3.7
3.3
3.6
3.6
3.3
2

Psychiatry
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure PSY-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=83

100%

90%

80%
70%

80%

69%

70%

60%

56%

60%

50%

50%

40%

41%

40%

30%

30%

30%

20%

20%

10%
0%

N=71

100%

90%

10%

1%
Yes, pass only

Yes, target score

3%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=83

N=70

100%

100%

90%

90%

80%

80%

70%
60%

70%

60%

64%

60%

50%

50%

40%

40%

30%

16%

20%

20%

10%

10%

0%

0%
Yes, pass only

30%

30%

24%

Yes, target score

No

6%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=17

N=14

N=14

USMLE Step 2 CK
N=12

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

107

Psychiatry
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PSY-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=80

100%

N=63

100%
90%

90%

80%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

20%

0%

30%

20%

N=80

10%

59%

N=63 11%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=72

80%

80%
70%

67%

70%

60%

60%

50%

50%

31%

30%

58%

40%

40%

30%

24%
18%

20%

20%
10%
0%

N=71

90%

90%

3%
Yes, pass only

Yes, target score

No

10%
0%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=70

90%
80%
70%

80%

67%

70%

60%

60%

50%

50%

40%

40%

30%

23%

53%

33%

30%
20%

20%

10%

10%
0%

N=49

90%

Yes, pass only

Yes, target score

No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

14%

10%

108

Yes, pass only

Yes, target score

No

Figure PSY-5

Psychiatry
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked
1,000

Average Percentage of Applicants Rejected and


Reviewed
100%

900

858

90%

800

80%

700

70%

61%

600

60%

500

50%

400

40%

300
200

20%

100

100
0

30%

30%

79

61

Number of
applicants
interviewed

Number of
applicants
ranked

10%

7
Number of
positions in the
Match

N=84*

Number of
applications
received

N=81

Number of
interview
invitations sent

N=81

N=83

0%

Percentage of applications
rejected

N=84*

Percentage of applicants
receiving an in-depth review

N=77

N=81

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
40% of Psychiatry programs consider all applicant groups
98%

90%

86%

89%

N=83

80%

80%
67%

70%

63%

60%
46%

50%
40%
30%
20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

109

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Radiation Oncology
(N=44)

NRMP Program Director Survey Results, 2014

110

Figure RO-1

Radiation Oncology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=43)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

Average Rating

95%

4.3

Lettersofrecommendationinthespecialty 100%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

4.5

86%

4.0

USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement

51%
84%

GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships

3.8
65%

4.2

77%

3.9

Gapsinmedicaleducation
Honorsinclinicalclerkships

47%

3.8

72%

4.2

Perceivedcommitmenttospecialty

67%

Classranking/quartile

65%

Evidenceofprofessionalismandethics

63%

Personalpriorknowledgeoftheapplicant
Auditionelective/rotationwithinyourdepartment

4.1

4.5
4.0
4.6

56%

4.3
4.3

72%

Leadershipqualities

60%

4.3

Honorsinclerkshipindesiredspecialty

60%

4.3

Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership

4.1

70%
60%

Otherlifeexperience

58%

Volunteer/extracurricularexperiences

4.3
3.7
3.9

53%

GraduateofhighlyregardedU.S.medicalschool

4.0

63%

4.4

86%

Visastatus*

21%

ApplicantwasflaggedwithMatchviolationbytheNRMP

23%

Interestinacademiccareer

Fluencyinlanguagespokenbyyourpatientpopulation

111

4.0
3.9
3.7

14%
44%
12%

Awayrotationinyourspecialtyatanotherinstitution

NRMP Program Director Survey Results, 2014

4.7

28%

GoldSocietymembership

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

3.6

53%

Honorsinbasicsciences

USMLE/COMLEXStep3score
100%

4.3

21%

Consistencyofgrades

Demonstratedinvolvementandinterestinresearch

3.8

60%

PassUSMLEStep2CS/COMLEXLvl2PE
Perceivedinterestinprogram

4.3

56%

3.8
3.4

9%
50%

0% 1

4.5
4

Figure RO-2

Radiation Oncology
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=43)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit
84%
Interpersonalskills
86%
Interactionswithhousestaffduringinterviewandvisit
70%
Feedbackfromcurrentresidents
70%
USMLEStep1/COMLEXLevel1score
57%
Lettersofrecommendationinthespecialty
77%
USMLEStep2CK/COMLEXLevel2CEscore
23%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
45%
Perceivedcommitmenttospecialty
57%
Evidenceofprofessionalismandethics
39%
Perceivedinterestinprogram
61%
Leadershipqualities
39%
Personalpriorknowledgeoftheapplicant
45%
Classranking/quartile
39%
GraduateofU.S.allopathicmedicalschool
27%
PersonalStatement
45%
Auditionelective/rotationwithinyourdepartment
39%
Gradesinrequiredclerkships
41%
PassingUSMLEStep2CS/COMLEXLevel2PE
2%
Honorsinclinicalclerkships
41%
Honorsinclerkshipindesiredspecialty
23%
Gapsinmedicaleducation
11%
Gradesinclerkshipindesiredspecialty
25%
AlphaOmegaAlpha(AOA)membership
18%
Otherlifeexperience
32%
Consistencyofgrades
23%
Volunteer/extracurricularexperiences
20%
Demonstratedinvolvementandinterestinresearch
61%
GraduateofhighlyregardedU.S.medicalschool
30%
Otherpostinterviewcontact
25%
Interestinacademiccareer
41%
Visastatus*
2%
ApplicantwasflaggedwithMatchviolationbytheNRMP
5%
7%
Fluencyinlanguagespokenbyyourpatientpopulation
0%
GoldSocietymembership
Honorsinbasicsciences
14%
Secondinterview/visit
7%
Awayrotationinyourspecialtyatanotherinstitution
30%
USMLE/COMLEXStep3score
2%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

112

Average Rating

4.9
4.9
4.8
4.6
3.8
4.4
4.2
4.2
4.4
4.6
4.4
4.2
4.4
4.0
4.0
4.0
4.4
3.7
4.0
3.8
4.3
3.4
4.0
4.0
3.6
4.2
3.7
4.4
3.8
4.5
4.2
4.0
5.0
3.3
3.5
4.3
4.0
4.0
2

Radiation Oncology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure RO-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=41

100%

90%

80%

73%

80%

70%

70%

60%

60%

50%

44%

40%

27%

30%

20%

20%

10%
0%

54%

50%

40%
30%

N=39

100%

90%

10%

0%
Yes, pass only

Yes, target score

3%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=35

N=28

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%
30%

37%

43%

40%
30%

23%

20%

20%

10%

10%

0%

0%
Yes, pass only

54%

Yes, target score

No

4%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=24

N=10

N=11

USMLE Step 2 CK
N=6

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

113

Radiation Oncology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure RO-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=36

100%
90%

90%

80%

80%

70%

70%

61%

60%

N=23

100%

74%

60%

50%

50%

39%

40%

40%

30%

30%

20%

20%

N=36

10%
0%

22%

N=23

10%

Yes

0%

No

Yes, pass only

4%

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=20

80%

80%

70%

70%

60%

50%

50%

40%

40%
30%

30%

20%

20%

10%

10%
0%

70%

70%

60%

20%

N=20

90%

90%

Yes, pass only

Yes, target score

20%
10%

10%
No

0%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=20

90%
80%

70%

60%

60%

50%

50%

40%

40%
30%

30%

20%
10%
Yes, pass only

22%

20%

10%
0%

78%

80%

70%

70%

20%

N=18

90%

Yes, target score

10%
No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

114

0%
Yes, pass only

Yes, target score

No

Figure RO-5

Radiation Oncology
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

73%

700

70%

600

60%

500

50%

400

40%

300

30%

169

200
100
0

2
Number of
positions in the
Match

N=44*

Number of
applications
received

N=43

26%

20%
10%

32

25

22

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

N=44

N=44

0%

Percentage of applications
rejected

N=44*

Percentage of applicants
receiving an in-depth review

N=42

N=43

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
12% of Radiation Oncology programs consider all applicant groups
100%
N=42

90%
80%
70%
60%

55%

50%

45%

40%
30%
19%

20%

19%
12%

14%

10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

115

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Radiology-Diagnostic
(N=75)

NRMP Program Director Survey Results, 2014

116

Figure RD-1

Radiology-Diagnostic
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=74)
Percent Citing Factor

Average Rating

USMLEStep1/COMLEXLevel1score 99%
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

4.2
77%

91%

4.5

USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships
Gapsinmedicaleducation
Honorsinclinicalclerkships

66%

3.9

74%

3.3

82%

4.2

76%

4.5

72%

4.1

81%

Perceivedcommitmenttospecialty
Classranking/quartile

3.9

4.1
62%

3.9

85%

4.3

Evidenceofprofessionalismandethics

64%

Personalpriorknowledgeoftheapplicant

64%

4.2
4.1

Auditionelective/rotationwithinyourdepartment

59%

Leadershipqualities

58%

Honorsinclerkshipindesiredspecialty

3.7
4.2

47%

Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership

3.9

4.2

50%

3.9

77%

PassUSMLEStep2CS/COMLEXLvl2PE

4.4

31%

Perceivedinterestinprogram

65%

4.0

Consistencyofgrades

64%

4.1

Otherlifeexperience
Volunteer/extracurricularexperiences
GraduateofhighlyregardedU.S.medicalschool
Demonstratedinvolvementandinterestinresearch

3.6

61%

3.3

50%

3.9

57%

3.5

47%

Visastatus*

42%

ApplicantwasflaggedwithMatchviolationbytheNRMP

42%

Interestinacademiccareer

3.9
3.2

15%
14%

Fluencyinlanguagespokenbyyourpatientpopulation

117

3.8
22%

Awayrotationinyourspecialtyatanotherinstitution

NRMP Program Director Survey Results, 2014

3.3

41%

GoldSocietymembership

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

4.6

27%

Honorsinbasicsciences

USMLE/COMLEXStep3score
100%

4.1

3.0

18%
50%

0% 1

3.5
3
4

Figure RD-2

Radiology-Diagnostic
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=74)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 95%
Interpersonalskills 97%
Interactionswithhousestaffduringinterviewandvisit
85%
Feedbackfromcurrentresidents
82%
USMLEStep1/COMLEXLevel1score
85%
Lettersofrecommendationinthespecialty
65%
USMLEStep2CK/COMLEXLevel2CEscore
53%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
78%
Perceivedcommitmenttospecialty
61%
Evidenceofprofessionalismandethics
51%
Perceivedinterestinprogram
64%
Leadershipqualities
57%
Personalpriorknowledgeoftheapplicant
55%
Classranking/quartile
73%
GraduateofU.S.allopathicmedicalschool
62%
PersonalStatement
49%
Auditionelective/rotationwithinyourdepartment
50%
Gradesinrequiredclerkships
59%
PassingUSMLEStep2CS/COMLEXLevel2PE
24%
Honorsinclinicalclerkships
50%
Honorsinclerkshipindesiredspecialty
32%
Gapsinmedicaleducation
42%
Gradesinclerkshipindesiredspecialty
27%
AlphaOmegaAlpha(AOA)membership
53%
Otherlifeexperience
50%
Consistencyofgrades
45%
Volunteer/extracurricularexperiences
34%
Demonstratedinvolvementandinterestinresearch
39%
GraduateofhighlyregardedU.S.medicalschool
42%
Otherpostinterviewcontact
38%
Interestinacademiccareer
31%
Visastatus*
27%
ApplicantwasflaggedwithMatchviolationbytheNRMP
22%
8%
Fluencyinlanguagespokenbyyourpatientpopulation
GoldSocietymembership
19%
Honorsinbasicsciences
26%
Secondinterview/visit
12%
Awayrotationinyourspecialtyatanotherinstitution
8%
USMLE/COMLEXStep3score
11%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

118

Average Rating

4.7
4.7
4.7
4.6
4.1
3.9
3.8
4.3
4.1
4.4
4.2
4.1
4.2
4.4
4.3
3.3
4.3
4.3
3.9
4.2
4.3
4.3
4.3
4.0
3.7
4.2
3.5
3.7
4.1
3.7
3.6
4.0
4.9
3.3
4.1
3.7
3.8
3.2
3.9
2

Radiology-Diagnostic
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure RD-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=71

100%

90%

80%

80%

70%

70%

60%

60%

50%

45%

40%

30%

30%
20%

14%

10%
0%

52%

50%

40%

20%

N=62

100%

86%

90%

10%

0%
Yes, pass only

Yes, target score

3%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=66

N=44

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

44%
36%

40%
30%
20%

40%
30%

20%

20%

10%

10%

0%

0%
Yes, pass only

50%

48%

Yes, target score

No

2%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=53

N=26

N=33

USMLE Step 2 CK
N=15

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

119

Radiology-Diagnostic
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure RD-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=62

100%

N=39

100%

90%

90%

80%

80%

70%

69%

70%

60%

60%

60%

50%

50%

40%

40%

40%

30%

30%

20%

20%

N=62

10%
0%

23%

N=39 8%

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=29

90%

90%

80%

80%

70%

70%

48%

50%

50%
40%

40%

28%

24%

30%

20%

20%

10%

10%

0%

67%

60%

60%

30%

N=27

Yes, pass only

Yes, target score

No

0%

19%

15%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=28

90%
80%

70%

60%

60%

50%

50%

40%

40%
30%

21%

20%

20%

11%

10%
0%

76%

80%

68%

70%

30%

N=25

90%

Yes, pass only

Yes, target score

No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

16%
8%

10%

120

Yes, pass only

Yes, target score

No

Figure RD-5

Radiology-Diagnostic
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

500

50%

426

400

39%

40%

300

30%

200

20%

106

100
0

56%

84

76

Number of
applicants
interviewed

Number of
applicants
ranked

10%

7
Number of
positions in the
Match

N=75*

Number of
applications
received

N=74

Number of
interview
invitations sent

N=71

N=73

0%

Percentage of applications
rejected

N=75*

Percentage of applicants
receiving an in-depth review

N=73

N=74

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
28% of Radiology-Diagnostic programs consider all applicant groups
99%
N=74

90%
78%

80%
70%

64%

60%
50%

50%

45%

36%

40%
30%

30%
20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

121

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Surgery
(N=121)

NRMP Program Director Survey Results, 2014

122

Figure GS-1

Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=115)
Percent Citing Factor

Average Rating

USMLEStep1/COMLEXLevel1score 97%
Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore
PersonalStatement
GraduateofU.S.allopathicmedicalschool

4.4

92%

4.3

79%

3.8

87%

4.3

72%

3.5

76%

4.3

Gradesinrequiredclerkships

70%

Gapsinmedicaleducation

69%

Honorsinclinicalclerkships
Perceivedcommitmenttospecialty
Classranking/quartile
Evidenceofprofessionalismandethics
Personalpriorknowledgeoftheapplicant

Honorsinclerkshipindesiredspecialty

4.0

65%

4.0

58%

4.5

62%

4.1
4.0

53%

4.2

68%

4.4

73%
69%

AlphaOmegaAlpha(AOA)membership

70%

Perceivedinterestinprogram

4.3

70%

Gradesinclerkshipindesiredspecialty
PassUSMLEStep2CS/COMLEXLvl2PE

4.1

78%

Auditionelective/rotationwithinyourdepartment
Leadershipqualities

3.9

4.2
3.9
4.2

47%

3.9

55%

Consistencyofgrades

3.9

39%

Otherlifeexperience

52%

3.6

Volunteer/extracurricularexperiences

50%

3.6

GraduateofhighlyregardedU.S.medicalschool

3.8

Demonstratedinvolvementandinterestinresearch

47%

Visastatus*

45%

ApplicantwasflaggedwithMatchviolationbytheNRMP

3.5
3.9

29%

Awayrotationinyourspecialtyatanotherinstitution

3.5

21%
10%

Fluencyinlanguagespokenbyyourpatientpopulation

123

3.8

21%

GoldSocietymembership

NRMP Program Director Survey Results, 2014

4.8

33%

Honorsinbasicsciences

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

3.9
27%

Interestinacademiccareer

USMLE/COMLEXStep3score
100%

3.9

43%

3.3
3.9

10%
50%

0% 1

Figure GS-2

Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=115)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit
91%
Interpersonalskills
89%
Interactionswithhousestaffduringinterviewandvisit
86%
Feedbackfromcurrentresidents
76%
USMLEStep1/COMLEXLevel1score
82%
Lettersofrecommendationinthespecialty
79%
USMLEStep2CK/COMLEXLevel2CEscore
78%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
58%
Perceivedcommitmenttospecialty
69%
Evidenceofprofessionalismandethics
53%
Perceivedinterestinprogram
64%
Leadershipqualities
59%
Personalpriorknowledgeoftheapplicant
53%
Classranking/quartile
55%
GraduateofU.S.allopathicmedicalschool
62%
PersonalStatement
51%
Auditionelective/rotationwithinyourdepartment
48%
Gradesinrequiredclerkships
41%
PassingUSMLEStep2CS/COMLEXLevel2PE
38%
Honorsinclinicalclerkships
46%
Honorsinclerkshipindesiredspecialty
59%
Gapsinmedicaleducation
38%
Gradesinclerkshipindesiredspecialty
44%
AlphaOmegaAlpha(AOA)membership
48%
Otherlifeexperience
42%
Consistencyofgrades
33%
Volunteer/extracurricularexperiences
36%
Demonstratedinvolvementandinterestinresearch
34%
GraduateofhighlyregardedU.S.medicalschool
35%
Otherpostinterviewcontact
36%
Interestinacademiccareer
31%
Visastatus*
24%
ApplicantwasflaggedwithMatchviolationbytheNRMP
14%
Fluencyinlanguagespokenbyyourpatientpopulation
10%
GoldSocietymembership
18%
Honorsinbasicsciences
17%
Secondinterview/visit
23%
Awayrotationinyourspecialtyatanotherinstitution
12%
USMLE/COMLEXStep3score
8%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

124

Average Rating

4.8
4.7
4.8
4.6
4.4
4.2
4.2
3.8
4.3
4.5
4.1
4.2
4.3
4.0
4.3
3.4
4.2
4.0
4.2
4.1
4.2
4.1
4.2
4.1
3.6
3.9
3.5
3.9
4.0
4.1
3.9
4.1
4.3
3.7
3.9
3.6
4.0
3.7
3.9
2

Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure GS-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=112

100%

91%

90%

90%

80%

80%

70%

70%

60%

60%

50%

45%

40%

30%

30%

20%

0%

53%

50%

40%

10%

N=104

100%

20%

9%

10%

0%
Yes, pass only

Yes, target score

2%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=107

N=92

100%

100%

90%

90%

80%

74%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%
10%
0%

16%

10%

36%

20%
10%
0%

Yes, pass only

62%

Yes, target score

No

2%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=94

N=76

N=72

USMLE Step 2 CK
N=58

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

125

Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure GS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=102

100%

N=62

100%
90%

90%

80%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

74%

30%

20%

20%

0%

10%

Yes

16%

20%

N=102

10%

0%

No

10%

N=62

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=54

90%

90%

80%

80%

70%

70%

60%

52%
37%

40%

40%

0%

30%

30%

30%

10%

57%

60%
50%

50%

20%

N=53

20%

11%

13%

10%

Yes, pass only

Yes, target score

No

0%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=50

90%

90%

80%

80%

70%

64%

60%

50%

50%
40%

40%

26%

30%
20%

20%

10%

10%
0%

80%

70%

60%

30%

N=40

Yes, pass only

Yes, target score

10%
No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

126

10%

10%

Yes, pass only

Yes, target score

No

Figure GS-5

Surgery
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

731

700

70%

62%

600

60%

500

50%

400

40%

300
200

20%

92

100
0

33%

30%

74

55

Number of
applicants
interviewed

Number of
applicants
ranked

10%

5
Number of
positions in the
Match

N=121*

Number of
applications
received

N=118

Number of
interview
invitations sent

N=115

N=117

0%

Percentage of applications
rejected

N=121*

Percentage of applicants
receiving an in-depth review

N=115

N=118

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
19% of Surgery programs consider all applicant groups
100%
N=113

90%
80%
66%

70%
60%

50%

50%

48%
39%

37%

40%
30%

23%

20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

127

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Thoracic Surgery
(N=12)

NRMP Program Director Survey Results, 2014

128

Figure TS-1

Thoracic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=12)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

92%

Lettersofrecommendationinthespecialty

92%

Average Rating

4.1
4.7

MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

83%

4.0

USMLEStep2CK/COMLEXLevel2CEscore

83%

4.0

PersonalStatement

83%

3.6

GraduateofU.S.allopathicmedicalschool
Gradesinrequiredclerkships

33%
83%

Gapsinmedicaleducation
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty

4.1
50%

4.0

83%

4.0
50%

Classranking/quartile
Evidenceofprofessionalismandethics

4.0

33%

4.6

42%

Auditionelective/rotationwithinyourdepartment

42%

Honorsinclerkshipindesiredspecialty
Gradesinclerkshipindesiredspecialty
AlphaOmegaAlpha(AOA)membership

4.3
4.6
4.4

67%

4.0

58%

4.5
4.2

50%

4.0

58%

5.0

42%

ApplicantwasflaggedwithMatchviolationbytheNRMP

5.0

17%
3.7

50%

Honorsinbasicsciences

3.7

25%

GoldSocietymembership

0%

Awayrotationinyourspecialtyatanotherinstitution
Fluencyinlanguagespokenbyyourpatientpopulation

129

4.0

25%
17%

Visastatus*

NRMP Program Director Survey Results, 2014

3.8

42%

Volunteer/extracurricularexperiences

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

4.0

33%

Otherlifeexperience

USMLE/COMLEXStep3score
100%

3.6

42%

Consistencyofgrades

Interestinacademiccareer

3.6

58%

Perceivedinterestinprogram

Demonstratedinvolvementandinterestinresearch

3.4

50%

PassUSMLEStep2CS/COMLEXLvl2PE

GraduateofhighlyregardedU.S.medicalschool

3.5

58%

Personalpriorknowledgeoftheapplicant
Leadershipqualities

4.3

50%

17%
8%

3.5

17%

3.5
3

5.0
0% 1

Figure TS-2

Thoracic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=12)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit
92%
Interpersonalskills
92%
Interactionswithhousestaffduringinterviewandvisit
83%
Feedbackfromcurrentresidents
83%
USMLEStep1/COMLEXLevel1score
75%
Lettersofrecommendationinthespecialty
92%
USMLEStep2CK/COMLEXLevel2CEscore
67%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
58%
Perceivedcommitmenttospecialty
75%
Evidenceofprofessionalismandethics
75%
Perceivedinterestinprogram
42%
Leadershipqualities
67%
Personalpriorknowledgeoftheapplicant
50%
Classranking/quartile
8%
GraduateofU.S.allopathicmedicalschool
33%
PersonalStatement
67%
Auditionelective/rotationwithinyourdepartment
25%
Gradesinrequiredclerkships
67%
PassingUSMLEStep2CS/COMLEXLevel2PE
33%
Honorsinclinicalclerkships
67%
Honorsinclerkshipindesiredspecialty
67%
Gapsinmedicaleducation
25%
Gradesinclerkshipindesiredspecialty
67%
AlphaOmegaAlpha(AOA)membership
50%
Otherlifeexperience
33%
Consistencyofgrades
42%
Volunteer/extracurricularexperiences
17%
Demonstratedinvolvementandinterestinresearch
67%
GraduateofhighlyregardedU.S.medicalschool
58%
Otherpostinterviewcontact
58%
Interestinacademiccareer
50%
Visastatus*
17%
ApplicantwasflaggedwithMatchviolationbytheNRMP
25%
Fluencyinlanguagespokenbyyourpatientpopulation
17%
0%
GoldSocietymembership
Honorsinbasicsciences
17%
Secondinterview/visit
17%
Awayrotationinyourspecialtyatanotherinstitution
8%
USMLE/COMLEXStep3score
0%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

130

Average Rating

4.8
4.6
4.8
4.6
4.2
4.6
4.3
3.3
4.2
4.3
4.4
4.1
4.0
5.0
4.5
3.4
4.3
3.9
4.0
4.3
4.3
4.0
4.3
4.3
3.5
4.0
3.0
3.5
4.0
4.1
3.8
4.5
4.0
4.5
3.0
4.0
4.0
2

Thoracic Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure TS-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=12

100%

90%

80%

80%

70%

60%

50%

50%

33%

40%

30%

33%

30%

20%

20%

8%

10%
0%

67%

70%

58%

60%

40%

N=6

100%

90%

Yes, pass only

Yes, target score

10%
0%

No

0%
Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=12

N=5

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%

42%

80%

50%

42%

40%

40%

30%

30%

17%

20%

20%

10%

10%

0%

0%
Yes, pass only

Yes, target score

No

20%
0%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260
250
240
230

USMLE Step 1 not


reported because
of low response
rate

USMLE Step 2 CK
not reported
because of low
response rate

220
210

USMLE Step 2 CK
not reported
because of low
response rate

200
190
180
170

USMLE Step 1
N=5

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

131

Thoracic Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure TS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=11

100%

91%

90%

N=6

100%
90%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%

30%

20%

67%

33%

20%

N=11

10%
0%

9%

Yes

N=6

10%
0%

No

0%
Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=7

90%

90%

80%

80%

70%

70%

60%

60%

50%

43%

30%

29%

29%

20%

10%

10%
Yes, pass only

Yes, target score

33%

30%

20%

0%

50%

50%
40%

40%

N=6

No

0%

17%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 3*
N=4

100%

N=5

90%
80%

Not reported because


of low response rate

70%

60%

60%
50%
40%

40%

30%
20%
10%
0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

132

0%
Yes, pass only

Yes, target score

No

Figure TS-5

Thoracic Surgery
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

62%

600

60%

500

50%

400

40%

300

30%

200

20%

108
100
0

36%

1
Number of
positions in the
Match

N=12*

Number of
applications
received

N=12

10%

33

28

23

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

N=12

N=12

0%

Percentage of applications
rejected

N=12*

Percentage of applicants
receiving an in-depth review

N=12

N=12

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
17% of Thoracic Surgery programs consider all applicant groups
100%
N=12

90%
80%
70%
58%

60%

58%
50%

50%

42%

40%
30%

25%

25%

20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

133

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Transitional Year
(N=47)

NRMP Program Director Survey Results, 2014

134

Figure TY-1

Transitional Year
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=47)
Percent Citing Factor

Average Rating

USMLEStep1/COMLEXLevel1score 98%

4.2

Lettersofrecommendationinthespecialty
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
USMLEStep2CK/COMLEXLevel2CEscore

53%

3.9

85%

4.2

89%

4.1

PersonalStatement

70%

GraduateofU.S.allopathicmedicalschool

68%

Gradesinrequiredclerkships

3.9
4.4

53%

Gapsinmedicaleducation

68%

Honorsinclinicalclerkships

70%

4.4
4.4
4.3

Perceivedcommitmenttospecialty
Classranking/quartile

28%
72%

4.3

Evidenceofprofessionalismandethics

66%

Personalpriorknowledgeoftheapplicant

68%

4.7
4.3

Auditionelective/rotationwithinyourdepartment

66%

PassUSMLEStep2CS/COMLEXLvl2PE

64%

3.8
4.2
4.4

74%

4.0

53%

3.9

47%

3.8

60%

GraduateofhighlyregardedU.S.medicalschool

3.6

36%

Demonstratedinvolvementandinterestinresearch

4.3

32%

ApplicantwasflaggedwithMatchviolationbytheNRMP

4.6

40%

Interestinacademiccareer
Honorsinbasicsciences

17%
26%

GoldSocietymembership

23%

Awayrotationinyourspecialtyatanotherinstitution

6%
15%

Fluencyinlanguagespokenbyyourpatientpopulation

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

NRMP Program Director Survey Results, 2014

135

3.8

28%

Visastatus*

USMLE/COMLEXStep3score
100%

4.2

23%

AlphaOmegaAlpha(AOA)membership

Volunteer/extracurricularexperiences

4.1

28%

Gradesinclerkshipindesiredspecialty

Otherlifeexperience

4.2

45%

Honorsinclerkshipindesiredspecialty

Consistencyofgrades

3.9

40%

Leadershipqualities

Perceivedinterestinprogram

4.1

3.9
3.9
3.5
4.0
4.4

9%
50%

0% 1

3.3
3

Figure TY-2

Transitional Year
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=47)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit
89%
Interpersonalskills
89%
Interactionswithhousestaffduringinterviewandvisit
74%
Feedbackfromcurrentresidents
83%
USMLEStep1/COMLEXLevel1score
91%
Lettersofrecommendationinthespecialty
40%
USMLEStep2CK/COMLEXLevel2CEscore
79%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
72%
Perceivedcommitmenttospecialty
21%
Evidenceofprofessionalismandethics
72%
Perceivedinterestinprogram
79%
Leadershipqualities
53%
Personalpriorknowledgeoftheapplicant
57%
Classranking/quartile
66%
GraduateofU.S.allopathicmedicalschool
60%
PersonalStatement
68%
Auditionelective/rotationwithinyourdepartment
36%
Gradesinrequiredclerkships
60%
PassingUSMLEStep2CS/COMLEXLevel2PE
60%
Honorsinclinicalclerkships
64%
Honorsinclerkshipindesiredspecialty
23%
Gapsinmedicaleducation
49%
Gradesinclerkshipindesiredspecialty
19%
AlphaOmegaAlpha(AOA)membership
57%
Otherlifeexperience
45%
Consistencyofgrades
40%
Volunteer/extracurricularexperiences
47%
Demonstratedinvolvementandinterestinresearch
28%
GraduateofhighlyregardedU.S.medicalschool
34%
Otherpostinterviewcontact
45%
Interestinacademiccareer
15%
Visastatus*
23%
ApplicantwasflaggedwithMatchviolationbytheNRMP
26%
Fluencyinlanguagespokenbyyourpatientpopulation
19%
GoldSocietymembership
15%
Honorsinbasicsciences
28%
Secondinterview/visit
15%
Awayrotationinyourspecialtyatanotherinstitution
13%
USMLE/COMLEXStep3score
15%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

136

Average Rating

4.7
4.8
4.6
4.3
4.0
3.9
4.2
4.3
4.1
4.6
4.4
4.2
4.4
4.2
4.2
3.9
4.3
4.2
4.2
4.1
3.9
4.3
4.1
4.0
4.0
4.3
3.9
3.8
4.0
4.0
4.0
4.5
4.8
4.4
3.9
4.1
3.7
3.8
3.7
2

Transitional Year
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure TY-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=47

100%

80%

90%

74%

80%

70%

70%

60%

50%

40%

40%

28%

30%

23%

20%

20%

10%
0%

65%

60%

50%

30%

N=43

100%

90%

Yes, pass only

Yes, target score

7%

10%

2%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=44

N=36

100%

100%

90%

90%

80%

80%

70%

70%

60%

60%

50%
40%

50%

41%

40%

32%

27%

30%

30%

20%

20%

10%

10%

0%

0%
Yes, pass only

69%

Yes, target score

No

28%

3%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=26

N=16

N=19

USMLE Step 2 CK
N=10

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

137

Transitional Year
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure TY-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=44

100%
90%

90%

80%

80%

68%

70%

N=19

100%

84%

70%

60%

60%

50%

50%

40%

40%

32%

30%

30%

20%

20%

N=44

10%
0%

16%

N=19

10%

Yes

0%

No

0%
Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=27

90%

90%

80%

80%

70%

70%
60%

60%

48%

50%
40%

50%
40%

33%

30%

30%

19%

20%

38%
31%

31%

Yes, pass only

Yes, target score

20%
10%

10%
0%

N=26

Yes, pass only

Yes, target score

No

0%

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=25

90%

90%

80%

80%

70%

70%

60%

80%

60%

52%

50%

50%

40%

40%

40%

30%

30%

20%

20%

8%

10%
0%

N=15

Yes, pass only

Yes, target score

10%
No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

20%

138

0%
Yes, pass only

Yes, target score

No

Figure TY-5

Transitional Year
Program's Interview Activities

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700

70%

600

60%

541

500

55%

50%

400

40%

300

34%

30%

200

20%

99

100

78

78

Number of
applicants
interviewed

Number of
applicants
ranked

10%

10
0
Number of
positions in the
Match

N=47*

Number of
applications
received

N=46

Number of
interview
invitations sent

N=46

N=45

0%

Percentage of applications
rejected

N=47*

Percentage of applicants
receiving an in-depth review

N=45

N=46

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
17% of Transitional Year programs consider all applicant groups
100%
N=47

90%
80%

74%

70%
60%
50%
40%

38%

34%

30%

30%

23%

19%

20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

139

Fifth Pathway

U.S. IMG

Non-U.S. IMG

Vascular Surgery
(N=22)

NRMP Program Director Survey Results, 2014

140

Figure VS-1

Vascular Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=20)
Percent Citing Factor

USMLEStep1/COMLEXLevel1score

Average Rating

95%

3.8

Lettersofrecommendationinthespecialty 100%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)

4.7
70%

USMLEStep2CK/COMLEXLevel2CEscore

80%

PersonalStatement

80%

3.9
3.6
3.9

GraduateofU.S.allopathicmedicalschool

55%

Gradesinrequiredclerkships

3.9

50%

Gapsinmedicaleducation
Honorsinclinicalclerkships
Perceivedcommitmenttospecialty

30%

4.1

80%

4.8
55%

Evidenceofprofessionalismandethics

55%

Honorsinclerkshipindesiredspecialty

4.0
4.2

65%

PassUSMLEStep2CS/COMLEXLvl2PE

4.2
3.8
4.5

65%
3.7

50%

Otherlifeexperience

3.7

50%

GraduateofhighlyregardedU.S.medicalschool

3.8

55%

4.0

75%

3.9

45%

3.5

10%
10%

GoldSocietymembership
Awayrotationinyourspecialtyatanotherinstitution

3.0
3.7

30%
15%

Fluencyinlanguagespokenbyyourpatientpopulation

141

4.6

25%

Honorsinbasicsciences

NRMP Program Director Survey Results, 2014

3.7

45%

ApplicantwasflaggedwithMatchviolationbytheNRMP

Ratings on a scale from 1 (not at all important) to 5 (very important).


* International Medical Graduates only

3.9

40%

Volunteer/extracurricularexperiences

USMLE/COMLEXStep3score
100%

3.6

45%

Consistencyofgrades

Interestinacademiccareer

4.0

75%

AlphaOmegaAlpha(AOA)membership

Visastatus*

3.3

60%
65%

Demonstratedinvolvementandinterestinresearch

4.5

45%

Gradesinclerkshipindesiredspecialty

Perceivedinterestinprogram

4.0

60%

Auditionelective/rotationwithinyourdepartment
Leadershipqualities

3.5

70%

Classranking/quartile
Personalpriorknowledgeoftheapplicant

4.0

3.3

15%
50%

0% 1

4.3
4

Figure VS-2

Vascular Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=20)
Percent Citing Factor

Interactionswithfacultyduringinterviewandvisit 95%
Interpersonalskills 100%
Interactionswithhousestaffduringinterviewandvisit
85%
Feedbackfromcurrentresidents
60%
USMLEStep1/COMLEXLevel1score
75%
Lettersofrecommendationinthespecialty 95%
USMLEStep2CK/COMLEXLevel2CEscore
70%
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter)
55%
Perceivedcommitmenttospecialty
60%
Evidenceofprofessionalismandethics
55%
Perceivedinterestinprogram
60%
Leadershipqualities
40%
Personalpriorknowledgeoftheapplicant
50%
Classranking/quartile
50%
GraduateofU.S.allopathicmedicalschool
35%
PersonalStatement
40%
Auditionelective/rotationwithinyourdepartment
30%
Gradesinrequiredclerkships
40%
PassingUSMLEStep2CS/COMLEXLevel2PE
35%
Honorsinclinicalclerkships
50%
Honorsinclerkshipindesiredspecialty
40%
Gapsinmedicaleducation
10%
Gradesinclerkshipindesiredspecialty
45%
AlphaOmegaAlpha(AOA)membership
50%
Otherlifeexperience
40%
Consistencyofgrades
35%
Volunteer/extracurricularexperiences
25%
Demonstratedinvolvementandinterestinresearch
60%
GraduateofhighlyregardedU.S.medicalschool
40%
Otherpostinterviewcontact
40%
Interestinacademiccareer
45%
Visastatus*
20%
ApplicantwasflaggedwithMatchviolationbytheNRMP
5%
0%
Fluencyinlanguagespokenbyyourpatientpopulation
10%
GoldSocietymembership
Honorsinbasicsciences
25%
Secondinterview/visit
5%
Awayrotationinyourspecialtyatanotherinstitution
15%
USMLE/COMLEXStep3score
20%
100%
50%
0% 1
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2014

142

Average Rating

4.9
4.7
4.7
4.2
3.9
4.7
3.9
3.8
4.7
4.5
4.6
3.9
3.9
3.8
4.3
3.6
4.0
4.1
3.7
3.7
4.0
3.0
4.1
4.1
3.6
4.2
2.8
3.9
3.9
3.6
4.2
3.5
5.0
2.5
3.4
3.0
4.0
4.0
2

Vascular Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Figure VS-3

Percentage of Programs That Use USMLE Step 1 Score


Scores required?

Would your program consider applicants who fail the


exam on the first attempt?

N=21

100%

81%

80%

90%
80%

70%

60%

50%

50%

40%

40%

30%

32%

30%

19%

20%

10%
0%

68%

70%

60%

20%

N=19

100%

90%

10%

0%
Yes, pass only

Yes, target score

0%

0%

No

Never

Seldom

Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Would your program consider applicants who fail
the exam on the first attempt?

Scores required?
N=21

N=15

100%

100%

90%

90%

80%

80%

71%

70%

60%

50%

50%

40%

40%

30%

30%

20%

67%

70%

60%

14%

20%

14%

10%

10%

0%

0%
Yes, pass only

Yes, target score

33%

No

0%
Never

Seldom

often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews

Scores Above Which Programs


Almost Always Grant Interviews

260

260

250

250

240

240

230

230

220

220

210

210

200

200

190

190

180

180

170

170

USMLE Step 1

USMLE Step 2 CK

USMLE Step 1

N=11

N=8

N=8

USMLE Step 2 CK
N=6

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014

143

Vascular Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure VS-4

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 CS

USMLE Step 3

N=21

100%

N=15

100%
90%

90%

76%

80%

80%

70%

70%

60%

60%

50%

50%

40%

40%

30%
20%

20%

N=21

0%

33%

30%

24%

10%

53%

13%

N=15

10%

Yes

0%

No

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%

COMLEX-USA Level 2-CE*


100%

N=13

90%

90%

80%

80%

70%

70%

60%

60%

50%

50%

38%

40%
30%

38%

50%

40%

33%

30%

23%

20%

20%

10%

10%

0%

N=12

Yes, pass only

Yes, target score

No

0%

17%

Yes, pass only

Yes, target score

No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%

COMLEX-USA Level 3*
100%

N=11

90%

90%

80%

80%

70%

70%

60%

60%

50%

45%
27%

27%

20%

10%

10%
Yes, pass only

Yes, target score

No

0%

* Osteopathic applicants only

NRMP Program Director Survey Results, 2014

30%

30%

20%

0%

50%

50%
40%

40%
30%

N=10

144

20%

Yes, pass only

Yes, target score

No

Vascular Surgery
Program's Interview Activities

Figure VS-5

Average Number of Positions, Applications Received, Interview


Invitations Sent, and Applicants Interviewed and Ranked

Average Percentage of Applicants Rejected and


Reviewed

1,000

100%

900

90%

800

80%

700
600

60%

500

50%

400

40%

300

27%

30%

200

20%

100
0

69%

70%

54
1
Number of
positions in the
Match

Number of
applications
received

N=22*

N=21

10%

22

17

14

Number of
interview
invitations sent

Number of
applicants
interviewed

Number of
applicants
ranked

N=22

N=22

0%

Percentage of applications
rejected

N=22*

Percentage of applicants
receiving an in-depth review

N=21

N=21

* Data from the NRMP database. All Responding programs included

100%

Percentage of Programs that Typically Interview and Rank Each Applicant Type
38% of Vascular Surgery programs consider all applicant groups

95%

N=21

90%
80%

71%

70%

62%

60%
48%

50%

52%
43%

43%

40%
30%
20%
10%
0%
U.S. Senior

U.S. Graduate

NRMP Program Director Survey Results, 2014

Osteopathic
Physician

Canadian

145

Fifth Pathway

U.S. IMG

Non-U.S. IMG

You might also like