Problem-Based Learning What and How Do Students Le
Problem-Based Learning What and How Do Students Le
net/publication/226053277
CITATIONS READS
2,800 53,024
1 author:
Cindy Hmelo-Silver
Indiana University Bloomington
121 PUBLICATIONS 7,634 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Cindy Hmelo-Silver on 13 March 2014.
1 Department of Educational Psychology, Rutgers, The State University of New Jersey, New
Brunswick, New Jersey.
2 Correspondence should be addressed to Cindy E. Hmelo-Silver, 10 Seminary Place, New
Brunswick, New Jersey 08901-1183; e-mail: chmelo@rci.rutgers.edu.
235
1040-726X/04/0900-0235/0 °
C 2004 Plenum Publishing Corporation
P1: FLT
Educational Psychology Review [jepr] pp1224-edpr-487801 May 22, 2004 0:50 Style file version June 4th, 2002
236 Hmelo-Silver
evaluate their hypotheses in light of what they have learned. At the comple-
tion of each problem, students reflect on the abstract knowledge gained. The
teacher helps students learn the cognitive skills needed for problem solv-
ing and collaboration. Because students are self-directed, managing their
learning goals and strategies to solve PBL’s ill-structured problems (those
without a single correct solution), they also acquire the skills needed for
lifelong learning. PBL was originally developed in medical schools and has
been used in a variety of settings from middle school to professional educa-
tion (Barrows, 2000; Barrows and Kelson, 1995; Barrows and Tamblyn, 1980;
Gallagher et al., 1992; Hmelo et al., 2000; Hmelo-Silver, 2000; Torp and Sage,
2002; Williams, 1992).
PBL is one of a family of approaches that include anchored instruc-
tion and project-based science (CTGV, 1997; Krajcik et al., 2000; Linn and
Hsi, 2000; White and Frederiksen, 1998). As shown in Table I, all three ap-
proaches use a common problem and rely on the teacher to help guide the
learning process. They differ in terms of the type and role of the problem,
the problem-solving process, and the specific tools that are employed. For
example, PBL uses realistic, ill-structured problems such as medical diagno-
sis or lesson design (Barrows, 2000; Hmelo-Silver, 2000). In this setting, the
problem is the focus for acquiring knowledge and reasoning strategies. In
anchored instruction, the problem is a video-based story that presents learn-
ers with a challenge at the end such as determining if a certain school project
can be profitable. The problem has two roles in anchored instruction. First,
it provides an apportunity for learners to apply their shared knowledge to a
P1: FLT
238
Problem Realistic ill-structured problem Video-based narrative ending with Driving question
complex problem
Role of problem Focus for learning information and Provide shared experience so students can Focus for scientific inquiry process
reasoning strategies understand how knowledge can support leading to artifact production
problem solving
Video supports problem comprehension
Process Identify facts, generate ideas and Guided planning and subgoal generation Prediction, observation, explanation
learning issues, SDL, revisit, and cycles
pp1224-edpr-487801
reflect
Role of teacher Facilitate learning process and model Engage students’ prior knowledge, model Introduce relevant content before
reasoning problem-solving strategies, provide and during inquiry
content instruction when needed by
students Guides inquiry process
Collaboration Negotiation of ideas Negotiation of ideas and strategies within Negotiation of ideas with peers and
May 22, 2004
Individual students bring new small groups and whole class local community members
knowledge to group for application
to problem
0:50
GOALS OF PBL
240 Hmelo-Silver
awareness of what they do and do not understand. Second, they must be able
to set learning goals, identifying what they need to learn more about for the
task they are engaged in. Third, they must be able to plan their learning and
select appropriate learning strategies. In other words, they must decide on a
course (or courses) of action to reach these goals. Finally, as they implement
their plan, learners must be able to monitor and evaluate whether or not
their goals have been attained.
The fourth goal of being a good collaborator means knowing how to
function well as part of a team. This encompasses establishing common
ground, resolving discrepancies, negotiating the actions that a group is going
to take, and coming to an agreement (Barron, 2002). These tasks require
an open exchange of ideas and engagement by all members of the group
(Cohen, 1994; Wenger, 1998). Explaining one’s ideas is important for produc-
tive collaboration and also serves to enhance learning (Webb and
Palincsar, 1996). The goal of becoming a good collaborator and the process
of learning collaboratively are often woven together.
The final goal of PBL is to help students become intrinsically moti-
vated. Intrinsic motivation occurs when learners work on a task motivated
by their own interests, challenges, or sense of satisfaction. Creating an en-
gaging problem is simple for medical students because they all share the
intrinsic goal of becoming physicians. Similarly, gifted high school students
tend to be highly motivated and have the cognitive skills that allow them
to be confident in tackling some complex task. Determining an appropriate
problem for less skilled students requires that the problem designers under-
stand what is developmentally appropriate, interesting to a heterogeneous
group of students, and moderately challenging without being overwhelming.
Several features of PBL support increased motivation for learning. Students
are more motivated when they value what they are learning and when their
educational activity is implicated in personally meaningful tasks (Ferrari and
Mahalingham, 1998; Leontiev, 1978). Students are also more motivated when
they believe that the outcome of learning is under their control (Bandura,
1997; Dweck, 1991).
To be intrinsically motivating, problems should provide students with
the proximal and tangible goal of applying their knowledge to solve a con-
crete problem. This type of goal is more motivating than are more distant,
abstract goals that may seem insurmountable (Bandura, 1997). Classroom
contexts that reward students for deep understanding, independent thought,
and action are also more motivating than many traditional classroom struc-
tures that reward comparative performances (Ames, 1992; Biggs, 1985;
Ramsden, 1992). PBL instruction techniques assume that all these goals
are achieved as part of the PBL learning cycle.
P1: FLT
Educational Psychology Review [jepr] pp1224-edpr-487801 May 22, 2004 0:50 Style file version June 4th, 2002
242 Hmelo-Silver
The PBL learning cycle (shown in Fig. 1) is enacted through the tutorial
process that begins with the presentation of a problem and ends with student
reflection. A PBL tutorial session begins by presenting a group of students
with minimal information about a complex problem (Barrows, 2000). From
the outset, students must question the facilitator to obtain additional prob-
lem information; they may also gather facts by doing experiments or other
research (Torp and Sage, 2002). For example, when middle-school children
were asked to build artificial lungs, they performed experiments to deter-
mine how much air the lungs had to displace (Hmelo et al., 2000). At several
points during their problem solving, students typically pause to reflect on the
data they have collected so far, generate questions about those data, and hy-
pothesize about underlying causal mechanisms that might help explain the
data. Students also identify concepts they need to learn more about in or-
der to solve the problem, labeling these concepts as “learning issues.” After
considering the problem with their naı̈ve knowledge, students independently
research the learning issues they have chosen. They then regroup to share
what they have learned, reconsider their hypotheses, and/or generate new
hypotheses in light of their new learning. When completing the task, learners
deliberately reflect on the problem to abstract the lessons learned about the
problem and about their SDL and collaborative problem-solving processes.
While working through the problem, students use whiteboards to record
their evolving ideas. Figure 2 shows an example of how engineering students
used whiteboards while determining the cause of a chemical spill (Hmelo
et al., 1995). The whiteboard is divided into four record-keeping columns to
facilitate problem solving. The Facts column holds information that the stu-
dents gleaned from the problem statement such as what the problem is and
where it occurred. The Ideas column serves to keep track of their evolving
hypotheses about solutions, such as reducing the storage of hazardous chem-
icals. The students place their questions for further study into the Learning
Issues column. In this example, students identify issues related to the tech-
nology for storing hazardous chemicals. They use the Action Plan column
to keep track of plans for resolving the problem or obtaining additional in-
formation such as calling a government agency. The four columns provide
scaffolding communicating the problem-solving process in PBL (Hmelo and
Guzdial, 1996). The whiteboard serves as a focus for negotiation of the prob-
lem and as a forum for students to co-construct knowledge. The whiteboard
helps students externalize their problem solving and allows them to focus on
more difficult aspects of the problem-solving process. It provides a model of
a systematic approach to problem solving and supports student planning and
monitoring as they identify what needs to be recorded on or later removed
from the board.
P1: FLT
Educational Psychology Review [jepr] pp1224-edpr-487801 May 22, 2004 0:50 Style file version June 4th, 2002
244 Hmelo-Silver
Cognitive research and practical experience with PBL have made im-
portant strides in identifying the characteristics of a good problem (Barrows
and Kelson, 1995; Gallagher et al., 1992; Kolodner et al., 1996). To foster flexi-
ble thinking, problems need to be complex, ill-structured, and open-ended; to
support intrinsic motivation, they must also be realistic and resonate with the
students’ experiences. A good problem affords feedback that allows students
to evaluate the effectiveness of their knowledge, reasoning, and learning
strategies. The problems should also promote conjecture and argumentation.
Problem solutions should be complex enough to require many interrelated
pieces and should motivate the students’ need to know and learn. As students
generate hypotheses and defend them to others in their group, they publicly
articulate their current state of understanding, enhancing knowledge con-
struction and setting the stage for future learning (Koschmann et al., 1994).
Such problems should help students become engaged in the learning process
based on their initial understanding. The problems in a PBL curriculum are
chosen so that concepts are visited in a number of problems across the entire
curriculum (Hmelo-Silver, 2000; Koschmann et al., 1994). For example, pre-
service teachers might apply information-processing concepts to a problem
on individual assessment, another on group assessment, and yet again as part
of an instructional redesign task (Derry et al., 2002; Hmelo-Silver, 2000). It
is also likely that aspects of motivation would be considered in some or all
of these problems.
Good problems often require multidisciplinary solutions. For example,
planning a long trip on the Appalachian Trail requires using knowledge
and skills from several content areas to solve the problem (e.g., math and
life sciences). The necessity of gathering knowledge from a wide range of
sources allows students to see how knowledge is a useful tool for problem
solving. Good problems also foster communication skills as students present
their plans to the rest of their class. Multidisciplinary problems should help
build extensive and flexible knowledge because information is not learned
in isolation.
Having good problems is a necessary but not sufficient condition for ef-
fective PBL. The facilitator role is critical to making PBL function well. With
P1: FLT
Educational Psychology Review [jepr] pp1224-edpr-487801 May 22, 2004 0:50 Style file version June 4th, 2002
its emphasis on learning through problem solving and on making key aspects
of expertise visible, PBL exemplifies the cognitive apprenticeship model
(Collins et al., 1989). In PBL, the teacher/facilitator is an expert learner,
able to model good strategies for learning and thinking, rather than an ex-
pert in the content itself. The facilitator scaffolds student learning through
modeling and coaching, primarily through the use of questioning strategies
(Hmelo-Silver and Barrows, 2003). Facilitators progressively fade their scaf-
folding as students become more experienced with PBL until finally the
learners adopt many of the facilitators’ roles. The facilitator is responsi-
ble both for moving the students through the various stages of PBL and
for monitoring the group process. This monitoring assures that all students
are involved and encourages them both to externalize their own thinking
and to comment on each other’s thinking (Hmelo-Silver, 2002; Koschmann
et al., 1994). The PBL facilitator (a) guides the development of higher or-
der thinking skills by encouraging students to justify their thinking and (b)
externalizes self-reflection by directing appropriate questions to individu-
als. The facilitator plays an important role in modeling the problem solving
and SDL skills needed for self-assessing one’s reasoning and understanding.
Although the facilitator fades some of his or her scaffolding as the group
gains experience with the PBL method, s/he continues to monitor the group,
making moment-to-moment decisions about how best to facilitate the PBL
process. The facilitator directly supports several of the goals of PBL. First,
s/he models the problem solving and SDL processes. Second, the facilitator
helps students learn to collaborate well. An underlying assumption is that
when facilitators support the learning and collaboration processes, students
are better able to construct flexible knowledge.
There are several important issues in understanding how to facilitate
and why it is so difficult for a facilitator who is comfortable with one group
and a small number of students to then monitor a typical classroom with sev-
eral groups and many students. Facilitation is a subtle skill. It involves know-
ing when an appropriate question is called for, when the students are going
off-track, and when the PBL process is stalled. In a study of an expert PBL
facilitator, Hmelo-Silver (2002) found that he accomplished his role largely
through metacognitive questioning and questioning that focused students’
attention and elicited causal explanations. The facilitator used a variety of
strategies to support his goal of getting medical students to construct causal
models of a patient’s illness. He asked students to explain their reasoning to
the point where they realized that the limitations of their knowledge neces-
sitated creating a learning issue. Another strategy was to ask students how
hypotheses related to the patient’s signs and symptoms in order to encour-
age the students to elaborate causal mechanisms. This study demonstrated
that an expert facilitator has a flexible set of strategies that can be tailored
to different stages of the PBL process.
P1: FLT
Educational Psychology Review [jepr] pp1224-edpr-487801 May 22, 2004 0:50 Style file version June 4th, 2002
246 Hmelo-Silver
dedicated facilitator, there are a variety of techniques that might help estab-
lish productive collaboration. For example, scripted cooperation, reciprocal
teaching, and the use of student roles have all been used to support effec-
tive collaborative learning with K–16 students (O’Donnell, 1999; Palincsar
and Herrenkohl, 1999). Although none of these techniques have been tested
in a PBL classroom, the technique of assigning students to different cogni-
tive roles was used in a fourth-grade inquiry science classroom (Palincsar and
Herrenkohl, 1999). These cognitive roles included predicting and theorizing,
summarizing results, and relating predictions and theories to results. These
roles, much like a facilitator, help ensure that all group members are cogni-
tively engaged (Hmelo-Silver, 2002). Use of some of these well-researched
techniques might facilitate effective collaboration within PBL settings.
Reflection in PBL
248 Hmelo-Silver
Critical reflection can give students a basis for improvement. This next
example demonstrates that students can be critical about themselves and
others during the end of a problem reflection session. They freely acknowl-
edged both their strengths and their weaknesses as Delia, a 2nd-year medical
student, did in this excerpt:
Well, I’ll go first because we’ll just go around . . . I think I did a pretty good job with
this case. I think for my knowledge, I think I covered . . . a good breadth of issues,
and I think I covered the issues on the learning issues list well, I think I could have
gotten a little bit more in depth into some of them, especially, you know . . . vitamin
B12 deficiency was a thing I ran across, you know we kind [of] ruled it down, but I
ran across it when I was looking at some differentials, and I studied it a little bit but
didn’t get all the way down into the details of it, so I’m gonna want to go back and
do that, especially the biochemistry . . ., I think also with the neurosyphilis I’d like to
look a little bit more into that because I’m really weak in understanding how that
works . . . but I think, I did a good job with the differential diagnosis and figuring out
what we needed to know in order to rule things in and out. I thought I did a good
job with that when I was studying, and it worked well for the case . . .. (Hmelo-Silver
and Barrows, 2002)
Delia noted that she needed to go back and look up some of the biochemistry
concepts and she reflected on her SDL. The other students offered their
specific feedback. For example, Carol pointed out that
One thing I thought you did really well was that you understood which tests were
needed and why they were needed and how they were done and what they would
tell us. I thought that was really one of your strengths in this case. (Hmelo-Silver and
Barrows, 2002)
This section considers the evidence about each of the purported goals
of PBL. Much of the evidence comes from research in medical schools and
gifted education although there are a few studies involving other populations.
There are many innovative descriptions of using PBL in various settings:
educational administration, business, educational psychology, engineering,
chemistry, various undergraduate disciplines, and K–12 education (Boud and
Felletti, 1991; Bridges, 1992; Duch et al., 2001; Hmelo-Silver, 2000; Hmelo
et al., 1995; Ram, 1999; Stepien and Gallagher, 1993; Torp and Sage, 2002),
but there is less empirical evidence as to what students are learning and
how. The questions that need to be addressed in such a literature include
the following: Do students construct an extensive and flexible knowledge
base, do they become better problem-solvers, what kind of self-directed
learners do they become, how do they collaborate (and what factors affect
their collaboration), and are they intrinsically motivated? The next sections
address the evidence as to whether students actually achieve these goals.
The results on what students learn from PBL are mixed. Much eval-
uation of PBL has examined traditional academic outcome measures such
as examination scores. In general, several meta-analyses have demonstrated
that PBL students scored slightly lower than traditional medical students
on multiple-choice measures of academic achievement such as the National
Board of Medical Examiners (NBME) Part I, which examines basic science
knowledge (Albanese and Mitchell, 1993; Goodman et al., 1991; Mennin
et al., 1993; Vernon and Blake, 1993). However, meta-analyses also showed
that PBL students performed slightly better than traditional medical stu-
dents at tasks related to clinical problem solving such as NBME II and
on ratings and tests of clinical performance (Albanese and Mitchell, 1993;
Vernon and Blake, 1993). The effect sizes were small on the NBME II and
moderate when performance ratings were used. Although multiple-choice
tests measure knowledge, they may not get at the type of extensive and flexi-
ble knowledge aligned with the goals of PBL. In a more recent meta-analysis,
Dochy et al. (2003) found that there was no effect of PBL on measures of
factual knowledge, however studies of knowledge application demonstrated
a moderate effect size favoring PBL students compared with traditional
P1: FLT
Educational Psychology Review [jepr] pp1224-edpr-487801 May 22, 2004 0:50 Style file version June 4th, 2002
250 Hmelo-Silver
Basic knowledge is the main focus of another group’s approach to teaching but
it can only be accomplished through memory. By going back to basic concepts and
incorporating new ideas, memory is a necessary attribute in the success of knowledge
based learning. Memory is the processes [sic] by which information is encoded, stored,
and retrieved. Long term memory becomes the goal of the students in this teaching
approach. Information in long term memory is practically unlimited in both capacity
and duration but on the other hand, long term memory is hard to achieve [sic].
Through constant use of information, long term memory is possible because schemas
are formed about how situations will occur based on past experiences. Schemas,
therefore, become a template of knowledge on which information is organized . . ..
(Hmelo-Silver, 2000, p. 51)
252 Hmelo-Silver
The first thing that Mr. Johnson should have done was to introduce a unit on static
electricity by asking the students what they already knew about static electricity. We
suggest that Mr. Johnson create a concept map using what the students already know
about static electricity from their other classes or everyday lives. “Prior knowledge
is stored in the form of schemas. Teachers can activate these schemas in a number
of ways including: reviewing, questioning, or developing with the students a concept
map of prior knowledge” (Knowledge Web, the Prior Knowledge Use [sic]). A con-
cept map is extremely important because teachers use students’ prior knowledge to
explain and discuss increasingly more sophisticated concepts. Prior knowledge be-
comes a platform upon which new understanding is constructed ” (Knowledge Web,
the Prior Knowledge Use [sic]). . . . When the students are done explaining to Mr.
Johnson what they previously knew about static electricity, we suggested he give a
brief lecture to fill in the gaps and add to the concept map what the students missed.
The new knowledge that students learn from the lecture provides them with an inte-
gral tool that will allow them to make more meaningful connections when they see
the experiment. (Hmelo-Silver, 2000, p. 53)
254 Hmelo-Silver
256 Hmelo-Silver
SRL students may have difficulty dealing with the SDL demands of a PBL
curriculum.
A commonly held assumption in the PBL approach is that problem
content and ensuing discussions direct SDL. In questioning this assumption,
Dolmans and Schmidt (2000) asked what other curricular elements might
direct SDL. The PBL students at their institution received course objectives,
a limited number of lectures, tests, and suggested references. Dolmans and
Schmidt reasoned that over reliance on these external elements might im-
pede the development of SDL skills. To examine this, they gave first through
4th-year students a questionnaire with items relating to the different curricu-
lar elements. They found that both problem discussion and course objectives
had the greatest positive influence on SDL. Tests and lectures had the least
positive influence. Furthermore, over the 4 years of the curriculum, students
increased their emphasis on the functional knowledge they would need as
physicians and decreased their reliance on external elements such as tests.
These results indicate that over time, students in a PBL curriculum become
more self-reliant.
Developing SDL skills is a difficult and multifaceted process for students
in PBL curricula. This begs the question of whether PBL students develop
better SDL skills than traditional medical students. One way to study this
is by examining component processes in SDL such as how students gener-
ated learning issues, planned their learning, and integrated new knowledge
in problem solving. Hmelo and Lin (2000) examined these component pro-
cesses by comparing medical students in traditional and PBL curricula who
had completed a pathophysiological explanation task. They found that the
PBL students transferred the hypothesis-driven strategies from their prob-
lem solving into their SDL as they used their hypotheses to plan their learn-
ing. Moreover, they were more likely to integrate new information into a
revised explanation than traditional medical students.
In a study comparing traditional and PBL medical students in terms of
the learning resources they used, Blumberg and Michael (1992) found that
PBL students were more likely to use self-chosen learning resources whereas
students in the conventional curriculum used faculty-chosen resources. PBL
students were more likely to report selecting the material to study them-
selves, whereas conventional curriculum students reported reading specific
teacher-generated assignments. Engineering students in a PBL course in sus-
tainable technology increased their use of expertise other than that provided
by course instructors as the course progressed and tended to use a variety
of student-selected resources throughout the course (Shikano and Hmelo,
1996).
The research on SDL in PBL has largely been confined to professional
students so its wider application is ripe for additional research. It is clear
P1: FLT
Educational Psychology Review [jepr] pp1224-edpr-487801 May 22, 2004 0:50 Style file version June 4th, 2002
that all students need to grapple with the uncertainty involved in directing
their own learning. For students who are poor self-regulated learners, PBL is
likely to pose difficulties without appropriate scaffolding for students trying
to develop SDL skills. Becoming self-directed learners is not a given as the
Evensen et al. (2001) and Ertmer et al. (1996) studies demonstrate. It is not
at all certain how to structure PBL for less mature learners. Scaffolding SDL
is likely to be especially important for younger learners but as the research
has noted, there are considerable individual differences even among adult
learners.
258 Hmelo-Silver
260 Hmelo-Silver
DISCUSSION
One barrier to using PBL in more diverse settings is the lack of a suffi-
cient number of skilled facilitators in many settings. Classrooms have more
students than one person can easily facilitate, and learning to facilitate well is
a challenge (Derry et al., 2001). Some techniques such as procedural facilita-
tion, scripted cooperation, and structured journals may prove useful tools in
moving PBL to other settings. In addition, the PBL activity structure might
be modified to support PBL for specific teaching goals. Technology may also
play an important role in adapting PBL for specific disciplines. For example,
in the STEP system (Secondary Teacher Education Program), the activity
structure was modified to help preservice teachers engage in instructional
design as they learn about educational psychology (www.estepweb.org). The
STEP system is an integrated system with videocases of classroom instruc-
tion, a hypermedia textbook, a set of problems, a virtual whiteboard, and an
activity structure that guides students through PBL and the instructional de-
sign process (Steinkuehler et al., 2002). The activity is divided into a sequence
that starts with individual problem analysis, moves on to group SDL and
problem solving, and ends with individual explanation and reflection. The
whiteboard structure has been modified to include students’ ideas about ob-
jectives, assessment, and activities. A space is provided that reminds students
to include the psychological justification for their ideas. The same three cat-
egories emphasized in the whiteboard are the focus of the students’ problem
solving. The problems are video based and indexed to educational psychol-
ogy concepts to help support the students’ SDL. Approaches to distributing
facilitation using various tools and technology need further research and
evaluation to understand their strengths and limitations.
In conclusion, PBL is a pedagogical technique that situates learning
in complex problem-solving contexts. It provides students with opportuni-
ties to consider how the facts they acquire relate to a specific problem at
hand. It obliges them to ask what they need to know. PBL offers the po-
tential to help students become reflective and flexible thinkers who can use
knowledge to take action. Although the roots of PBL go back to Kilpatrick
(1918) and Dewey (1938), PBL has the advantage of suggesting a method
to promote active and reflective knowledge-building-for-action (Hmelo and
Guzdial, 1996). Still, careful research is needed to understand if and how
these potentials might be realized.
ACKNOWLEDGMENTS
262 Hmelo-Silver
REFERENCES
Abrandt Dahlgren, M., and Dahlgren, L. O. (2002). Portraits of PBL: Students’ experiences
of the characteristics of problem-based learning in physiotherapy, computer engineering,
and psychology. Instr. Sci. 30: 111–127.
Albanese, M. A., and Mitchell, S. (1993). Problem-based learning: A review of literature on its
outcomes and implementation issues. Acad. Med. 68: 52–81.
Ames, C. (1992). Classrooms: Goals, structures, and student motivation. J. Educ. Psychol. 84:
261–271.
Bandura, A. (1997). Self-Efficacy: The Exercise of Control, Freeman, New York.
Barron, B. J. S. (2002). Achieving coordination in collaborative problem-solving groups. J.
Learn. Sci. 9: 403–437.
Barrows, H. S. (2000). Problem-Based Learning Applied to Medical Education, Southern Illinois
University Press, Springfield.
Barrows, H., and Kelson, A. C. (1995). Problem-Based Learning in Secondary Education and
the Problem-Based Learning Institute (Monograph 1), Problem-Based Learning Institute,
Springfield, IL.
Barrows, H. S., and Tamblyn, R. (1980). Problem-Based Learning: An Approach to Medical
Education, Springer, New York.
Bereiter, C., and Scardamalia, M. (1989). Intentional learning as a goal of instruction. In
Resnick, L. B. (ed.), Knowing, Learning, and Instruction: Essays in Honor of Robert Glaser,
Erlbaum, Hillsdale, NJ, pp. 361–392.
Biggs, J. B. (1985). The role of metalearning in study processes. Br. J. Educ. Psychol. 55: 185–212.
Blumberg, P., and Michael, J. A. (1992). Development of self-directed learning behaviors in a
partially teacher-directed problem-based learning curriculum. Teach. Learn. Med. 4: 3–8.
Blumenfeld, P. C., Marx, R. W., Soloway, E., and Krajcik, J. S. (1996). Learning with peers: From
small group cooperation to collaborative communities. Educ. Res. 25(8): 37–40.
Boud, D., and Feletti, G. (1991). The Challenge of Problem Based Learning, St. Martin’s Press,
New York.
Bransford, J. D., Brown, A. L., and Cocking, R. (2000). How People Learn, National Academy
Press, Washington, DC.
Bransford, J. D., and McCarrell, N. S. (1977). A sketch of a cognitive approach to comprehen-
sion: Some thoughts about understanding what it means to comprehend. In Johnson-Laird,
P. N., and Wason, P. C. (eds.), Thinking: Readings in Cognitive Science, Cambridge Univer-
sity Press, Cambridge, UK, pp. 377–399.
Bransford, J. D., Vye, N., Kinzer, C., and Risko, R. (1990). Teaching thinking and content
knowledge: Toward an integrated approach. In Jones, B. F., and Idol, L. (eds.), Dimensions
of Thinking and Cognitive Instruction, Erlbaum, Hillsdale, NJ, pp. 381–413.
Bridges, E. M. (1992). Problem-Based Learning for Administrators, ERIC Clearinghouse on
Educational Management, Eugene, OR.
Brown, A. L. (1995). The advancement of learning. Educ. Res. 23(8): 4–12.
Chi, M. T. H., Bassok, M., Lewis, M. W., Reimann, P., and Glaser, R. (1989). Self-explanations:
How students study and use examples in learning to solve problems. Cogn. Sci. 13: 145–182.
Chi, M. T. H., DeLeeuw, N., Chiu, M., and LaVancher, C. (1994). Eliciting self-explanations
improves understanding. Cogn. Sci. 18: 439–477.
Chi, M. T. H., Feltovich, P., and Glaser, R. (1981). Categorization and representation of physics
problems by experts and novices. Cogn. Sci. 5: 121–152.
P1: FLT
Educational Psychology Review [jepr] pp1224-edpr-487801 May 22, 2004 0:50 Style file version June 4th, 2002
Cognition and Technology Group at Vanderbilt (1997). The Jasper Project: Lessons in Curricu-
lum, Instruction, Assessment, and Professional Development, Erlbaum, Mahwah, NJ.
Cohen, E. G. (1994). Restructuring the classroom: Conditions for productive small groups. Rev.
Educ. Res. 64: 1–35.
Collins, A., Brown, J. S., and Newman, S. E. (1989). Cognitive apprenticeship: Teaching the
crafts of reading, writing, and mathematics. In Resnick, L. B. (ed.), Knowing, Learning,
and Instruction: Essays in Honor of Robert Glaser, Erlbaum, Hillsdale, NJ, pp. 453–494.
DeGrave, W. S., Boshuizen, H. P. A., and Schmidt, H. G. (1996). Problem-based learning:
Cognitive and metacognitive processes during problem analysis. Instr. Sci. 24: 321–341.
Derry, S. J., Lee, J., Kim, J.-B., Seymour, J., and Steinkuehler, C. A. (2001, April). From ambitious
vision to partially satisfying reality: Community and collaboration in teacher education.
Paper presented at the Annual Meeting of the American Educational Research Association,
Seattle, WA.
Derry, S. J., Levin, J. R., Osana, H. P., Jones, M. S., and Peterson, M. (2000). Fostering students’
statistical and scientific thinking: Lessons learned from an innovative college course. Am.
Educ. Res. J. 37: 747–773.
Derry, S. J., Siegel, M., Stampen, J., and the STEP team (2002). The STEP system for collab-
orative case-based teacher education: Design, evaluation, and future directions. In Stahl,
G. (ed.), Proceedings of CSCL 2002, Erlbaum, Hillsdale, NJ, pp. 209–216.
Dewey, J. (1938). Experience and Education, Macmillan, New York.
Dochy, F., Segers, M., Van den Bossche, P., and Gijbels, D. (2003). Effects of problem-based
learning: A meta-analysis. Learn. Instr. 13: 533–568.
Dods, R. F. (1997). An action research study of the effectiveness of problem-based learning in
promoting the acquisition and retention of knowledge. J. Educ. Gifted 20: 423–437.
Dolmans, D. H. J. M., and Schmidt, H. G. (2000). What directs self-directed learning in a
problem-based curriculum? In Evensen, D. H., and Hmelo, C. E. (eds.), Problem-Based
Learning: A Research Perspective on Learning Interactions Erlbaum, Mahwah, NJ, pp. 251–
262.
Duch, B. J., Groh, S. E., and Allen, D. E. (2001). The Power of Problem-Based Learning, Stylus,
Steerling, VA.
Dweck, C. S. (1991). Self-theories and goals: Their role in motivation, personality, and develop-
ment. In Nebraska Symposium on Motivation, 1990, University of Nebraska Press, Lincoln,
pp. 199–235.
Ertmer, P., Newby, T. J., and MacDougall, M. (1996). Students’ responses and approaches to
case-based instruction: The role of reflective self-regulation. Am. Educ. Res. J. 33: 719–752.
Evensen, D. (2000). Observing self-directed learners in a problem-based learning context:
Two case studies. In Evensen, D., and Hmelo, C. E. (eds.), Problem-Based Learn-
ing: A Research Perspective on Learning Interactions, Erlbaum, Mahwah, NJ, pp. 263–
298.
Evensen, D. H., Salisbury-Glennon, J., and Glenn, J. (2001). A qualitative study of 6 medical
students in a problem-based curriculum: Towards a situated model of self-regulation. J.
Educ. Psychol. 93: 659–676.
Faidley, J., Evensen, D. H., Salisbury-Glennon, J., Glenn, J., and Hmelo, C. E. (2000). How are
we doing? Methods of assessing group processing in a problem-based learning context. In
Evensen, D. H., and Hmelo, C. E. (eds.), Problem-Based Learning: A Research Perspective
on Learning Interactions, Erlbaum, Mahwah, NJ, pp. 109–135.
Ferrari, M., and Mahalingham, R. (1998). Personal cognitive development and its implications
for teaching and learning. Educ. Psychol. 33: 35–44.
Gallagher, S., and Stepien, W. (1996). Content acquisition in problem-based learning: Depth
versus breadth in American studies. J. Educ. Gifted 19: 257–275.
Gallagher, S. A., Stepien, W. J., and Rosenthal, H. (1992). The effects of problem-based learning
on problem solving. Gifted Child Q. 36: 195–200.
Gick, M. L., and Holyoak, K. J. (1980). Analogical problem solving. Cogn. Psychol. 12: 306–355.
Gick, M. L., and Holyoak, K. J. (1983). Schema induction and analogical transfer. Cogn. Psychol.
15: 1–38.
P1: FLT
Educational Psychology Review [jepr] pp1224-edpr-487801 May 22, 2004 0:50 Style file version June 4th, 2002
264 Hmelo-Silver
Goodman, L. J., Erich, E., Brueschke, E. E., Bone, R. C., Rose, W. H., Williams, E. J., and Paul,
H. A. (1991). An experiment in medical education: A critical analysis using traditional
criteria. JAMA 265: 2373–2376.
Greeno, J. G., Collins, A., and Resnick, L. B. (1996). Cognition and learning. In Berliner, D.
C., and Calfee, R. C. (eds.), Handbook of Educational Psychology, Macmillan, New York,
pp. 15–46.
Hmelo, C. E. (1994). Development of Independent Thinking and Learning Skills: A Study of
Medical Problem-Solving and Problem-Based Learning, Unpublished Doctoral Disserta-
tion, Vanderbilt University, Nashville, TN.
Hmelo, C. E. (1998). Problem-based learning: Effects on the early acquisition of cognitive skill
in medicine. J. Learn. Sci. 7: 173–208.
Hmelo, C. E., and Ferrari, M. (1997). The problem-based learning tutorial: Cultivating higher-
order thinking skills. J. Educ. Gifted 20: 401–422.
Hmelo, C. E., Gotterer, G. S., and Bransford, J. D. (1997). A theory-driven approach to assessing
the cognitive effects of PBL. Instr. Sci. 25: 387–408.
Hmelo, C. E., and Guzdial, M. (1996). Of black and glass boxes: Scaffolding for learning and
doing. In Edelson, D. C., and Domeshek, E. A. (eds.), Proceedings of ICLS 96, AACE,
Charlottesville, VA, pp. 128–134.
Hmelo, C. E., Holton, D., and Kolodner, J. L. (2000). Designing to learn about complex systems.
J. Learn. Sci. 9: 247–298.
Hmelo, C. E., and Lin, X. (2000). The development of self-directed learning strategies in
problem-based learning. In Evensen, D., and Hmelo, C. E. (eds.), Problem-Based Learning:
Research Perspectives on Learning Interactions, Erlbaum, Mahwah, NJ, pp. 227–250.
Hmelo, C., Shikano, T., Bras, B., Mulholland, J., Realff, M., and Vanegas, J. (1995). A problem-
based course in sustainable technology. In Budny, D., Herrick, R., Bjedov, G., and Perry,
J. B. (eds.), Frontiers in Education 1995, American Society for Engineering Education,
Washington, DC.
Hmelo-Silver, C. E. (2000). Knowledge recycling: Crisscrossing the landscape of educational
psychology in a Problem-Based Learning Course for Preservice Teachers. J. Excell. Coll.
Teach. 11: 41–56.
Hmelo-Silver, C. E. (2002). Collaborative ways of knowing: Issues in facilitation. In Stahl, G.
(ed.), Proceedings of CSCL 2002, Erlbaum, Hillsdale, NJ, pp. 199–208.
Hmelo-Silver, C. E., and Barrows, H. S. (2003). Facilitating collaborative ways of knowing.
Manuscript submitted for publication.
Hmelo-Silver, C. E., and Barrows, H.S. (2002, April). Goals and strategies of a constructivist
teacher. Paper presented at American Educational Research Association Annual Meeting,
New Orleans, LA.
Kilpatrick, W. H. (1918). The project method. Teach. Coll. Rec. 19: 319–335.
Kilpatrick, W. H. (1921). Dangers and difficulties of the project method and how to overcome
them: Introductory statement: Definition of terms. Teach. Coll. Rec. 22: 282–288.
Kolodner, J. L. (1993). Case-Based Reasoning, Morgan Kaufmann, San Mateo, CA.
Kolodner, J. L., Hmelo, C. E., and Narayanan, N. H. (1996). Problem-based learning meets
case-based reasoning. In Edelson, D. C., and Domeshek, E. A. (eds.), Proceedings of ICLS
96, AACE, Charlottesville, VA, pp. 188–195.
Koschmann, T. D., Myers, A. C., Feltovich, P. J., and Barrows, H. S. (1994). Using technology
to assist in realizing effective learning and instruction: A principled approach to the use of
computers in collaborative learning. J. Learn. Sci. 3: 225–262.
Krajcik, J., Blumenfeld, P., Marx, R., and Soloway, E. (2000). Instructional, curricular, and
technological supports for inquiry in science classrooms. In Minstrell, J., and Van Zee, E.
H. (eds.), Inquiring Into Inquiry Learning and Teaching in Science, American Association
for the Advancement of Science, Washington, DC, pp. 283–315.
Krajcik, J., Marx, R., Blumenfeld, P., Soloway, E., and Fishman, B. (2000, April). Inquiry-
based science supported by technology: Achievement among urban middle school students.
Paper presented at the Annual Meeting of the American Educational Research Association,
New Orleans, LA.
P1: FLT
Educational Psychology Review [jepr] pp1224-edpr-487801 May 22, 2004 0:50 Style file version June 4th, 2002
Lampert, M. (2001). Teaching Problems and the Problems of Teaching, Yale University Press,
New Haven, CT.
Leontiev, A. N. (1978). Activity, Consciousness, and Personality (M. J. Hall, Trans.), Prentice-
Hall, Englewood Cliffs, NJ.
Lesgold, A., Rubinson, H., Feltovich, P., Glaser, R., Klopfer, D., and Wang, Y. (1988). Expertise
in a complex skill: Diagnosing x-ray pictures. In Chi, M. T. H., Glaser, R., and Farr, M. J.
(eds.), The Nature of Expertise, Erlbaum. Hillsdale, NJ, pp. 311–342.
Linn, M. C., and Hsi, S. (2000). Computers, Teachers, Peers: Science Learning Partners, Erlbaum,
Mahwah, NJ.
Mennin, S. P., Friedman, M., Skipper, B., Kalishman, S., and Snyder, J. (1993). Performances
on the NBME I, II, and III by medical students in the problem-based and conventional
tracks at the University of New Mexico. Acad. Med. 68: 616–624.
Needham, D. R., and Begg, I. M. (1991). Problem-oriented training promotes spontaneous
analogical transfer. Memory-oriented training promotes memory for training. Mem. Cogn.
19: 543–557.
Norman, G. R., Brooks, L. R., Colle, C., and Hatala, H. (1998). Relative effectiveness of in-
struction in forward and backward reasoning. Paper presented at the Annual Meeting of
the American Educational Research Association, San Diego, CA.
Norman, G. R., Trott, A. D., Brooks, L. R., and Smith, E. K. (1994). Cognitive differences in
clinical reasoning related to postgraduate training. Teach. Learn. Med. 6: 114–120.
Novick, L. R., and Hmelo, C. E. (1994). Transferring symbolic representations across noniso-
morphic problems. J. Exp. Psychol. Learn. Mem. Cogn. 20: 1296–1321.
Novick, L. R., and Holyoak, K. J. (1991). Mathematical problem solving by analogy. J. Exp.
Psychol. Learn. Mem. Cogn. 17: 398–415.
O’Donnell, A. M. (1999). Structuring dyadic interaction through scripted cooperation. In
O’Donnell, A. M., and King, A. (eds.), Cognitive Perspectives on Peer Learning, Erlbaum,
Mahwah, NJ, pp. 179–196.
Palincsar, A. S., and Herrenkohl, L. R. (1999). Designing collaborative contexts: Lessons from
three research programs. In O’Donnell, A. M., and King, A. (eds.), Cognitive Perspectives
on Peer Learning, Erlbaum, Mahwah, NJ, pp. 151–178.
Patel, V. L., Groen, G. J., and Norman, G. R. (1991). Effects of conventional and problem-based
medical curricula on problem solving. Acad. Med. 66: 380–389.
Patel, V. L., Groen, G. J., and Norman, G. R. (1993). Reasoning and instruction in medical
curricula. Cogn. Instr. 10: 335–378.
Pea, R. D. (1993). Practices of distributed intelligence and designs for education. In Salomon,
G., and Perkins, D. (eds.), Distributed Cognitions: Psychological and Educational Consid-
erations, Cambridge University Press, New York, pp. 47–87.
Perfetto, G. A., Bransford, J. D., and Franks, J. J. (1983). Constraints on access in a problem-
solving context. Mem. Cogn. 11: 24–31.
Puntambekar, S., and Kolodner, J. L. (1998). The design diary: A tool to support stu-
dents in learning science by design. In Bruckman, A. S., Guzdial, M., Kolodner, J.,
and Ram, A. (eds.), Proceedings of ICLS 98, AACE, Charlottesville, VA, pp. 230–
236.
Ram, P. (1999). Problem-based learning in undergraduate instruction: A sophomore chemistry
laboratory. J. Chem. Educ. 76: 1122–1126.
Ramsden, P. (1992). Learning to Teach in Higher Education, Routledge, New York.
Salomon, G. (1993). No distribution without individual cognition: A dynamic interac-
tional view. In Salomon, G., and Perkins, D. (eds.), Distributed Cognitions: Psycholog-
ical and Educational Considerations, Cambridge University Press, New York, pp. 111–
138.
Salomon, G., and Perkins, D. N. (1989). Rocky roads to transfer: Rethinking mechanisms of a
neglected phenomenon. Educ. Psychol. 24: 113–142.
Schmidt, H. G., DeVolder, M. L., De Grave, W. S., Moust, J. H. C., and Patel, V. L. (1989).
Explanatory models in the processing of science text: The role of prior knowledge activation
through small-group discussion. J. Educ. Psychol. 81: 610–619.
P1: FLT
Educational Psychology Review [jepr] pp1224-edpr-487801 May 22, 2004 0:50 Style file version June 4th, 2002
266 Hmelo-Silver
Schmidt, H. G., Machiels-Bongaerts, M., Hermans, H., ten Cate, T. J., Venekamp, R., and
Boshuizen, H. P. A. (1996). The development of diagnostic competence: Comparison of
a problem-based, an integrated, and a conventional medical curriculum. Acad. Med. 71:
658–664.
Schmidt, H. G., and Moust, J. H. C. (2000). Factors affecting small-group tutorial learning: A
review of research. In Evensen, D., and Hmelo, C. E. (eds.), Problem-Based Learning: A
Research Perspective on Learning Interactions, Erlbaum, Mahwah, NJ, pp. 19–51.
Schwartz, D. L., and Bransford, J. D. (1998). A time for telling. Cogn. Instr. 16: 475–522.
Schoenfeld, A. H. (1985). Mathematical Problem Solving, Academic Press, Orlando, FL.
Shikano, T., and Hmelo, C. E. (1996, April). Students’ learning strategies in a problem-based
curriculum for sustainable technology. Paper presented at American Educational Research
Association Annual Meeting, New York.
Steinkuehler, C. A., Derry, S. J., Hmelo-Silver, C. E., and DelMarcelle, M. (2002). Cracking the
resource nut with distributed problem-based learning in secondary teacher education. J.
Distance Educ. 23: 23–39.
Stepien, W. J., and Gallagher, S. A. (1993). Problem-based learning: As authentic as it gets.
Educ. Leadersh. 50(7): 25–29.
Torp, L., and Sage, S. (2002). Problems as Possibilities: Problem-Based Learning for K–12
Education, 2nd edn., ASCD, Alexandria, VA.
Vernon, D. T., and Blake, R. L. (1993). Does problem-based learning work?: A meta-analysis
of evaluative research. Acad. Med. 68: 550–563.
Vye, N. J., Goldman, S. R., Voss, J. F., Hmelo, C., and Williams, S. (1997). Complex math
problem-solving by individuals and dyads: When and why are two heads better than one?
Cogn. Instr. 15: 435–484.
Webb, N. M., and Palincsar, A. S. (1996). Group processes in the classroom. In Berliner,
D., and Calfee, R. (eds.), Handbook of Educational Psychology, MacMillan, New York,
pp. 841–876.
Wenger, E. (1998). Communities of Practice: Learning, Meaning, and Identity, Cambridge
University Press, New York.
White, B. Y., and Frederiksen, J. R. (1998). Inquiry, modeling, and metacognition: Making
science accessible to all students. Cogn. Instr. 16: 3–118.
Williams, S. M. (1992). Putting case based learning into context: Examples from legal, business,
and medical education. J. Learn. Sci. 2: 367–427.
Williams, S. M., Bransford, J. D., Vye, N. J., Goldman, S. R., and Carlson, K. (1993). Positive and
negative effects of specific knowledge on mathematical problem solving. Paper presented
at the American Educational Research Association Annual Meeting, Atlanta, GA.
Zimmerman, B. (2002). Becoming a self-regulated learner: An overview. Theory Pract. 41,
64–71.