The Cognitive Theory of Multimedia Learning PDF
The Cognitive Theory of Multimedia Learning PDF
The Cognitive Theory of Multimedia Learning PDF
discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/267991109
Article
CITATIONS READS
12 164
1 author:
Stephen Sorden
Chinle Unified School District, Chinle, Arizona
6 PUBLICATIONS 85 CITATIONS
SEE PROFILE
All content following this page was uploaded by Stephen Sorden on 13 July 2016.
The user has requested enhancement of the downloaded file. All in-text references underlined in blue are added to the original document
and are linked to publications on ResearchGate, letting you access and read them immediately.
The Cognitive Theory
of Multimedia Learning
Stephen D. Sorden
Mohave Community College/Northern Arizona University
Abstract
Multimedia learning is a cognitive theory of learning which has
been popularized by the work of Richard E. Mayer and others.
Multimedia learning happens when we build mental
representations from words and pictures. The theory has largely
been defined by Mayers cognitive theory of multimedia learning.
Generally, the theory tries to address the issue of how to structure
multimedia instructional practices and employ more effective
cognitive strategies to help people learn efficiently. Baddeleys
model of working memory, Paivios dual coding theory, and
Swellers theory of cognitive load are integral theories that support
the overall theory of multimedia learning. The theory can be
summarized as having the following components: (a) a dual-
channel structure of visual and auditory channels, (b) limited
processing capacity in memory, (c) three memory stores (sensory,
working, long-term), (d) five cognitive processes of selecting,
organizing, and integrating (selecting words, selecting images,
organizing work, organizing images, and integrating new
knowledge with prior knowledge), and theory-grounded and
evidence-based multimedia instructional methods. Important
considerations for implementing the theory are discussed, as well
as current trends and future directions in research.
Introduction
The cognitive theory of multimedia learning was popularized by
the work of Richard E. Mayer and other cognitive researchers who
argue that multimedia supports the way that the human brain
learns. They assert that people learn more deeply from words and
pictures than from words alone, which is referred to as the
multimedia principle (Mayer 2005a). Multimedia researchers
generally define multimedia as the combination of text and
pictures; and suggest that multimedia learning occurs when we
build mental representations from these words and pictures
(Mayer, 2005b). The words can be spoken or written, and the
pictures can be any form of graphical imagery including
illustrations, photos, animation, or video. Multimedia instructional
design attempts to use cognitive research to combine words and
pictures in ways that maximize learning effectiveness.
Cognitive Theory of Multimedia Learning
2
Cognitive Theory of Multimedia Learning
3
Cognitive Theory of Multimedia Learning
4
Cognitive Theory of Multimedia Learning
Meaningful Learning
Mayer (2010a) argues that meaningful learning from words and
pictures happens when the learner engages in five cognitive
processes:
5
Cognitive Theory of Multimedia Learning
Cognitive Load
The limited capacity assumption states that there is a limit to the
amount of information that can be processed at one time by
working memory. In other words, learning is hindered when
cognitive overload occurs and working memory capacity is
exceeded (De Jong, 2010).DeLeeuw & Mayer (2008) theorize that
there are three types of cognitive processing (essential, extraneous,
and generative)and place them in the triarchic model of cognitive
load. Mayer (2009) made this model the organizing framework for
the cognitive theory of multimedia learning and stated that a major
goal of multimedia learning and instruction is to manage essential
processing, reduce extraneous processing and foster generative
processing ( p. 57).The model is heavily based on Swellers
cognitive load theory (Chandler & Sweller, 1991; Sweller, 1988,
1994).
6
Cognitive Theory of Multimedia Learning
7
Cognitive Theory of Multimedia Learning
8
Cognitive Theory of Multimedia Learning
9
Cognitive Theory of Multimedia Learning
10
Cognitive Theory of Multimedia Learning
the theory have not changed. In fact, the theory appears to have
matured as it enters its third decade of active research and is finally
reaching a consistently recognizable state.
11
Cognitive Theory of Multimedia Learning
12
Cognitive Theory of Multimedia Learning
Learner-Centered Focus
A critical perspective to maintain while designing multimedia
lessons according to CTML is that the multimedia instructional
methods are learner-centeredthey are not technology-centered
approaches. Mayer (2009) reminds us that multimedia can be as
simple as a still image with words and that it is the instructional
method, not the technology that matters. Multimedia instructional
designers often fall victim to letting the technology drive the
instructional design, rather than looking at the design from the
perspective, and limitations, of the learner.
13
Cognitive Theory of Multimedia Learning
14
Cognitive Theory of Multimedia Learning
Task Analysis
Task analysis is tied to the concepts of schemas and levels of
expertise. The multimedia lesson should try to ensure that the
learner has sufficiently automated key core knowledge or tasks.
The learner should do this before trying to tackle an overall task
that may be beyond the learners current ability range, which could
cause unnecessary frustration and possibly even cause the learner
to drop out of the activity. The theories of Vygotskys Zone of
Proximal Development and Piagets concept of scaffolding can be
applied here. This suggests that a task analysis should be done
during the instructional design of a multimedia lesson in order to
breakdown the skills and information that are needed to learn or
perform the educational objective.
Guided Instruction
According to CTML, guided instruction and worked examples are
preferable to discovery learning, even though other learning
theories often support discovery learning as a useful component of
multimedia instruction. Mayer (2004; 2011a) and Kirschner,
Sweller, & Clark (2006) caution against using discovery learning
and argue that guided instruction is much more effective. Mayer
(2011a) presents four principles for studying by practicing that
support this idea. The four principles supporting guided instruction
are spacing, feedback, worked example, and guided discovery.
Interactivity
While the principle of interactivity still requires more research,
much of the literature suggests that infusing interactivity such as
learner control, feedback, and guidance into a multimedia lesson
15
Cognitive Theory of Multimedia Learning
16
Cognitive Theory of Multimedia Learning
17
Cognitive Theory of Multimedia Learning
Critique
There are critics of the theory, however, and the use of multimedia
for instruction has been challenged (Clark & Feldon, 2005; Tufte,
2003). Ballantyne (2008) has criticized the narrowness of some of
the CTML studies and whether the principles derived from CTML
research can be applied in broader, more realistic settings.
Additionally, striking at the very heart of the cognitive theory of
multimedia learning, Rasch & Schnotz (2009) were not able to
show that students actually learned better from text and pictures
than from text alone, calling the multimedia principle itself into
question. They also could not show that students learned better
from interactive pictures than from non-interactive ones.
Gall (2004) points out that Mayers research has tended to focus
mainly on the understanding of physical and mechanical systems,
and thus raises the question of how applicable his results are to
nondidactic, immersive learning environments. This criticism of
whether results obtained in controlled experimental situations can
be applied to dynamic classrooms and learning environments is an
old complaint that has been leveled at psychology since
psychologists first began studying and trying to measure learning.
Often, these charges of non-relevance to real-life learning and
instruction have been justified. But Mayer is careful not to claim
that his research should be seen as the final word on instruction in
the situations he is trying to measure. Rather, it is obvious in the
evolution of the cognitive theory of multimedia learning that they
are only trying to determine what appears to make a difference in
learning situations, hypothesize about it, and then continue to look
for better explanations and hypotheses. The theory is dynamic and
the expectation that it will continue to grow, adapt, and change
appears frequently in the literature.
18
Cognitive Theory of Multimedia Learning
19
Cognitive Theory of Multimedia Learning
Possibly a holy grail for CTML and CTL researchers in the near
future will be the quest to find evidence of three separate cognitive
load processes (essential, extraneous, generative) and how to
measure them reliably (Brnken, Plass, & Leutner, 2003;
Antonenko, Paas, Grabner, and van Gog, 2010). A recent study by
Antonenko & Niederhauser (2010) found that measuring overall
cognitive load with self-reports may not be adequate. Instead, they
suggest that cognitive load should be viewed as a dynamic process
and assessed with EEG-based measures to provide a more
complete picture for explaining the causes and effects of cognitive
load.
20
Cognitive Theory of Multimedia Learning
As de Jong (2010) and Mayer (2010b) point out, there are many,
many unresolved issues in CLT and CTML research, which means
that the field continues to be wide open and should provide a
challenging and stimulating area of research for many years to
come. De Jong suggests that research in CLT should now turn to
finding load-reducing approaches for intensive knowledge-
producing strategies such as learning from multiple
representations, self-explanations, inquiry learning, or game-based
learning which all stimulate germane (generative) processes. While
speaking to cognitive load theory, de Jongs recommendation for
future research can be applied as easily to the cognitive theory of
multimedia learning in determining: (1) which instructional
treatments lead to which cognitive processes (and how), (2) what
the corresponding effects are on memory workload and potential
overload, (3) what characteristics of the learning material and the
student mediate these effects and (4) how best to measure effects
on working memory load in a theory-related manner (p. 127).
21
Cognitive Theory of Multimedia Learning
Conclusion
The cognitive theory of multimedia learning has progressed over
the past two decades and is poised to become a mature, robust
theory as it enters its third decade. Fortunately, the theoretical
cognitive foundations upon which the theory is based go much
further back and have contributed heavily to its framework of the
big three sciences, as well as the structure given to its principles
by the triarchic theory of cognitive load. Together, these two areas
of study form what we generally understand today to be the
cognitive theory of multimedia learning.
The theory is expanding into exciting new areas that will allow it
to continue to evolve. Its learner-centered and cognitive-
constructivist orientation makes it very relevant in current
educational applications. The fact that it focuses on finding
effective instructional methods rather than a specific technology
makes it a dynamic theory that will allow it to expand well beyond
the life cycle of any particular technology.
22
Cognitive Theory of Multimedia Learning
References
Antonenko, P. D., Paas, F., Grabner, R., & Van Gog, T. (2010).
Using electroencephalography to measure of cognitive
load. Educational Psychology Review, 22, 425-438.
23
Cognitive Theory of Multimedia Learning
Chandler, P., & Sweller, J. (1991). Cognitive load theory and the
format of instruction. Cognition andInstruction, 8(4), 293-
332.
Clark R.E., & Feldon, D.F. (2005). Five common but questionable
principles of multimedia learning. In R.E. Mayer (Ed.), The
Cambridge Handbook of Multimedia Learning. New York:
Cambridge University Press.
24
Cognitive Theory of Multimedia Learning
Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003). The
expertise reversal effect. Educational Psychologist, 38, 23-
32.
25
Cognitive Theory of Multimedia Learning
Mayer, R. E., Bove, W., Bryman, A., Mars, R., & Tapangco, L.
(1996). When less is more: Meaningful learning from
visual and verbal summaries of science textbook lessons.
Journal of Educational Psychology, 88, 64-73.
27
Cognitive Theory of Multimedia Learning
28
Cognitive Theory of Multimedia Learning
Paas, F., Renkl, A., & Sweller, J. (2004). Cognitive load theory:
Instructional implications of the interaction between
information structures and cognitive architecture.
Instructional Science, 32, 1-8.
29
Cognitive Theory of Multimedia Learning
30
Cognitive Theory of Multimedia Learning
Yuan, K., Steedle, J., Shavelson, R., Alonzo, A., & Oppezo, M.
(2006). Working memory, fluid intelligence, and science
learning. Educational Research Review, 1, 83-98.
31