ED535224
ED535224
ED535224
This report is based on discussions from a series of Workshops organized by the Center
for the Study of Mathematics Curriculum (CSMC). CSMC is supported by the National
Science Foundation under Grant No. 0958058. Any opinions, findings, conclusions or
recommendations expressed in this report are those of the author(s) and do not
necessarily reflect the views of the National Science Foundation.
Table of Contents
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Appendix:
In 2009-10 a series of Workshops was organized to focus on STEM learning design for
young students and adolescents. The objective was to provide visionary leadership to the
education community by: (a) identifying and analyzing the needs and opportunities for
future STEM curriculum development and instructional design given current and
emerging technologies; and, (b) recommend policy positions and actions by funding
agencies and the STEM research and development community regarding STEM
instructional resources. Specific questions addressed included:
• What will a high-impact, technology-intensive STEM learning
environment look like in the near and long-term future?
• What materials development and research are required to make this vision
possible?
• What design, development, and diffusion processes are most likely to produce new
approaches to STEM education?
To address these questions, two workshops were convened to identify and analyze the
needs and opportunities for innovative work. The goal was to identify strategies,
directions and recommendations about the future of STEM instructional design.
Participants included education futurists, researchers in the STEM content and education
disciplines and specialists in instructional technology, cognitive psychology, policy,
museum and educational media (see Appendix for complete list of Workshop
participants).
The first Workshop solicited perspectives from key progressive thinkers in STEM
education and instructional technology regarding the first two questions noted above.
A set of five reflection papers resulting from the discussions are available at:
http://www.mathcurriculumcenter.org/conferences/stem/index.php
The second Workshop focused on articulating a research and development agenda for
STEM learning designers. Building upon the visions for future STEM educational
environments described in the first Workshop, participants identified high priority work
(research and development) needed to capitalize on technological advances and
produce/deliver/use the next generation of curriculum and instructional tools and
environments for advancing STEM learning in formal (school) and informal (museums,
community centers, etc.) settings (and across settings).
This report provides a summary of the ideas generated by Workshop participants and
offered to the STEM instructional design community and to agencies that fund this work.
The rapid growth in features and use of educational media (from e-books to applets) makes it
possible to envision dramatic changes in the kinds of instructional environments in support of
STEM learning. For example, it is conceivable that a totally interactive, continually up-
datable e-book (linked to numerous external sources of data, images, and research tools) will
provide more inviting and effective learning environments than the conventional printed
textbooks that students currently tote from class to class and home and back. It is also
conceivable that a science, technology, or mathematics classroom that engages students in
regular communication with teachers, other students, scientists, engineers and
mathematicians, and makes accessible data from around the world could be more engaging
and effective than an environment bound by the walls of conventional classrooms. Old
boundaries may become less relevant, even as new knowledge generated by the learning
sciences opens new paths for personalized learning. Effective use of such new instructional
resources will require rethinking the ways that education is delivered and managed. Most
important, those new ideas and their embodiments in experimental instructional resources
must be developed and carefully tested before it makes sense to implement broad
transformation of STEM learning both in and out of schools.
The demands for broad STEM education of all students are accompanied by an expectation
that today’s learning institutions will provide enhanced STEM education to students from
very diverse cultural, linguistic, and socioeconomic backgrounds. These demands are a
significant challenge for developers of curricula and instructional materials. New
instructional designs must be developed in ways that broaden access and increase rich
learning opportunities for all students. They must also connect with and take advantage of
the interests and extracurricular experiences of students growing up as cyber-savvy digital
natives.
• What kinds of research and development work should be encouraged and sponsored
in order to assure that educational experiences and practices reflect the best of
current knowledge about the STEM disciplines, STEM learning, and STEM teaching?
• What advances in the practice of curriculum and instructional design research,
development, and evaluation will be required to assure that investments in that work
produce relevant and useful results?
• How can funding agencies and professional organizations best stimulate, respond to,
and develop the community of STEM educators to assure that important innovative
curriculum and instructional material development and research is conducted and
widely disseminated in a timely manner?
• What kinds of projects can both develop new instructional design ideas and materials
and successfully facilitate implementation of those innovations so students will be
well prepared for the demands and opportunities of future study, work, and personal
life?
To consider these important questions, two workshops were convened. Participants of the
first STEM Workshop focused on needed research in four areas:
STEM Learning Goals for a Technology-Enhanced Society and Educational System. How
does the emerging information, communication, and technology-driven environment change
the nature and relevance of STEM learning goals for students and thus the objectives of the
various educational institutions they will encounter? What new organizations or sequences
of core curriculum are viable and relevant? What topics within the STEM disciplines should
receive increased attention, less attention? What is the impact of new (or current)
technologies on the prioritization of learning goals? For example, if young students use
technology to calculate or do symbol manipulation, how does it change their view and
understanding of important mathematical concepts (e.g., place value, meaning of operations,
“symbol sense”)? What are the critical core knowledge areas that cut across multiple
disciplines (e.g., mathematics, science, literacy and social studies at the elementary level) and
represent a “thin core” of vital STEM learning goals? In what ways does integration across
multiple disciplines strengthen or enhance student motivation and learning outcomes?
STEM Digital Textbooks/Learning Tools for Students. The next generation of instructional
resources will likely be delivered through current or new forms of technology (e.g., laptop
computer, iPad) that support technology-based features and options (e.g., applets for
STEM Teachers as Learning Guides. How will digital curriculum resources shift thinking
about teaching and what implications do they have for the professional development of
teachers? In what ways can technological tools be used to support teachers’ customization of
curriculum and instructional resources? Can new technologies provide data to support
teachers’ understanding of their students’ grasp of content? How can technology be used to
support teachers’ learning? What opportunities does technology offer in connecting teachers
within professional learning communities?
A summary of needed research and development in each of these four areas follows. The
summaries were compiled based on Working Group discussions held during the second
STEM Workshop.
The notion of a “thin core” for the curriculum, raised in the first Blue Sky Workshop3,
was a way of expressing the need for a rich curriculum that leaves room for additional
topics of interest of individual students. It might be compared to the college model: a thin
core, plus room and requirement for greater depth in areas jointly negotiated by students
and faculty.
The task for the Working Group was to give some definition to this thin core—not to
specify it, but to make the thinking concrete enough to suggest possible directions in
which research and/or development might proceed. The initial discussions focused on the
implications of a “thin core” – is it a viable idea? How thin can it be?
Even such broad questions can be researched, if they are operationalized. It was
suggested that, for example, “what can be ‘left out’ of a core (of any thickness)” can be
investigated by experiment: leave out a reasonable candidate and examine the
consequences. The difficulty of performing such experiments is obvious - if we really
don’t know the consequences, it would be hard for researchers to propose such an
experiment, unlikely for reviewers to accept it ethically, and unimaginable for schools to
sign on. Curricular change is naturally conservative, partly because one does not know
the consequences of omitting things that (seem to) have served the population in the past.
An important distinction exists between content that’s on a list of standards (the official
“thin core”) and ideas that make up a curriculum to achieve those standards. The core is
to be thin so that the curriculum can be rich. Designers of curriculum, not standards, often
face this distinction. A standard can specify, for example, merely that children learn to
multiply: the curriculum can use array images and connect this model with area; it can
use pairings (e.g., flavors of ice cream and toppings, word parts, Lego towers) and
images that foreshadow ideas from other parts of mathematics. The standard is limited—
thin!—but the curriculum that “delivers” that standard can be quite rich.
In preparation for the discussion, the Working Group raised and addressed the following
questions:
New technology exists; students will likely have access to it; the technologies give kids
access to knowledge, each other, computational power, visualizations, simulations, a
tsunami of data (not often well organized, not necessarily accurate); educational settings
can be less rigid, more creative, more integrative, more inclusive of diverging talents and
interests, more responsive to the available resources. The fundamental question is, “How
2
Working Group Members: Janice Earle, Jim Fey, Brad Findell, Paul Goldenberg, Barbara Reys, Jo Ellen
Roseman, Peter Turner and Zalman Usiskin.
3
The “Blue Sky” or First Workshop was held December 1-3, 2009 in Lansdowne, Virginia. For a full
report see: http://www.mathcurriculumcenter.org/conferences/stem/index.php
This was partly a question about focus, and came up multiple times in different contexts.
Race To the Top funding requires that states make Common Core State Standards
(CCSS) 85% of their program, but are “free” to use the other 15% as they like. But
assessment, especially if it is connected to accountability, drives many school decisions.
Unless schools must add variety in the other 15%—which is to say, unless the tests
reward them for doing so and punish them for not doing so—their entire curriculum will
consist of the “thin core.”
What criteria should be drawn upon for deciding, within a discipline, what should
or should not be in the essential (thin) core?
One consideration is with regard to the purpose of acquiring knowledge - for citizenship,
career, and/or scholarship? We agreed that the core should be coherent, regardless of its
thinness or thickness. What's important is to identify a set of conceptual models that are
"good enough" for students to use to think about phenomena at a particular grade range.
Logic can be used to estimate what the elements of a "good enough" model might be, but
ultimately this is an empirical question.
What are the implications of different visions of the thin or essential core?
Might the nature or meaning of thin (or essential) core be differentiated across the
grades? Two opposing arguments were made about the organization of instruction and
the question about grade levels. On one hand, young students natural learning tendencies
are not bounded by artificial categories. Putting mathematics, science, making things, or
even language into separate boxes may be artificial and unhelpful. Perhaps that is where
the integration of content would work best. On the other hand, children know there are
categories, even when they are very young. What does and does not constitute science, as
opposed to opinion or story-telling, needs to be established while children are creating the
meaning of that word. The same argument applies in mathematics - the mathematics one
naturally encounters while working on age-appropriate projects in science or engineering
would be limited and not likely to include anything about the structure (orderliness,
pattern) behind age-appropriate mathematical ideas.
This question has been debated for some time. It can be operationalized by asking: What
are the affordances of using a disciplinary approach versus a non-disciplinary approach in
defining some core requirements? What are the nature and affordances of a mixed
strategy?
In the very near future the core set of instructional materials used in schools and in other
environments to guide and monitor K-12 mathematics learning will be interactive digital
texts or modules. As the medium for learning materials shifts from print to digital,
opportunities arise for advances in mathematics teaching and learning.
Although the term “digital text” is used in this report, it represents a broad and far-
reaching learning tool including (but not limited to): multi-media, interactivity,
customization and adaptive systems, storage of information by and about student work,
and intelligent agents. Future core instructional materials will be “delivered” through
current or emerging technologies (e.g., laptop computer, iPad) that support a variety of
features and options such as probes, applets for simulation and visualizing physical
phenomena and mathematical ideas, tasks permitting reasoning with multiple
representations, links to additional information and video clips related to the context of
problems, short video clips of master teachers or scientists introducing or applying ideas.
Four overarching questions are discussed here to provide background and context for
recommendations regarding needed research and development efforts.
What are viable possibilities for future digital resources given current and
emerging technologies, and what are features that show promise for further
development and/or customization?
Digital resources in the future should take advantage of a platform that allows connection
between the teacher and student environment as well as use of content tools and digital
media. Use of multiple representations and tools such as simulations, mathematical tools,
animations, and visualization models should be standard. Digital resources drawing from
Universal Design for Learning could include features such as learner-controlled
scaffolding for tasks, use of text-to-speech software that reads aloud the written digital
text, and translation software that translates from one written language to another. Digital
resources could support students’ texting questions to each other and to the teacher on a
monitored network using mobile devices. Other communication and collaboration digital
resource ideas incorporate public and private student work environments, a network of
embedded links allowing immediate access to specific sections within the resource
(including a glossary), and means for transmitting homework between teacher and
4
Two Working Groups focused on this topic independently and took slightly different directions in their
discussions. This report represents the ideas and recommendations that emerged from both Working
Groups. Members of Group A: Dave Campbell, Jere Confrey, Chad Dorsey, A.J. Edson, Mike Haney,
Chris Hirsch, Joe Krajcik, Chris Rogers, Susan Jo Russell. Members of Group B: Jacqueline Barber, Bill
Finzer, Glenda Lappan, Robert Reys, Jeremy Roschelle, Gerhard Salinger, Gabbie Schlichtmann, Louisa
Ann Stark, Eric Wiebe.
“Intelligent agents” (IA) provide another venue for supporting STEM learning. The term
defines a wide range of tools or applications that deliver customized support and are used
everyday by millions of individuals (e.g., search applications by Google, texting
correction tools on the Apple iPhone, URL completion tools on Firefox web browsers,
movie recommendations on Netflix). They are often embedded in the interface of a tool,
not front and center. They can be thought of as intelligent media or embedded advice that
directly supports both students and teachers, though often in different ways.
Some technical challenges include the design behind the usability of different devices,
such as the interconnectability of cloud computing, standards, and sharing of digital
resources. Challenges in the use of digital resources in classrooms include a lack of
access in many schools to consistent, up-to-date technology and barriers to deploying
such technology (e.g., IT support staff). Teacher professional development is also needed
to change the mindset toward the use of digital resources as well as provide expertise in
their use. In addition, it is essential that changing public expectations of schools precede
serious attempts at changing the nature of schools. This highlights the need to include
administrators, parents, and community members in the discussion. Other challenges
include strategic use of data and the need for data management (e.g., servers, data size,
and security).
We suggest support for the development of three or four digital resource platforms for
different STEM disciplines. Digital platforms for each discipline could then be
customized by a particular curriculum development project. One advantage is that these
base templates would reduce technical development time and expense for individual
projects and accelerate small-scale initial trials. Another advantage is that each discipline
could customize the platform and increase the connections between the technological
differences of separate projects. In terms of dissemination, the platform could be
distributed to many more classrooms and be accessible to a wide range of devices. Some
questions include: Will curriculum development slow while the development of platforms
is happening? What about satellites for digital platforms that could be accessed by
curriculum developers with content and R&D knowledge/expertise? Key ideas to be
addressed include the likely involvement of smaller companies in the creation of
interactive designs with the intent that they would be an open source open access. What
are the advantages and disadvantages of platforms designed to be open access instead of
open source, allowing a slice of the market to update and extend the digital resources and
provide continued support revenue for professional development?
Curriculum designs could capitalize on the promising design principles of the NSF-
funded curriculum materials of the 1990s and their later editions and be adapted for
digital resources. This approach would reinforce the need for partnerships between
curriculum specialists and computer scientists. Multiple questions arise: How do we
connect prior knowledge with digital resources to students? How do we identify
“interesting problems”? How do you ensure student-student interaction with digital
resources? How do you “digitalize” our current successful work and not just “pdf” it?
How do you allow personalized learning without losing sight of the end learning goal?
How would our model (curriculum, theory, implementation, outcomes) for assessment
have to change in this new medium? Are elements missing, such as interface with
technology and school? What metrics would be used?
2. In what ways can digital texts lead to students and teachers having a coherent and
comprehensive understanding of STEM content and processes?
− How can we support students to be metacognitive, intentional, and self-
regulating in their learning with digital texts?
− How can digital technologies be used to engage students while accommodating
individual differences?
− What are the issues around equitable access and digital texts?
3. What would a digital learning environment look like that supported students engaged
in the process of science, mathematics, and engineering in asking questions, learning
big ideas, and collecting and analyzing data in order to use evidence to develop
arguments? What suites of tools should be assembled to create such an environment?
− What are the unique challenges of combining these tools into an environment to
support student learning?
− What unique opportunities arise from the integration of these
tools/environments?
− What kinds of supports are needed to help students navigate the range of tools
in such an environment?
− What tools can be integrated into such an environment to support teacher
feedback (assessment) to students?
4. What challenges are posed for teachers and students in working within such an
environment?
− What scaffolds are necessary to support teachers and students in working with
and integrating information and learning among a mix of tools?
− How can teachers efficiently collect information about student learning and
provide timely, useful feedback?
− How can teachers support differentiation in this environment?
− How do you ensure coherence within environments that are student-controlled
and collaborative?
− How do non-linear presentations of content support student learning? What
unique challenges are posed by these presentations?
5. How
can
digital
texts
support
teachers
in
developing
their
own
understanding,
pedagogical
skill,
and
confidence
in
using
appropriate
learning
experiences?
− In what ways can digital texts support and increase teachers’ use of effective
teaching methods and pedagogical knowledge? For example, multimedia
materials that model best practices, provide glimpses of instruction in the
classroom, video case studies showing ways other teachers have responded to
specific teaching and learning challenges.
− In what ways can digital texts support teachers’ understanding and use of
pedagogical content knowledge in their teaching? For example, visualizations
What does it mean for STEM teachers to serve as “learning guides?” Mischaracterization
could convey a false conception of teachers as ”peripheral” in the education process,
particularly to novice teachers or to the general public. The working group agreed that
when the teacher functions as a learning guide, he or she acts as a mediator in the
learning process. We developed the following description, framed around How People
Learn (Bransford, Brown, & Cocking, 1999).
The learning guide engages students for learning (both intellectually and
physically), develops understanding of important content in a meaningful
storyline, and facilitates meaning-making by organizing and relating knowledge.
Engaging students is best done in a culture of respect where the learning guide models
and guides appropriate behavior. Learners and guides support and encourage others to
share, develop, and respectfully challenge ideas in a non-personal manner. Learning
guides encourage all students to volunteer their examples, ideas, justifications, analyses,
and conclusions. Students and the guide jointly make decisions about procedures for
investigation and next directions for investigation.
The learning guide focuses learners on the development of important core content. There
is a clear sequence of activities for development of a coherent story line of ideas and
skills that makes sense to learners. Ideas are based on phenomenological experiences and
developed to organize and understand a range of phenomena. Technical terms are
introduced after ideas are developed and terms are used for ease of communication after
learners understand the ideas.
The guide helps learners organize and relate knowledge and skills for ready access in
subsequent learning opportunities and applications. The guide accesses learners’ prior
ideas and adapts activities to address learner needs. Connections are made to prior
experiences and to future applications and learning opportunities. Multiple forms of
representation are used to organize and understand ideas.
The learning guide effectively uses dialogic interaction to stimulate and guide learning.
Guides listen respectfully and critically to understand learners and identify their needs.
Questions and questioning are encouraged and used to clarify meaning, to motivate
inquiry, and to promote deeper understanding and design. Learners are guided to justify
their conjectures, to explain why and how their ideas make sense, and to know the
conditions of when one idea or procedure applies and when it doesn’t.
5
Members: Spud Bradley, Kim Lightle, Gladis Kersaint, Alan Maloney, Jim Minstrell, Jeff Shih, Amanda
Thomas, Elizabeth Vanderputten, Iris Weiss, Carla Zembal-Saul.
When teachers are effective as learning guides, the complex decision making and expert
knowledge underlying their practices is often transparent to the observer and tacit to the
teacher. Accordingly, it is essential to delineate the features and identify levels of mastery
associated with the construct of teacher as learning guide. Video-based cases can provide
images of the possible (Hatch & Grossman, 2009) and complement research
protocols/instruments. Having a shared words-to-images framework (Roth, Lemmens, &
Garnier, 2009) has the potential to support a common language among researchers and
teacher educators, as well as facilitate the development of research tools that can be used
across sites/settings to investigate STEM teachers, teaching, and teacher development.
Cases and protocols would need to account for where teachers are in their careers, and
possibly place them along a trajectory of development toward mastery in the role of
teacher as learning guide.
Assumptions
This vision of teacher as learning guide leads to several assumptions about the complex
environment in which learning guides must function. Recommendations for research and
development that follow assume the following:
• The content for which learning guides are responsible is part of a ”thin core.”
• Learning guides may not be knowledgeable about important content that connects
and spans all of the STEM areas.
• Learning guides need support to use formal instructional materials (e.g.,
textbooks, teacher guides, manipulatives) to their fullest potential.
• Learning guides function within a complex system that includes high stakes
accountability and extensive public scrutiny, which may at times facilitate and at
other times interfere with attention to individual student needs.
Educators at different levels are already exploring Web 2.0 technologies, applications,
conceptualizations, and collections of resources – for instance, a number of K-12
educators are using blogs and wikis to engage their students in authentic timely responses
to real-world events and experiences. Coupled with increased student use of social
networking sites like Facebook, there is an emerging convergence between social
phenomenon and educational practices. It is important to design content, tools, and
applications so that the entire experience becomes a catalyst for change and supports
improvement efforts in STEM classrooms.
3. What does the learning guide need in order to support increased student learning?
− What experiences and scaffolding do learning guides need to develop the skills
and habits of mind that enable them to meaningfully integrate digital tools into
their own classroom instruction?
− What technological tools are needed to collect the data to address critical teaching
and learning questions?
− In addition to developing tools, there must be ongoing assessment of the many
facets of the tool and its application. How do we know when a tool is effective?
Under what conditions or with what users is it effective?
− To what extent can technology help the learning guide anticipate or know how
students might respond to instructional events? How does the learning guide
interpret student responses in terms of strengths as well as the problematic aspects
of students’ thinking? How can technology provide feedback to the learning
guide to make instructional decisions on the fly? What support can be made
available for learning guides to adjust lessons to address students’
misconceptions?
− What are the consequences of learning guides’ choices regarding scope and
sequence of STEM content? How can technology inform the learning guide about
the tradeoffs inherent in these decisions? Can an application be developed to
highlight the implications of curricular sequencing (e.g., “By sequencing content
as proposed, the following concepts are not addressed…”)?
− How can technology help the learning guide weave elements such as big ideas,
objectives, and key questions to develop a coherent content storyline? What kind
of supports can be packaged with curriculum materials to help them discern
coherent content storylines?
4. How can professional development promote and support the learning guide?
− What tools do learning guides need to inform their own teaching and learning?
How can technology allow for the learning guide to continue learning content in
deeper and different ways while improving practice?
− What are the challenges that learning guides face in making effective use of
digital resources in their own professional development as well as for supporting
diverse learners?
− How can professional development promote and support the learning guide to
help students develop competency with unifying STEM threads such as data
analysis, modeling, and heterogeneous approaches to problem solving? How can
professional development support STEM educators in creating learning contexts
that build robust quantitative thinking across the STEM content areas?
− What are the challenges that learning guides face in making effective use of
digital resources in their own professional development as well as supporting
learning for diverse students?
Bransford, J., Brown, A., Cocking, R. (Eds.). (1999). How People Learn: Brain, Mind,
Experience, and School. Washington, D.C.: National Academy Press.
Hatch, T. & Grossman, P. (2009). Look beyond the boundaries of representation: Using
technology to examine teaching (Overview for a digital exhibition: Learning from
the practice of teaching). Journal of Teacher Education, 60(1), 70-85.
Minstrell, J., Anderson, R., Kraus, P., and Minstrell, J.E. (2008). Bridging from Practice
to Research and Back: Tools to Support Formative Assessment. In J. Coffey, R.
Douglas, and C. Sterns (Eds.) Science Assessment: Research and Practical
Approaches. NSTA Press.
Roth, K., Lemmens, M., Garnier, H. (2009). Tying words to images of science teaching
(TWIST). Retrieved from http://cse.edc.org/dr-
k12/Docs/2009docs/Resources/Poster_Roth_Twist.pdf
We were particularly interested in how the existing boundaries between in-school and
out-of-school learning can be broken down. We acknowledged the learner-directed,
project-based inquiry embodied in such movements as the “maker-culture”. We also
6
Working Group Members: Julie Benyo, Marta Civil, Andy diSessa, David Hanych, Margaret Honey,
Sharon Lynch, Bill Neufeld, Brian Smith, Didem Taylan and Adam Z. Tobin.
7
See: http://www.mathcurriculumcenter.org/PDFS/ReflectionSTEMblueSky.pdf
As Mike Haney pointed out, if members of the formal education community (i.e.
curriculum developers, teachers, policy makers) don’t find ways of somehow validating
out-of-school learning, it will self-validate, and quite possibly in ways that are not
consistent with in-school curricula. If schools are to participate in a larger, more
integrated learning ecology, two critical areas for research and development must be
addressed: 1) How to introduce some form of STEM curricula into informal learning
environments, and how to introduce it in a way that honors student agency, student-
directed learning and does NOT transform these environments into schools; 2) How to
recognize/validate informal learning from within the formal education system. We
suggest that if we are to fully realize the potential of this larger ecology of learning, in-
school and out-of-school learning cannot be as cleanly bifurcated as they are now.
The most challenging barriers are not technological, they are largely not fiscal, rather
they are barriers of infrastructure, professional development, and culture. The tools,
curricula, technologies, materials and even teaching professionals of in-school and out-
of-school environments are currently developed in near complete isolation from one-
another. Tools, materials and professional development programs that bridge the
boundaries between formal and informal learning environments are necessary. For
example, we talked specifically about the need for technologies that work well for both
in-school and out-of-school environments. These tools would be built upon core
functionality that is then extensible, customizable, and subvertable enough to adapt to
multiple environments/settings.
More than anything, we need to create the right conditions for a willingness on the part of
both in-school and out-of-school educators to work with each other. With regards to in-
school environments, attempts at integration in ways that pose any additional challenges
in the classroom will not be well received by teachers. With regards to out-of-school
environments, we must not integrate in way that makes out-of-school environments begin
to feel like a conventional school classroom. Successful integrations will take into
account real challenges on the ground, directly addressing issues of infrastructure and
culture, and directly addressing existing needs of schools and teachers. One suggested
approach is that of partnership, asking this question of schools and classroom teachers:
“What can we help you with?” That is, informal communities should be positioned as
resources for in-school educators. Particularly from the standpoint of the teacher in the
formal classroom, how can participation in a larger ecosystem support them in the
classroom as opposed to creating additional challenges? Conversely, in what way could
the introduction of STEM curricula build specific content understanding within the
We talked about the immediate possibilities to build relationships between formal and
informal professionals. Sharing of tools, materials, technology, and even professional
staff will build bridges. We could begin immediately by finding ways of getting
members of the larger community into classrooms and facilitating movement of teachers
out of the classroom and into the Cultural Commons. We recognize that professional
development is a key component to making these programs successful, and we see these
types of exchanges as a potential first step in the professional development of teachers. A
logical next step would be to professionally develop teachers/educators/facilitators so that
they are natively comfortable in both in-school and out-of-school educational settings.
4. What models can be developed that allow for the ongoing integration of emerging
technologies into learning environments?
We have a short window of opportunity to prepare for, and interpret to our STEM
education community of researchers and practitioners, what should occur between the
impending release of the Common Core State Standards and the development and
implementation of the new generation of assessments slated for 2015. We need to draw
on the expertise of the community to identify the lessons learned both about technology
development and curricular materials that can help us refine our strategic priorities during
this precious interval of opportunity. Given the current state of development, it appears
that we need to hedge our bets on the Common Core State Standards, at least in
mathematics: simultaneously treating them as they are intended - a means to accomplish
fewer, clearer and higher standards - and as potentially too conservative (based on their
omission of adequate attention to a) probability and statistics and early algebra in early
grades, b) modeling, and c) use of technology). Thus, we need to view the impending
four- to five-year interval as an opportunity to 1) transition the field to common standards
and 2) make good and aggressive use of the non-determined 15% of standards left to
individual states, to accomplish some of our most cherished goals. The message is: we
must move this agenda forward, with and in front of the proposed first generation
common standards.
But before I could reflect on this challenge and discuss the components of new generation
materials, I needed to clarify and express my overriding goals for education. That is,
schooling is about modeling our world, encouraging active citizenry, building
opportunities for expressiveness, fostering collaboration, designing and testing solutions,
and feeling engaged and empowered.
What are curricula in this new generation of rich and expansive access to resources and
interactive technologies? What is the role of a problem sequence? How does it link to the
concepts of learning trajectories? How can they help us accomplish these broad goals?
Reflecting on these issues and on the discussions and presentations over the last two
days, I identified six primary components that should be addressed and researched in any
major forthcoming initiative. These are identified in relation to both what we have
learned from previous efforts in curricula design and implementation, and what new foci
the new technological tools and arrangements afford. The six components focus on:
These problems should also set new expectations in terms of student outcomes, including
performances, productions, and demonstrations of proficiencies. Part of the goal is to
support varied levels of customization and adaptation to interests and passions.
These opportunities contribute to “making thinking visible” and include the collection
and interpretation of student ideas. The development of diagnostic assessments, built on
empirically validated learning progressions, can provide instructional guidance that was
previously only learned over years of reflective practice. Affordances that could be built
for or into such activities include artifact galleries, communication methods, commenting
capabilities and opportunities for private and public communication and display spaces.
Another aspect of this component would be to support peer to peer exchange of
information, posting of ideas, answering of questions and/or multiple forms of mentoring
(by peers, parents, significant others, teachers).
3. Developing new means in which curricular and classroom materials can promote
professional development, strengthen capacity, and share best practices among
teacher communities.
One possible scenario is that increasingly in education, services will be paid for and
content will become freely available. If this becomes the case, then there is a question of
whether and how to use the distinction between open sources and open access to ensure
6. The capability of data mining provides amazing opportunities for automatic data
collection, what one group referred to as forms of “intelligent agency.”
The new CIT-based systems will permit us to bootstrap to better designs, to identify both
weaknesses and effectiveness in materials and assessment, and to troubleshoot various
bottlenecks or sticky design characteristics. A particularly interesting question for us to
consider is how the theories of curriculum evaluation might become revised in light of
the new technologies. For instance, if we use the NRC model of program theory,
implementation, and outcomes, how will this play out when program implementation can
be done automatically by the system and when frequency of use could be correlated with
student outcomes? This provokes a whole host of possibilities; it will be imperative to
ensure that our research capabilities evolve with our materials and resources, and
important student variables are linked to teacher and district variables to permit us to
draw valid and reliable conclusions.
Finally, I would encourage a call for research and development of courses called MAD-
STEM, (Modeling and Design for STEM), and for these courses to be taught outside of
regular STEM classrooms. In this way, we can demonstrate what is possible, freed from
the tendency towards reductive standards and/or the limitations inherent, at least to date,
in large scale assessment.
Mike Haney made the point that there will be a next generation of instructional materials
capitalizing on new technologies, whether or not NSF supports their development. The
challenge and the opportunity for our community is to develop instructional materials that
incorporate in new, technology-infused forms what is already known about effective
STEM teaching and learning, and to conduct additional research to enhance the
knowledge base for future development. My expertise is in research, not development, so
that will be the focus of my comments, considering what has limited knowledge
generation in our field in the past, and the implications for future research on
instructional materials.
First, I think it is important that we be both more open and more explicit about the
development process, acknowledging what aspects of a particular design are “research-
based,” and where the development is based on the intuition of experts. In the past, for
example in the development of the national standards documents, I believe we overstated
what was known, including not only elements with solid research support, but also
elements where effectiveness was far less certain, or at least more conditional. Over-
promising comes back to haunt us when things don’t play out as we had hoped.
As our “teacher as learning guide” group described our vision, I was struck both by the
similarity of our views/intuitions and by how scant the empirical support was for some of
the elements of the teacher role we were suggesting. Richard Elmore’s notion of points
of expert consensus as “sensible propositions” came to mind; he suggests using those
ideas as best bets to guide practice and at the same time treating them as hypotheses for
research so future practice can be better informed. In the case of teacher as learning
guide, we need to find out if in fact student outcomes are better when teachers play that
role, and whether individual elements of the role as we envision it are particularly
important. And when professional development efforts, including “educative” materials,
attempt to prepare teachers to serve as learning guides, we need to find out if those efforts
But before we can develop instruments, we need to define the constructs we want to
measure in order to generate the knowledge we seek, including characteristics of the
materials, and the nature and extent of their enactment, as well as student outcomes.
What do we mean by coherence, and would the focus be within a unit, across units within
a year, and/or across K-12? What criteria would we use to assess the extent of alignment
between learning experiences in the formal and informal sectors? What does fidelity of
implementation mean in an environment that expects very different pathways for classes,
groups of students, and even individual students? And we need to consider both how to
take advantage of the opportunities technology-infused instructional materials provide to
improve the quality and reduce the burden of data collection, and the associated
challenges of informed consent.
Finally, I hope we can take advantage of the opportunity to cumulate knowledge more
effectively and efficiently than we have in the past. For example, it would be helpful if
the field could come up with a set of descriptors with clear definitions for use in “coding”
instructional materials design and implementation both so if something is effective we
know what “it” was, and so we can begin to aggregate results across studies. Similarly,
while no study is “perfect,” setting up an expectation that research proposals and results
reports be explicit about how threats to internal validity are being addressed (and which
ones remain), as well as the limits of generalizability of the results would help improve
the quality and aggregability of research results.
Although it is well understood that technology enables profound societal changes, the
biggest changes are often unexpected and dramatic. For example, I would not have
guessed how quickly paper maps have become irrelevant to me, all my music listening
involves Apple products, and I watch more movies streamed over the Internet than I
watch on cable TV or in theaters. When new possibilities, unmet needs, and participatory
enthusiasm suddenly align, change accelerates.
Arguably, a similarly broad change, one that has been on the radar for at least 15 years, is
about to effect school age children: the change from paper to digital textbooks. Electronic
readers, such as Amazon’s Kindle or Apple’s iPad, are accelerating rapidly in quality and
affordability. Today’s teachers and students assume an infrastructure of connected digital
devices throughout their everyday lives and increasingly expect the Internet to be
available at school (Project Tomorrow, 2009). Excellent examples of digital learning
tools that deeply enhance STEM education are available to us for uses such as
visualization, modeling, and simulation (NSF Task Force on Cyberlearning, 2008). The
technological, social and educational factors that would support a change from paper to
digital learning materials are coming together in the environment of education (Lewin,
2009). Yet, significant change toward digital STEM curriculum has not yet occurred and
there is no systemic or planned movement in that direction.
Educational systems are typically very slow and resistant to change. However, an
additional factor makes the present time atypical. In the United States, state governments
face a budgetary crisis that is severely effecting education. Consequently, states are now
willing to question a key financial assumption of the existing school finance regulations:
that instructional materials budgets are exclusively for the purchase of paper textbooks
(Salpeter, 2009). Because of such regulations, technology has been an “extra” funded in
Further, the movement to new “common core state standards” is preparing states to retire
old instructional materials (see http://www.corestandards.org/). By all accounts these
materials need to be retired. The old paper textbooks have grown bloated, incoherent and
almost unusable – an average Algebra text now weighs in at 1000 pages, but covers no
more topics than much thinner texts of years ago (National Mathematics Advisory Panel,
2008). It seems hard to imagine how stakeholders could defend purchase of more of
today’s textbooks if better alternatives are available, particularly if they are also more
economical. Thus, although educational systems are ordinarily very slow to change, the
funding crisis at the state level and the misfit between existing textbooks and new
common standards could make the change from paper to digital instructional materials
unusually fast.
As Joan Ferrini-Mundy reminded attendees at the beginning of the first Blue Sky
Workshop, NSF thrives on the steep part of the learning curve. Once innovation in a field
slows down, it is time for other agencies (as well as the commercial market) to take over.
This slow down has already occurred for educational technologies and curriculum
materials that NSF invested heavily in approximately 15-20 years ago, such as scientific
probes, programming languages for children, dynamic mathematical representations and
curriculum materials based on new visions of school mathematics and science. These
tools are now readily available through commercial and open source vendors and there is
less opportunity for discovery and innovation through NSF funding. It is now time for
NSF to rethink funding priorities to move back to the “steep acceleration” portion of the
learning curve.
Other factors in the environment are powerful and more stable. Attendees at the first Blue
Sky Workshop felt certain that teachers will remain important. Curricular coherence is an
intrinsic requirement for STEM disciplines, in which knowledge must be built
systematically. Common standards are also likely to be a stabilizing force in years to
come.
Launching a rocket is impossible without a strong platform and steady scaffolding. Just
as the rocket needs a platform and scaffolding, so does a research and development
community that seeks to move to the steep part of the learning curve. Continuing the
metaphor, the “platform” could be a common knowledge base of how to use technology
• It is important to find new ways to grab and extend students’ deep cognitive
engagement in powerful learning environments.
• The design of powerful learning environments must follow from detailed
understanding of how students learn specific content as well as an enriched
understanding of what is most important and generative within that content.
• Learning progressions and new forms of learning activities will replace the
traditional “scope and sequence” and lesson plans. Progressions highlight subject
matter coherence and connections, not just an ordering of topics. Explicit plans
for how teachers and students will interact around content and resources are
needed.
• The focus of assessments will be increasingly formative; that is, assessments that
are timely, meaningful, and informative.
• A focus on metacognition, thinking, and collaboration skills can be as important
as a focus on subject matter content.
Learning scientists also tend to share some common values, and these values shape
projects that design new learning materials. We tend to value hands-on learning, playful
environments, nurturing of students’ curiosity and aesthetics. We also tend to value deep
understanding of foundational STEM content and the occasions and conditions that allow
students to have wonderful ideas and the respect of their teachers and peers. Most
importantly, learning scientists predominantly work in applied settings and therefore base
much of what they do in first hand experiences with great teaching and inspiring learning,
as well as first hand experiences with the barriers and obstacles in schools and other
environments.
In addition, although not exhaustive of technology’s possibilities, there are now a number
of links between technology and advanced STEM learning that have been firmly
established and form the basis for research-based design principles:
This opportunity for change should not be wasted. There is broad agreement that the
nation’s STEM programs need an overhall in order to produce a steady supply of future
innovators and educate all children for a technological world (National Academy of
Science, 2005). An opportunity to change the educational content and corresponding
instructional approach can offer huge leverage for how teachers teach STEM and how
students learn. In fact, curriculum and digital content are arguably the biggest levers
available to reform-minded educators (Schmidt et al., 2001). But there is no guarantee
that a switch from paper to digital instructional materials will be transformative: schools
could settle for a new medium without demanding real innovation and higher quality in
the content of the materials.
Consider the change to iTunes or Kindle for music and books. iTunes has not changed the
structure of music; we still listen to 3 minute songs, a length that was dictated by
recording time available on a vinyl disc spinning at 78 rotations per minute. We still read
the same books, too. Quality has not been improved (e.g. music quality is of lower
quality than on CDs or vinyl records), rather cost and convenience factors have
dominated consumers’ transition to digital media. Following the analogy, it is possible
that schools will purchase digital curricula for cost and convenience factors as well and
that these materials could be of even lower quality than today’s textbooks. Even if digital
learning materials have the same structure, content and quality of paper learning
materials, the present opportunity will have been wasted. Our nation’s students will not
be better prepared in critical STEM disciplines merely because instructional content is
now accessed in digital form. Our children need the transition to digital materials to be a
transition to higher quality.
A timely, targeted, and ambitious federal investment in Blue Sky STEM Learning
Designs could make the critical difference – the difference between “old wine in new
There are legitimate questions as to whether NSF’s mission should include the production
of the core materials routinely needed by schools. On one hand, proponents can point to
the strong role of NSF-funded mathematics and science materials in demonstrating that
all students can learn science inquiry and develop a connected understanding of
mathematics. On the other hand, opponents can argue that curriculum production is a
routine business and NSF should remain focused on the steep, innovative part of the
learning curve. While continued work on cyberlearning infrastructure (e.g. platforms,
openness, rich data and search services) is certainly needed, the remainder of this essay
will argue in favor of a strong, well-funded focus within cyberlearning on Blue Sky
STEM Learning Designs by advancing four points:
The most striking feature of the emerging cyberlearning landscape is that it transcends
school (Chan, et al, 2006). But then, so does the development of childrens’ trajectories
towards STEM careers—students develop their interests and passions for science in
science fairs, museums, robotics competitions, with parents, and through many venues
that extend beyond classroom walls (Barron, 2006). The fundamental reason for NSF to
take a lead role in Blue Sky STEM Learning Designs is this:
A new feature of the Internet age is that problems of distribution no longer limit the
market to the tall part of the curve (Anderson, 2008). For example, whereas a
conventional bookstore could only afford to have more popular titles, an electronic
bookseller can serve the “long tail” of small interest groups. Thus, in general, the Internet
allows companies to thrive by capturing markets in the long-tail, not just mass
consumption markets at the tall end of the curve.
I believe that the long tail curve will shape the landscape for STEM learning as well. At
one end, students can have extensive new opportunities to develop and shape their
For interest-driven experiences, the main benefit of digital cyberlearning may be the
opportunity for extensive personalization to meet children where they are and develop
their passion and commitment for future STEM learning.
These core materials, however, do not have to look exactly like current instructional
materials (textbooks). In an earlier article (Patton & Roschelle, 2008), we argue for a
“thin core” approach. In this approach, educators agree on a lean foundational learning
progression, with the most essential content – coherent and complete in the sense that this
would be all that advanced learners would need. In mathematics, this lean content would
include key definitions, algorithms, concepts, worked examples, and a few well chosen
problems – much like textbooks used currently in some high performing countries, such
as those found in Singapore, Japan and Finland . Digital media would allow for rich
extensions to be embedded and attached to this “thin core” to support a wide variety of
learners. For example, extensions could include interactive, dynamic representations,
integrated tutors that provide feedback during problem solving, and “Universal Design
for Learning” adaptations to ensure opportunity to learn for individuals with varying
interests and needs. Thus, instead of today’s bloated “one size fits all” textbooks, 21st
century learners could experience a lean, essential core complemented with focused
extensions and adaptations to support their own learning needs and preferences.
What about the middle of the landscape? Here we will find “projects” that are less formal
than disciplinary school experiences but better organized and populated than niche,
personalized materials. Robotics competitions (e.g., http://www.usfirst.org/) are present-
day examples of a non-school, semi-formal STEM activity. These robotics activities
engage students in developing designs that address a common challenge over an extended
period of time and provide extensive mentoring. Similarly, many serious games will exist
in this middle space; serious games can draw large audiences of school-age children and
offer a fairly common, long-term experience for the participants, but are not constrained
to be structured in the same way as learning a STEM discipline (Neulight et al., 2007;
Squire, 2007; Schaffer, 2005). It seems quite likely that the greatest learning benefit of
activities in this region will be the opportunity to participate in an authentic learning
community with longevity and substance (Barab, et al 2005). Through such experiences,
students can develop identities as STEM learners (Gee, 2007).
The potential for different learning benefits in different regions of the learning ecosystem
curve argues against the prevalent idea that one region of the ecosystem (or one benefit)
will dominate all the others. For example, it is unlikely to be the case that the middle
“games” and “projects” region will replace school, or that all learning can become as
personalized as it is in the low part of the long tail distribution. In contrast, the exciting
fact is that all students will have opportunities to learn across all regions. Indeed, because
of the distribution efficiencies of cyberlearning materials and experiences, a learning
market that was formally balkanized with most of the money placed on the tall end of the
spectrum can now be more connected across the whole spectrum.
The ecosystem could be usefully organized around a “cultural commons” that aligns
schools, museums (and like institutions) and homes as places of learning, while
building on the unique attributes of each.
An emergent idea from the Blue Sky Workshop, articulated in the paper by Sherry Hsi
(2010), describes a plan in which children’s learning time is more thoughtfully balanced
across school settings, after school and informal settings, and homes. The cultural
commons concept challenges the community-based consortia to weave together their
unique capacities to create more “seamless” learning opportunities across traditional
boundaries. Cyberinfrastructure, of course, can be a key enabler for linking together
activities in disparate places.
Due to its responsibility for nurturing future citizens’ STEM abilities, NSF has a mission
that includes responsibility for the nation’s learning ecosystem for developing STEM
talent among our youth (National Science Board, 2006; Wing et al, 2010). Further, NSF
has always invested across learning ecosystems: in creating new textbooks for
mathematics and science (tall region of the curve), sponsoring development of new
materials for informal (e.g. museum) learning (middle region), and supporting outreach
efforts that engage small numbers of kids with mentors or provide access to scientific
data (highly personalized region). The result of these investments has been the
community represented at the Blue Sky Workshops; an active learning sciences
community with high quality research credentials that is also somewhat balkanized by the
quirks of funding programs.
To date, the community has not had a mechanism to taken responsibility for their
knowledge and activities as a continuum or spectrum that forms a coherent learning
ecosystem.
Without federal investment, we will likely see digital content remain highly balkanized
and incoherent. Publishers have already noticed the market shift to digital materials and
are making digital science and mathematics textbooks, but these are likely to be much
like current paper textbooks but in digital form that allow for limited degrees of choice
and personalization. Other companies will continue to produce highly successful games
that attract a large following among youth. Nonprofit organizations will continue to
sponsor engineering competitions and the like. But these efforts will not be part of an
ecosystem, but rather a montage of almost completely unrelated experiences. For
example, a mentor in a robotics tournament will not be able to identify learning modules
from a child’s core school curriculum relevant to the mathematics of a particular timely
engineering challenge, and thus will not be able to link school and out-of-school projects.
A school teacher will have no idea of the personalized niches in which students have
nurtured their own interests in science and shown considerable capability (Bell et al,
2009), and thus may miss opportunities to engage and motivate students with disciplinary
subject matter. And providers of niche learning experiences may remain underfunded and
unappreciated because they cannot show linkages between the ways in which they
develop students’ interests and the core content that schools are accountable for.
The opportunity will be missed if funding is only available for infrastructure and does not
allow cross-fertilization of the experts working on Blue Sky Learning Designs (including
details of the tangible learning environment, the content, the instructional routines, the
assessments, etc.). The nation needs a new generation of learning designs that coherently
Some examples of research questions that a Blue Sky community, once suitably focused
on the continuum of learning designs, might address include:
1. What is the nature and structure of digital STEM materials that support greater
coherence in core disciplinary learning as well as in less formal, interest-driven
activities?
2. How can cyberinfrastructure enable us to track (and measure) students learning
across formal and informal settings in ways that inform teaching and increase
collaboration across settings?
3. How can cyberlearning environments support learners’ processes of weaving
together a range of informal and formal experiences that support their growing
identities as a STEM learner?
Note that these are all questions that expand across the learning ecosystem – implying
that regions of the ecosystem should be related and coherently support students’
development in STEM.
Without federal investment it is unlikely that any other party in the ecosystem will take
responsibility for the coherence of the whole.
Because of NSF’s responsibility for nurturing the pipeline of future STEM innovators
and the need to increase the capacity of all citizens to participate in an advanced scientific
civilization, the Blue Sky community should seek support for structuring the content of
the learning ecosystem to coherently and comprehensively support all students’
development of STEM interests and knowledge.
Today’s STEM learning technology accomplishments were built upon a large investment
in people and innovation that NSF made approximately 15-25 years ago. This investment
yielded new inquiry science curriculum, new standards-based mathematics textbooks,
better approaches to teacher professional development and powerful simulation,
visualization, representational and modeling tools. Equally important, the investment
nurtured a community of people who think innovatively about the future of STEM
education. Of course, the features and structure of today’s emerging cyberlearning
ecosystem was not envisioned 15-25 years ago. Many of the people in the existing STEM
learning innovation community are now approaching retirement and many of their skills
were honed in an era with different possibilities. In the intervening time, funding for
innovative STEM materials has been tight; we have been through a time where more
focus has gone into increasing the rigor of educational research. Consequently, NSF’s
Cyberlearning report (NSF, 2008) relies heavily on examples and ideas that were
germinated 15 or more years ago.
The federal government must focus its limited R&D resources in areas where innovation
is accelerating. I have argued that innovation is about to accelerate dramatically in the
design of STEM learning designs because multiple factors are coming into place:
Anderson, C. (2008). The long tail: Why the future of business is selling less of more.
Hyperion.
Barab, S., Thomas, M., Dodge, T., Carteaux, R., & Tuzun, H. (2005). Making learning
fun: Quest Atlantis, a game without guns. Educational Technology Research and
Development, 53(1), 86-107.
Barron, B. (2006). Interest and self-sustained learning as catalysts of development: A
learning ecology perspective. Human Development, 49, 193-224.
Bell, P., Lewenstein, B., Shouse, A. W., & Feder, M. A. (Eds.). (2009). Learning science
in informal environments: People, places, and pursuits. Washington DC: National
Academies Press.
Brown, J.S. & Adler, R.P. (2008). Minds on fire: Open education, the long tail, and
learning 2.0. Educause Review, 43(1).