Rubric Development

Why use
rubrics?
Characteristics
of good rubrics
Definition &
types of rubric
Strategies for
RUBRIC DEVELOPMENT rubric
development
SOLO taxonomy
Phenomeno-
graphic sorting
Using rubrics
with students
SCORING RUBRIC
 Definition
 A scoring tool that lays out the specific expectations for an
assessment task (Stevens & Levi, 2005)
 A set of clear explanations or criteria used to help teachers and
students focus on what is valued in a subject, topic, or activity
(Russell, & Airasian, 2012).
 Components of a rubric:
 Criteria/Indicator
 aspects of an assessment task which the assessor takes into account
when making their judgment
 May use different weightings for different criteria
 Level of Attainment
 often use grade level descriptors
 Types of rubrics:
 Descriptive (Analytic), Holistic
 Why and when we use particular types of rubrics
WHY USE RUBRICS?
For teachers: For students:
• Prompt a criterion-referenced • Clarify the teacher’s

assessment expectations of student
• Provide students with detailed performance
and timely feedback • Provide informative
• Encourage critical thinking descriptions of expected
• Facilitate communication with performance
others involved in scoring • Help to monitor and critique
• Help to refine teaching own work
skills/learning activities
CHARACTERISTICS OF GOOD RUBRICS (1)
 Well defined
 Clearly describe the expected level of student performance for
each criterion in a rubric
 Avoid general evaluative words (poor, excellent, etc.)
 Use specific objective terms (correctly identifies, uses only
basic vocabulary, chooses incorrect formula… )
 Context specific
 Describe what teachers expect from student for a given
performance or work product on a particular subject domain
 Viable for instruction
CHARACTERISTICS OF GOOD RUBRICS (2)
 Finite and exhaustive

 Every response must be scorable
 Too many score levels is confusing for students and causes
disagreement among teacher scores
 Ordered
 Represent the different levels of learning targets as defined by
LP
 Related to Common Core theme/strand
 Coherent with the cognitive complexity of the standards
ANALY TIC (DESCRIPTIVE) RUBRICS
Components:
(1) Task Task Description:
description Criteria Criteria Criteria Criteria Total
1 2 3 4
(2) Assessment
criteria
Level 5
(3) Performance
levels Level 4
Level 3
Advantage:
 Provides Level 2
judgment on Level 1
each criterion
Disadvantage:
 Time consuming
to make
HOLISTIC RUBRICS
 A single scale with all criteria to be included in the

evaluation being considered together
 Based on an overall judgment of student work
Task Description:
Advantage: Criteria
 Saves time in Level 5 Overall description of Level 5
developing and
Level 4 Overall description of Level 4
scoring
Disadvantage: Level 3 Overall description of Level 3
 Does not provide Level 2 Overall description of Level 2
specific feedback
for improvement Level 1 Overall description of Level 1
WHEN TO USE RUBRICS
 On performance-based tasks:
 extended response items
 projects
 presentations
 portfolios
4 KEY STAGES IN CREATING RUBRICS
 Reflecting on the task & content

 Learning outcomes of the unit and the particular assessment
 What we want from the students, why we created this
assessment, what our expectations are
 Listing the learning outcomes & expectations
 Focus on the particular details of the task and what specific
learning objectives we expect to see in the completed task
 Grouping & labeling the outcomes & criteria
 Organize the results of reflections, group similar expectations
together to become the rubric Indicators
 Application of a rubric format
 Apply the templates & descriptions to the final form of the
rubrics
STRATEGIES FOR RUBRIC DEVELOPMENT
 Relationship between the intended Learning

Progression (LP) and rubrics
 Direct use of the LP as standard reference
 Use of a general strategy (i.e. modified Bloom’s
taxonomy or SOLO taxonomy)
 Assign the target outcome as mapped onto the Cognitive Rigor
Matrix as the maximum level of the rubric
 Use the SOLO taxonomy as scoring
 Phenomenographic sorting
SOLO TAXONOMY
 A possible value of 0 – 4 can be used to score each

question
Possible Level Responses that …

Score
4 Extended not only include all relevant pieces of information, but also
extend the response to integrate relevant pieces of
information not in the stimulus.
3 Relational integrate all relevant pieces of information from the stimulus.
2 Multistructural respond to several relevant pieces of information from the
stimulus.
1 Unistructural respond to only one relevant piece of information from the
stimulus.
0 Pre-structural consist only of irrelevant information.
* Modified from Wilson (2005, p. 75)

PHENOMENOGRAPHIC SORTING
1. Sort student responses into performance level piles

(excellent, good, …, and poor), or in terms of the
levels of understanding of the responses
2. Describe similarities within a pile and differences
between
 These similarities and differences can inform the different
level of rubrics
3. Do sorting in pairs
 To reconfirm matches & mismatches
 Allow dialogue to maximize the effectiveness of rubric
development
USING RUBRICS WITH STUDENTS
 Explain what the test will emphasize

 Emphasis and expectations will be delineated in the
assessment criteria in the rubrics
 Inform students how the assessment will be scored
 Explain what each of the assessment criteria defined in the
rubrics means
 Explain how the results will be used
 Explain the importance of the test scores in the student’s
learning progression
HOW TO USE RUBRICS WITH STUDENTS
 Make sure that the wording of the rubrics is

understandable to students (simplify wording for
lower grades).
 Works best with holistic rubrics (or with a combined
version of analytic descriptions).
 Provide rubrics to students in advance of the
administration of the assessment.
 Alternatively, students can be provided with a
general rubric and a small number of papers (names
removed). Students can score the papers in small
groups; groups are required to come to consensus on
the grade to be assigned.
BIBLIOGRAPHY
 N i t ko , A . J. , & B ro o k har t , S. ( 2 0 07). E duc a t i onal a s s essmen t o f s t ude n t s . Uppe r

Sa ddl e Ri ver, N J: Pe a r s on E duc a t i o n, In c .
 M c M i llan, J. H . ( 2 0 07). C l a s s ro om a s s e s s m e nt. P ri n c i pl e s a n d p r a c ti ce fo r
e f fe c t i ve s t a nd ard -b a s e d i n s t ruct ion ( 4 t h e d. ) . B o s to n: Pe a r s on - Al l y n & B a c o n .
 Ore g o n D e pa r t m e nt o f E duc a t i o n. ( 2 014, Jun e ) . As s essment g ui da n ce.
 Po ph a m, W. J. ( 2 014 ). Cri te rion -re ferenc ed m e a sureme nt: A h a l f - c ent ur y wa s te d?
Pa pe r pre s e nte d a t th e An n ua l M e et i ng o f N a t i o nal Co un c il o n M e a sure ment i n
E duc a t i o n, P h i la dephia, PA .
 Po ph a m, W. J. ( 2 014 ). C l a s s ro om a s s e s s m e nt: W h a t te a c h e r s n e e d s to k n ow . Sa n
Fra n c i sco, CA: Pe a r son
 Rus s ell, M . K . , & Ai ra sian , P. W. ( 2 01 2). C l a s s ro om a s s e s s m e nt: C o n c e pts a n d
a p p l i cati ons . N ew Yo rk , N Y: M c G raw - H ill .
 Steve n s , D . & L ev i , A . ( 2 0 0 5 ). I n t ro ducti on to ru b ri c s . As a s s e s s m e nt to o l to s ave
gr a d i n g t i m e , c o nvey e f fe c t i ve fe e d b a c k , a n d p ro m ote s t u d e nt l e a rn i n g . Ste rl i ng:
St y l us P ubl i shing, LLC
 Wi h a rdini, D . ( 2 010). As s essment deve lo pment II. Un publ ish ed m a n usc ript .
Re s e arc h a n d D eve lopment D e pa r t m e nt , B i n us B us i ness Sc h o o l, Ja ka r t a ,
In do n esia.
 Wi l son, M . ( 2 0 0 5). Co n st ruc t i ng m e asure s: An i te m re s po n se m o de lin g a ppro a c h .
M a h wa h, N J: Law re n c e E rl ba um As s ocia tes.
CREATIVE COMMONS LICENSE
Ru b r i c s P P T by t h e O r e g o n D e p a r t me n t o f E d uc a t i o n a n d B e r ke l ey E v a l ua t i o n a n d
A s s e s s m e n t Re s e a r c h C e n te r i s l i c e n s e d u n d e r a C C BY 4 . 0 .
You are free to:

 Share — copy and redistribute the material in any medium or format
 Adapt — remix, transform, and build upon the material
Under the following terms:

 Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes
were made. You may do so in any reasonable manner, but not in any way that suggests the licensor
endorses you or your use.
 NonCommercial — You may not use the material for commercial purposes.
 ShareAlike — If you remix, transform, or build upon the material, you must distribute your
contributions under the same license as the original.
O r e go n D e p a r t me n t o f E d u c a t i o n w e l c o m e s e d i t i n g o f t h e s e r e s o u r c e s a n d w o u l d
g r e a t l y a p p r e c i a te b e i n g a b l e to l e a r n f r o m t h e c h a n g e s m a d e . To s h a r e a n e d i te d
ve r s i o n o f t h i s r e s o u r c e , p l e a s e c o n t a c t C r i s te n M c L e a n , c r i s te n .m c l e a n @ s t a te . o r. u s .

Rubric Development

Uploaded by

Copyright:

Available Formats

Rubric Development

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Rubric Development

Uploaded by

Copyright:

Available Formats

Why use

For teachers: For students:

• Prompt a criterion-referenced • Clarify the teacher’s

 Finite and exhaustive

 A single scale with all criteria to be included in the

 Reflecting on the task & content

 Relationship between the intended Learning

 A possible value of 0 – 4 can be used to score each

Possible Level Responses that …

* Modified from Wilson (2005, p. 75)

1. Sort student responses into performance level piles

 Explain what the test will emphasize

 Make sure that the wording of the rubrics is

 N i t ko , A . J. , & B ro o k har t , S. ( 2 0 07). E duc a t i onal a s s essmen t o f s t ude n t s . Uppe r

You are free to:

Under the following terms:

You might also like