Types of Tests: Unit: 4
Types of Tests: Unit: 4
Types of Tests: Unit: 4
TYPES OF TESTS
Written By:
Dr. Naveed Sultana
Reviewed By:
Dr. Muhammad Tanveer Afzal
CONTENT
Sr. No Topic Page No
Introduction ................................................................................................................81
Objectives ...................................................................................................................81
examine the role, advantages and disadvantages of different types of objective and subjective type
tests for measuring the students’ achievement.
describe the learning outcomes that are best measured with selection and supply test items.
differentiate the characteristics of all types of selection and supply categories of items concentrating
to measure the higher level of thinking of students.
4.1 Selection Type Items (objective type)
There are four types of test items in selection category of test which are in common use today. They are
multiple-choice, matching, true-false, and completion items.
The stem may be stated as a direct question or as an incomplete statement. For example:
Direct question
Which is the capital city of Pakistan? --------------- (Stem)
A. Paris. --------------------------------------- (Distracter)
B. Lisbon. -------------------------------------- (Distracter)
C. Islamabad. ---------------------------------- (Key)
D. Rome. --------------------------------------- (Distracter)
Incomplete Statement
The capital city of Pakistan is
A. Paris.
B. Lisbon.
C. Islamabad.
D. Rome.
Multiple choice questions are composed of one question with multiple possible answers (options),
including the correct answer and several incorrect answers (distracters). Typically, students select the
correct answer by circling the associated number or letter, or filling in the associated circle on the
machine-readable response sheet. Students can generally respond to these types of questions quite
quickly. As a result, they are often used to test student’s knowledge of a broad range of content. Creating
these questions can be time consuming because it is often difficult to generate several plausible
distracters. However, they can be marked very quickly.
Multiple Choice Questions Good for:
Application, synthesis, analysis, and evaluation levels
RULES FOR WRITING MULTIPLE-CHOICE QUESTIONS
There are several rules we can follow to improve the quality of this type of written examination.
8. Avoid Distracters in the Form of "All the answers are correct" or "None of the Answers is
Correct"!
Teachers use these statements most frequently when they run out of ideas for distracters. Students,
knowing what is behind such questions, are rarely misled by it. Therefore, if you do use such statements,
sometimes use them as the key answer. Furthermore, if a student recognizes that there are two correct
answers (out of 5 options), they will be able to conclude that the key answer is the statement "all the
answers are correct", without knowing the accuracy of the other distracters.
Advantages:
Multiple-choice test items are not a panacea. They have advantages and advantages just as any other type
of test item. Teachers need to be aware of these characteristics in order to use multiple-choice items
effectively.
Advantages
Versatility
Multiple-choice test items are appropriate for use in many different subject-matter areas, and can be used
to measure a great variety of educational objectives. They are adaptable to various levels of learning
outcomes, from simple recall of knowledge to more complex levels, such as the student’s ability to:
• Analyze phenomena
• Apply principles to new situations
• Comprehend concepts and principles
• Discriminate between fact and opinion
• Interpret cause-and-effect relationships
• Interpret charts and graphs
• Judge the relevance of information
• Make inferences from given data
• Solve problems
The difficulty of multiple-choice items can be controlled by changing the alternatives, since the more
homogeneous the alternatives, the finer the distinction the students must make in order to identify the
correct answer. Multiple-choice items are amenable to item analysis, which enables the teacher to
improve the item by replacing distracters that are not functioning properly. In addition, the distracters
chosen by the student may be used to diagnose misconceptions of the student or weaknesses in the
teacher’s instruction.
Validity
In general, it takes much longer to respond to an essay test question than it does to respond to a multiple-
choice test item, since the composing and recording of an essay answer is such a slow process. A student
is therefore able to answer many multiple-choice items in time it would take to answer a single essay
question. This feature enables the teacher using multiple-choice items to test a broader sample of course
contents in a given amount of testing time. Consequently, the test scores will likely be more
representative of the students’ overall achievement in the course.
Reliability
Well-written multiple-choice test items compare favourably with other test item types on the issue of
reliability. They are less susceptible to guessing than are true-false test items, and therefore capable of
producing more reliable scores. Their scoring is more clear-cut than short answer test item scoring
because there are no misspelled or partial answers to deal with. Since multiple-choice items are
objectively scored, they are not affected by scorer inconsistencies as are essay questions, and they are
essentially immune to the influence of bluffing and writing ability factors, both of which can lower the
reliability of essay test scores.
Efficiency
Multiple-choice items are amenable to rapid scoring, which is often done by scoring machines. This
expedites the reporting of test results to the student so that any follow-up clarification of instruction may
be done before the course has proceeded much further. Essay questions, on the other hand, must be
graded manually, one at a time. Overall multiple choice tests are:
Very effective
Versatile at all levels
Minimum of writing for student
Guessing reduced
Can cover broad range of content
Disadvantages
Versatility
Since the student selects a response from a list of alternatives rather than supplying or constructing a
response, multiple-choice test items are not adaptable to measuring certain learning outcomes, such as the
student’s ability to:
• Articulate explanations
• Display thought processes
• Furnish information
• Organize personal thoughts.
Perform a specific task
• Produce original ideas
• Provide examples
Such learning outcomes are better measured by short answer or essay questions, or by performance tests.
Reliability
Although they are less susceptible to guessing than are true false-test items, multiple-choice items are still
affected to a certain extent. This guessing factor reduces the reliability of multiple-choice item scores
somewhat, but increasing the number of items on the test offsets this reduction in reliability.
Difficulty of Construction
Good multiple-choice test items are generally more difficult and time-consuming to write than other
types of test items. Coming up with plausible distracters requires a certain amount of skill. This skill,
however, may be increased through study, practice, and experience.
Gronlund (1995) writes that multiple-choice items are difficult to construct. Suitable distracters are often
hard to come by and the teacher is tempted to fill the void with a “junk” response. The effect of
narrowing the range of options will available to the test wise student. They are also exceedingly time
consuming to fashion, one hour per question being by no means the exception. Finally multiple-choice
items generally take student longer to complete (especially items containing fine discrimination) than do
other types of objective question.
Difficult to construct good test items.
Difficult to come up with plausible distracters/alternative responses.
Activity 4.1: Construct two items of direct question and two items of incomplete statement
while following the rules of multiple items.
Example
Directions: Circle the correct response to the following statements.
1. Allama Iqbal is the founder of Pakistan. T/F
2. Democracy system is for the people. T/F
3. Quaid-e-Azam was the first Prime Minister of Pakistan. T/F
Good for:
Knowledge level content
Evaluating student understanding of popular misconceptions
Concepts with two logical responses
Advantages:
Easily assess verbal knowledge
Each item contains only two possible answers
Easy to construct for the teacher
Easy to score for the examiner
Helpful for poor students
Can test large amounts of content
Students can answer 3-4 questions per minute
Disadvantages:
They are easy to construct.
It is difficult to discriminate between students that know the material and students who don't
know.
Students have a 50-50 chance of getting the right answer by guessing.
Need a large number of items for high reliability.
Fifty percent guessing factor.
Assess lower order thinking skills.
Poor representative of students learning achievement.
Activity 4.2: Enlist five items by indicating them T/F (True & False)
Matching test items are used to test a student's ability to recognize relationships and to make associations
between terms, parts, words, phrases, clauses, or symbols in one column with related alternatives in
another column. When using this form of test item, it is a good practice to provide alternatives in the
response column that are used more than once, or not at all, to preclude guessing by elimination.
Matching test items may have either an equal or unequal number of selections in each column.
Matching-Equal Columns. When using this form, providing for some items in the response column to be
used more than once, or not at all, can preclude guessing by elimination.
Good for:
Knowledge level
Some comprehension level, if appropriately constructed
Types:
Terms with definitions
Phrases with other phrases
Causes with effects
Parts with larger units
Problems with solutions
Advantages:
The chief advantage of matching exercises is that a good deal of factual information can be tested in
minimal time, making the tests compact and efficient. They are especially well suited to who, what, when
and where types of subject matter. Further students frequently find the tests fun to take because they have
puzzle qualities to them.
Maximum coverage at knowledge level in a minimum amount of space/prep time
Valuable in content areas that have a lot of facts
Disadvantages:
The principal difficulty with matching exercises is that teachers often find that the subject matter is
insufficient in quantity or not well suited for matching terms. An exercise should be confined to
homogeneous items containing one type of subject matter (for instance, authors-novels; inventions
inventors; major events-dates terms – definitions; rules examples and the like). Where unlike clusters of
questions are used to adopt but poorly informed student can often recognize the ill-fitting items by their
irrelevant and extraneous nature (for instance, in a list of authors the inclusion of the names of capital
cities).
Student identifies connected items from two lists. It is useful for assessing the ability to discriminate,
categorize, and association amongst similar concepts.
Time consuming for students
Not good for higher levels of learning
Activity 4.3: Keeping in view the nature of matching items, construct at least five items of
matching case about any topic.
I. Word the statement such that the blank is near the end of the sentence rather than near the
beginning. This will prevent awkward sentences.
II. If the problem requires a numerical answer, indicate the units in which it is to be expressed.
Good for:
Application, synthesis, analysis, and evaluation levels
Advantages:
Easy to construct
Good for "who," what," where," "when" content
Minimizes guessing
Encourages more intensive study-student must know the answer vs. recognizing the answer.
Gronlund (1995) writes that short-answer items have a number of advantages.
They reduce the likelihood that a student will guess the correct answer
They are relatively easy for a teacher to construct.
They are will adapted to mathematics, the sciences, and foreign languages where specific types of
knowledge are tested (The formula for ordinary table salt is ________).
They are consistent with the Socratic question and answer format frequently employed in the
elementary grades in teaching basic skills.
Disadvantages:
May overemphasize memorization of facts
Take care - questions may have more than one correct answer
Scoring is laborious
According to Grounlund (1995) there are also a number of disadvantages with short-answer items.
They are limited to content areas in which a student’s knowledge can be adequately portrayed by
one or two words.
They are more difficult to score than other types of objective-item tests since students invariably
come up with unanticipated answers that are totally or partially correct.
Short answer items usually provide little opportunity for students to synthesize, evaluate and
apply information.
4.2.3 Essay
Essay questions are supply or constructed response type questions and can be the best way to measure the
students' higher order thinking skills, such as applying, organizing, synthesizing, integrating, evaluating,
or projecting while at the same time providing a measure of writing skills. The student has to formulate
and write a response, which may be detailed and lengthy. The accuracy and quality of the response are
judged by the teacher.
Essay questions provide a complex prompt that requires written responses, which can vary in length from
a couple of paragraphs to many pages. Like short answer questions, they provide students with an
opportunity to explain their understanding and demonstrate creativity, but make it hard for students to
arrive at an acceptable answer by bluffing. They can be constructed reasonably quickly and easily but
marking these questions can be time-consuming and grade agreement can be difficult.
Essay questions differ from short answer questions in that the essay questions are less structured. This
openness allows students to demonstrate that they can integrate the course material in creative ways. As a
result, essays are a favoured approach to test higher levels of cognition including analysis, synthesis and
evaluation. However, the requirement that the students provide most of the structure increases the amount
of work required to respond effectively. Students often take longer time to compose a five paragraph
essay than they would take to compose paragraph answer to short answer questions.
Essay items can vary from very lengthy, open ended end of semester term papers or take home tests that
have flexible page limits (e.g. 10-12 pages, no more than 30 pages etc.) to essays with responses limited
or restricted to one page or less. Essay questions are used both as formative assessments (in classrooms)
and summative assessments (on standardized tests). There are 2 major categories of essay questions --
short response (also referred to as restricted or brief) and extended response.
Restricted Response: more consistent scoring, outlines parameters of responses
Extended Response Essay Items: synthesis and evaluation levels; a lot of freedom in answers
Example 1:
List the major similarities and differences in the lives of people living in Islamabad and Faisalabad.
Example 2:
Compare advantages and disadvantages of lecture teaching method and demonstration teaching method.
Example:
Identify as many different ways to generate electricity in Pakistan as you can? Give advantages and
disadvantages of each. Your response will be graded on its accuracy, comprehension and practical ability.
Your response should be 8-10 pages in length and it will be evaluated according to the RUBRIC (scoring
criteria) already provided.
Over all Essay type items (both types restricted response and extended response) are
Good for:
Application, synthesis and evaluation levels
Types:
Extended response: synthesis and evaluation levels; a lot of freedom in answers
Restricted response: more consistent scoring, outlines parameters of responses
Advantages:
Students less likely to guess
Easy to construct
Stimulates more study
Allows students to demonstrate ability to organize knowledge, express opinions, show originality.
Disadvantages:
Can limit amount of material tested, therefore has decreased validity.
Subjective, potentially unreliable scoring.
Time consuming to score.
Activity 4.6: Develop an essay type test on this unit while covering the levels of knowledge,
application and analysis.