Vol 26 2 PDF
Vol 26 2 PDF
Vol 26 2 PDF
Editor
SANDRA SILBERSTEIN, University of Washington
Associate Editor
SANDRA McKAY, San Francisco State University
Review Editor
HEIDI RIGGENBACH, University of Washington
Brief Reports and Summaries Editor
GAIL WEINSTEIN-SHR, University of Massachusetts at Amherst
Research Issues Editor
GRAHAM CROOKES, University of Hawaii at Manoa
Assistant Editors
DEBORAH GREEN, University of Washington
MARILYN KUPETZ, TESOL Central Office
Editorial Assistant
MAUREEN P. PHILLIPS, University of Washington
Editorial Advisory Board
Roberta G. Abraham Thom Hudson
Iowa State University University of Hawaii at Manoa
Joan G. Carson Claire Kramsch
Georgia State University University of California, Berkeley
Jim Cummins Anne Lazaraton
Ontario Institute for Studies in Education The Pennsylvania State University
Graham Crookes
University of Hawaii at Manoa Michael K. Legutke
Catherine Doughty Goethe Institute, Munich
The University of Sydney David Nunan
Miriam Eisenstein Macquarie University, Sydney
New York University Teresa Pica
Yehia El-Ezabi University of Pennsylvania
United Arab Emirates University/
The American University in Cairo N. S. Prabhu
Susan Gass National University of Singapore
Michigan State University Thomas Ricento
Jean Handscombe Central Michigan University
North York Board of Education, Toronto Patricia L. Rounds
Sarah Hudelson University of Oregon
Arizona State University
Thomas Huckin Andrew F. Siegel
University of Utah University of Washington
Additional Readers
Gregory Barnes, Ruth Benander, Ulla Connor, David Eskey, Ilona Leki, Ann Raimes, Thomas Scovel,
James W. Tollefson, Carole Urzúa, Elizabeth Whalley, Richard Young
Credits
Advertising arranged by Patti Olson, TESOL Central Office, Alexandria, Virginia
Typesetting, printing, and binding by Pantagraph Printing, Bloomington, Illinois
Design by Chuck Thayer Advertising, San Francisco, California
VOLUMES MENU
TESOL QUARTERLY
CONTENTS
ARTICLES
The Dynamics of the Language Lesson 225 (10-26)
N. S. Prabhu
Communicative Competence and the Dilemma of
International Teaching Assistant Education 243 (28-54)
Barbara Hoekje and Jessica Williams
ESL Student Bias in Instructional Evaluation 271 (56-73)
Ann K. Wennerstrom and Patty Heiser
Beyond Comprehension Exercises in the
ESL Academic Reading Class 289 (74-103)
May Shih
See How They Read: Comprehension Monitoring
of L1 and L2 Readers 319 (104-128)
Ellen L. Block
The Effect of Speech Modification, Prior Knowledge,
and Listening Proficiency on EFL Lecture Learning 345 (130-159)
Chung Shing Chiang and Patricia Dunkel
REVIEWS
The Cornell Lectures: Women in the Linguistics Profession 375
Alice Davison and Penelope Eckert
Reviewed by Johnnie Johnson Hafernik
Building Better English Language Programs:
Perspectives on Evaluation
Martha C. Pennington (Ed.)
Reviewed by Daniel L. Robertson
BOOK NOTICES
Teaching Language Minority Students in the Multicultural Classroom,
Robin Scarcella (Marjorie Terdal) 381
Multicultural Education: A Teacher’s Guide to Content and Process
Hilda Hernandez (Ilyse Rathet Post)
Communicative Strategies: A Psychological Analysis of Second-Language Use,
Ellen Bialystok (Greg Jewell)
Volume 26, Number 2 ❑ Summer 1992
THE FORUM
Comments on Suzanne Irujo’s Review of Rosalie Pedalino Porter’s
Forked Tongue: The Politics of Bilingual Education 397
A Reader Reacts . . .
Keith Baker
The Reviewer Responds . . .
Suzanne Irujo
Teaching Issues
Formal Grammar Instruction 406
An Educator Comments . . .
Marianne Celce-Murcia
Another Educator Comments . . .
Stephen D. Krashen
Editor’s Note
With this issue, I welcome two new members to the editorial staff of the
TESOL Quarterly. I am pleased to announce that Sandra McKay has
accepted the newly created position of Associate Editor. Beginning with
this issue, Marilyn Kupetz of TESOL’S Central Office shares with Deborah
Green some of the duties of the Assistant Editorship. I am grateful to all
these colleagues for their significant contributions.
This issue premiers a new subsection of The Forum, Teaching Issues,
edited by Sandra McKay. In each instance, an aspect of teaching will be
addressed, frequently from somewhat different perspectives. Although
contributions will typically be solicited, readers are encouraged to submit
topic suggestions and/or make known their availability as contributors by
contacting Sandra McKay at the address provided in the Information for
Contributors section of the Quarterly.
Finally, I note with pleasure that the TESOL Quarterly’s 26th volume is
printed entirely on recycled paper. Readers with a taste for irony (or
mnemonics) will appreciate that this transition coincides accidentally with
the choice of a green cover for this volume.
In this Issue
221
event, an implementation of a method, a social event, and an arena of
human interaction. Lessons reconcile these conflicting dimensions, in
part through reliance on stable classroom routines. A change in
protective classroom routines becomes productive only when teachers’
own theories are engaged in classroom activities: “This involves
teachers being their own theorists and specialists interacting with
teachers as fellow theorists.”
● Barbara Hoekje and Jessica Williams critique a traditional skills-based
approach to the training of international teaching assistants (ITAs),
arguing that it ignores dimensions of context and role. The authors
advocate reconceptualizing language skills in terms of communicative
competence, “a theoretical model of language use that takes into
account social relationships, language appropriateness, and context.”
This recasting allows ITA programs to justify instruction that
necessarily goes beyond traditional notions of language teaching in
order to prepare ITAs for their new roles as university teachers.
• Ann Wennerstrom and Patty Heiser’s study examines ESL student bias
in instructional evaluation. The researchers find systematic bias on the
basis of ethnic background, level of English, course content, and
attitude toward the course. In light of these findings, the authors
question the use of ESL student evaluations as the basis of personnel
decisions. They recommend that student evaluation data “be used only
in conjunction with other measures. ”
• May Shih’s suggestions go beyond traditional skill-building compre-
hension activities in the ESL academic reading class. Citing research on
comprehension and study strategies, she advocates holistic strategy-
oriented activities. Practical and detailed guidelines are offered to aid
teachers in selecting and sequencing reading materials, designing
criterion tasks, and providing instruction in reading strategies. Shih
advocates activities that promote learner independence and transfer of
strategies from ESL to content reading.
• Ellen Block compares the comprehension-monitoring strategies of L1
and L2 readers with respect to two problems: locating a referent and
defining a vocabulary item. Differences seem to arise more from
readers’ proficiency level than language background. Think-aloud
protocols reveal three comprehension phases: evaluation, action, and
checking. Although she identifies some parallels, Block cautions against
applying results of L1 reading research to L2 readers. On the basis of
this comparative study, she recommends process- and strategy-
oriented L2 reading instruction in which students are taught to identify
reading problems and develop strategies to resolve them.
• Chung Shing Chiang and Patricia Dunkel investigate the listening
comprehension of high- and low-intermediate Chinese EFL students.
Their study explores the effects of speech modification, prior
knowledge, and listening proficiency on listening comprehension.
225
THE LESSON AS A CURRICULAR UNIT
Let me begin with a familiar perspective on a lesson, namely, that
it is a stage in the implementation of a course. The curriculum
normally is organised as an incremental sequence of teaching units,
the sequence as a whole meant to achieve a large objective, and
each unit in it meant to achieve a small subobjective. Classroom
teaching is seen as a steady movement from the first unit to the last,
and any given lesson is viewed as the completion of one small part
of the journey. What happens in a lesson is, from this perspective,
best understood by reference to earlier and later lessons and by
seeing the logic of the overall sequence.
It is worthwhile noticing here the nature of the connection
between curricular progression and the educative process.
Education is centrally concerned with the mind: Language
education aims to promote one form of mental development in
learners, whether we conceive of it as the development of cognitive
structures or cognitive skills, the realisation of an inherent capacity,
or the creation of a new capacity. In designing educational activity,
this concept of psychological progress is translated into one of
curricular progression, the metaphor of a journey being equally
applicable to both. The completion of a lesson as a curricular unit is
thus meant to represent the completion of a step in the learner’s
psycholinguistic development. If this is taken seriously, a given
lesson has to be understood and assessed in relation to its match
with the learner’s developmental stage at that point, rather than in
relation to preceding and following units. The reason why this is not
done is that it is extremely difficult to perceive the learner’s actual
developmental stage at each point and that the day-to-day activity
of classroom teaching needs to have a more accessible and stable
source of guidance. The provision of a curricular sequence enables
the teacher to assume, without having to ascertain, that each unit in
the sequence matches a corresponding point in the learner’s
progress. A fundamental reason for constructing a curriculum,
therefore, is to give the classroom teacher a workable alternative to
the difficult task of following the learner’s actual development.
However, this workable alternative involves the belief that the
curriculum represents a predetermination of the learner’s
development, both at particular points and over a stretch of time
(i.e., the course); and this in turn implies that the curriculum
developer has far better access than the teacher to the learner’s
mental development: The curriculum developer attempts to predict
or decide in advance the process of development before it takes
place, while the teacher has difficulty perceiving it as it happens. It
ACKNOWLEDGMENT
A version of this paper was presented as a featured talk at the 25th Annual TESOL
Convention in New York, March 1991.
THE AUTHOR
N. S. Prabhu teaches applied linguistics at the National University of Singapore.
His earlier work in India included the development of task-based language
teaching and the concept of a procedural syllabus, in the context of what is
generally known as the Bangalore Project.
JESSICA WILLIAMS
University of Illinois at Chicago
243
In an effort to provide more narrowly focused instruction than is
found in general ESL programs, ITA program developers have
frequently tried to specify the discourse functions and domains that
are most important for ITAs. Typically, course development begins
with what Hutchinson and Waters (1987) have called a language-
centered or skill-centered needs analysis. First, native-speaker
teaching assistants (NSTAS) are observed to determine the language
items and functions integral to an ITA’s success. Next, a needs
analysis is undertaken to determine the communication skills ITAs
presently hold or lack.
Early language- and skill-centered needs analyses of ITAs (see
papers in Bailey et al., 1984) revealed, among other things, that ITAs
needed to interact in colloquial spoken English inside and outside
the classroom. Interestingly, the early studies also revealed the
particular importance of the nonlinguistic factors: ITAs who were
highly authoritarian in approach were often more likely to cause
resentment among undergraduates than those who were less
linguistically skilled but more in tune with typical patterns of
classroom interaction (Landa & Perry, 1984; Shaw & Garate, 1984).
Similarly, ITAs with excellent teaching skills seemed to surpass the
language barrier, in terms of undergraduate satisfaction, whereas
those with poorer teaching skills could not (Bailey, 1984). An
understanding of the organization and rationale of the U.S.
classroom setting and undergraduates’ expectations of teaching was
seen as crucial. Thus, a focus on culture, pedagogy, and language
became an early focus of ITA instruction. In a recent survey of 26
ITA programs across the U.S. (Barnes, Finger, Hoekje, & Ruffin,
1989), program administrators continued to state ITA needs in
terms of these three categories. New ITA course texts stress the
same areas.
There appears to be a consensus in the field that adequate ITA
training should include culture, pedagogy, and language, but the
question of the relative importance of each and the relationship of
one area to the other remains. Many ITA curricula are organized
along some variation of this three-part approach; however, such
curricula are inadequate in several respects. We believe that an
underlying problem of many skills-based ITA curricula is an
insufficient recognition of context and role. Indeed, sociolinguistic
research over the past few decades has demonstrated the over-
whelming importance of analyzing communication in context. For
example, ITAs who practice 10- to 15-minute presentations in the
teaching-skills section of the ITA course, may be stonily received
by their undergraduate students who do not expect rehearsed
deliveries. ITAs who transfer the concept of U.S. classroom
—
into account social relationships, language appropriateness, and
context. Sociolinguistic models of language use, such as those of
communicative competence proposed by Hymes (1972), and more
specifically, in their more pedagogical applications, by Canale
(1983), Canale and Swain (1980), and Savignon (1983), are an
appropriate basis for developing models of ITA competence and
for examining ITA language use. Such a framework should be used
as a basis for setting goals, designing curriculum, and evaluating
results.
We are not the first to consider communicative competence an
appropriate goal for ITA programs; in fact, ITA research is
increasingly being carried out within this or compatible perspec-
tives, as demonstrated, for example, by the presentations of such re-
searchers as Davies (1991), Myers (1991), Rounds (1990), and Tyler
(1990) in preconference symposia on ITA training at recent TESOL
Conventions. Following in this tradition, our purpose is to propose
communicative competence as a general, theoretical framework for
ITA instruction, and to review relevant studies in this light. We
intend to demonstrate the advantage of this framework as an
organizing principle for ITA curriculum and evaluation, and to
provide a theoretically sound basis for responding to language
legislation. We believe that only when ITA programs are situated
within this framework can we emerge from the dilemma regarding
turf and legality.
In the following section, we discuss the overall construct of
communicative competence and provide a detailed discussion of
the individual components of linguistic, sociolinguistic, discourse,
and strategic competence in terms of how they apply to ITA
programs. In the process, we review many studies of ITAs in light
of this model and give examples from our own observations of ITAs
in the classroom. Finally, after having come to a fuller understand-
ing of the nature of ITA language use and the goals of ITA training,
we turn to the issue of appropriate assessment.
Grammatical Competence
In the Canale and Swain (1980) framework, grammatical
competence refers to knowledge of the rules of morphology,
syntax, sentence-grammar semantics, lexical items, and phonology
“to determine and express accurately the literal meaning of
utterances” (p. 30). It is clear that the promotion of grammatical
competence is one of the goals of ITA training; however, it has
proved a particularly problematic area to address.
One reason is that ITA programs are usually multilevel, with
students showing widely varying proficiencies in the same class.
According to second language acquisition theory, learners acquire
the target language systematically, the process of acquisition
represents the movement toward proficiency in the target language
(Klein, 1986). Thus, a reasonable goal for the development of
second language grammatical competence would be facilitating the
acquisition of the target language through the ordered presentation
of material appropriate to the learner’s current level of proficiency
(Rutherford, 1988). But with learners at widely varying levels, such
facilitation within the classroom is a difficult and therefore,
perhaps, unrealistic goal. Moreover, there is often a lack of
reinforcing input or opportunities for English use outside the
classroom (Ard, 1987).
Perhaps most importantly, however, is the fact that the time for
training is short, whereas the improvement of grammatical
accuracy can be a time-consuming, long-term process. ITA courses
typically range from an average of 1 to 8 weeks preterm, or possibly
1 to 2 terms (several hours per week) concurrent with the academic
program (Barnes et al., 1989). During this relatively short time, ITA
programs are required to prepare students, who are often new to
the U.S. and may have limited language skills, to successfully
handle a demanding teaching role. Given the time constraints, and
keeping in mind the needs of the native English-speaking
undergraduates, the most effective means for an ITA to improve
communication may be through pragmatic rather than linguistic
means. For example, ITAs who mispronounce terms can become
more intelligible by learning to recognize which terms are
Sociolinguistic Competence
In the original Canale and Swain (1980) model, sociolinguistic
competence included both knowledge of the sociocultural rules of
Discourse Competence
Grammatical and sociolinguistic competence, though important,
do not give a complete picture of ITA communicative competence.
It is equally important to know how to integrate these components
to produce and interpret cohesive and coherent discourse. Canale
(1983) has referred to this component as discourse competence,
encompassing both productive and interpretive abilities.
Cohesion refers to the ways in which utterances are connected so
as to produce unified oral or written text. There is evidence that
ITAs often fail to produce texts that attain the level of cohesion
necessary for easy interpretation. In the following excerpt, the
speaker, an L1 Mandarin ITA, at the end of an introduction to the
law of the conservation of energy, consistently overuses and over-
generalize the connectors and and so, often making the relation-
ships among propositions difficult to interpret. Of a group of 22
ESL professionals who listened to this presentation, 16 identified
the use of these connectors as a source of confusion:
2. A few days ago I met an American friend and he’s a very pious person
and he tell us—he told me—he recommend me study the Bible and
the first thing he told was that God create everything . . . so I think it
disobey the energy conservation law because according this law
energy cannot be create and cannot be destroy so that is a
contradiction and a very interesting problem.
Coherence is the other important element of discourse compe-
tence, according to Canale. Two areas of coherence, continuity and
progression, are essential aspects of ITA discourse. Continuity may
be indicated by repetition and rephrasing; progression by a variety
of discourse markers that identify the parts of an explanation as well
as the relationship among these parts. Adequate marking of this
kind has been shown to be an important element of comprehensi-
bility (Chaudron & Richards, 1986).
Discourse competence has been investigated in the context of
ITA production in a number of studies. The results of these studies
have yet to be fully incorporated into ITA curricula, but are
Strategic Competence
Strategic competence is described by Canale as the mastery of
verbal and nonverbal strategies that can either be used to
compensate for deficiencies in other areas of competence or to
increase communicative effectiveness in general. Because ITAs,
almost without exception, demonstrate gaps in the first three areas
of communicative competence, this component may prove to be a
crucial one. It may be possible to teach ITAs communication
strategies in order to make up for knowledge or abilities that are
weak in other areas; in this way, they may learn to use
compensatory strategies to increase their effectiveness as teachers.
On the nonverbal level, strategic competence could include the
knowledge of the advantages and disadvantages of particular
ASSESSMENT OF ITAs
The assessment of ITA performance is clearly tied to the goals
and methods of training. Because the ITA problem has been viewed
CONCLUSION
Until the ITA preparation curriculum is truly contextualized,
many ITA trainers will continue to find themselves in the double
bind to which Bailey alludes. If they pursue what may be seen as the
ethical course of limiting preparation courses to language teaching
with a bit of culture thrown in, they will surely fail. If, on the other
hand, the goal of ITA training is viewed as preparing the student to
effectively take on the role of TA with all that entails (teaching,
managing the classroom, advising), as we have proposed here, they
lay themselves open to charges of discrimination, either against
ITAs, who are forced to do extra work, or against NSTAs, who did
not have access to special training (see Brown, Fishman, & Jones,
1990). The central question that has been put to our field is whether
we as ITA educators have the right or duty to provide nonlinguistic
training to ITAs when it is not provided to NSTAs. Knowing that
such training may, in fact, be more effective in improving
classroom performance than attempts to improve linguistic
competence, is it possible or advisable to reject it in the name of a
presumed legal parity? We have tried to argue here that the notion
of language skills in a narrow sense keeps us firmly locked into this
dilemma. We have claimed that ITA education that does not
include the rich context we have described here can result only in
limited success. Therefore, the only way out of this dilemma is to
aim for parity, to provide education and support for all TAs who
lack classroom experience. It is unfortunate that, in this time of
contracting resources, this is an unlikely scenario. We hope that a
reconceptualization of language skills in terms of communicative
competence provides the theoretical means with which to begin to
recast this issue. The ITA curriculum has developed from the
THE AUTHORS
Barbara Hoekje is Associate Director of the English Language Center at Drexel
University. She has written and presented on ITA education since 1984.
REFERENCES
Abraham, R., Anderson-Hsieh, J., Douglas, D., Myers, C., & Plakans, B.
(1988). Evaluation and instructional program for international teaching
assistants. Paper presented at the 22nd Annual TESOL Convention,
Chicago, IL.
Anderson-Hsieh, J. (1990). Teaching suprasegmentals to international
teaching assistants using field-specific materials. ESP Journal, 9, 195-214.
Ard, J. (1987). The foreign TA problem from an acquisition-theoretic
point of view. English for Specific Purposes, 6, 133-144.
Bachman, L. (1988). Problems in examining the validity of the ACTFL
oral proficiency interview. Studies in Second Language Acquisition, 10,
149-164.
Bachman, L. (1990). Fundamental considerations in language testing.
Oxford: Oxford University Press.
271
Pennington and Young (1989) also recommend that a variety of
measures be used in an evaluation process. They propose that
different aspects of teaching be assessed at various stages of a
teacher’s professional development and note that student
evaluations may be more appropriate at certain developmental
stages than at others.
Another area of concern regarding student evaluations is that of
instrument development. A large body of research at U.S.
universities has centered on testing the reliability and validity of
instruments (Centra, 1972; Gillmore, Kane, & Naccarato, 1978;
Marsh, 1981; McKeachie, 1979). Out of this research have come
several standardized evaluation instruments which are still widely
used, such as Students’ Evaluations of Educational Quality (SEEQ)
(Marsh, 1982), Endeavor (Frey, Leonard, & Beatty, 1975), and the
Michigan State University Student Instructional Rating System
(SIRS) (Warrington, 1973).
Also related to the issue of instrument development is whether an
evaluation questionnaire measures more than one dimension of
teaching, since teaching is obviously a complex activity with many
components working together to make a successful class. Marsh
(1984), who has done extensive research on evaluations in U.S.
universities, warns of the danger of lumping all evaluation questions
into one category:
If a survey instrument contains an ill-defined hodgepodge of items, and
student ratings are summarized by an average of these items, then there
is no basis for knowing what is being measured, no basis for
differentially weighting different components in the way most
appropriate to the particular purpose they are to serve, nor any basis for
comparing these results with other findings. (p. 709)
To address this problem, a number of studies have been
conducted in U.S. university classes to distinguish the effects of
multiple dimensions of teaching (Frey, Leonard, & Beatty, 1975;
Marsh, 1982; Warrington, 1973). Such studies use factor analysis,
which extracts a small number of useful factors from a data set. For
example, as revealed by factor analysis, the Michigan State
University SIRS instrument measures five different aspects of
teaching: instructor involvement, student interest and performance,
student-instructor interaction, course demands, and course
organization. Another factor analysis by Frances and Gruber (1981)
found two dimensions, which they call instructor evaluation and
student motivation. Factor analysis on the Endeavor and SEEQ
instruments revealed seven and nine dimensions, respectively
(Marsh, 1984).
METHODOLOGY
Interviews with Teachers
In a series of informal, individual interviews with 16 teachers, a
skepticism about the fairness of student evaluations was revealed, as
summarized below.
The first concern was that low-proficiency-level ESL students,
because of limited English ability, would not be able to understand
questions presented to them on evaluation forms. A second concern
was that student dissatisfaction with program-wide constraints such
as testing procedures, required courses, and the like, would be
reflected negatively in student evaluations, thereby counting against
the teacher. The third, and perhaps the greatest, fear among
teachers was of student bias. Teachers wondered whether certain
cultures would rate more strictly than others, whether certain
courses were more popular than others regardless of who was
teaching them, and whether higher level students were stricter due
to a perception of a slower rate of progress in a course.
Pilot Study
A pilot study was conducted among 19 teachers in 35 classes of
ESL students in an intensive English program. Students received
surveys about their cultural and personal backgrounds, with
questions on country, age, gender, level of English, and course type;
the survey asked whether or not students were repeating the course.
They also received a course evaluation questionnaire, the language
of which was simplified for ESL students. A multiple regression
analysis similar in form to that subsequently used in the principal
study tested for bias. Afterwards teachers and students were
interviewed about the process.
Two important results were obtained from this pilot study. First,
the multiple regression analysis showed some preliminary
Principal Study
The principal study was conducted over four academic quarters
(one year) in each of two ESL programs, a required academic
English program for matriculated university students scoring 500-
580 on the TOEFL (Test of English as a Foreign Language), and an
intensive English program of five levels from beginning to
advanced. Teachers were required to distribute a background
survey and 16-question evaluation form in each class. The
evaluation form, shown in Figure 1, also included two questions to
measure student attitude. Each question was rated on a 5-point scale
from 0 to 4. Students were told that the purposes of the evaluation
were both to provide feedback to their teachers and data for
research. It was made clear that none of the data would affect the
teachers’ employment status. In the academic program there were
522 evaluations collected, a 62% response rate; in the intensive
program there were 2,658, a 69% response rate. (Nonresponse was
due either to student absence or, in some cases, to teachers’ not
distributing the forms.)
Factor analysis was used to test for multidimensionality, that is, to
determine whether students distinguish certain subgroups among
the 16 evaluation questions. On the model of Marsh (1982), we
conducted the factor analysis using a Kaiser normalization and an
Oblimin rotation. Cluster analysis was also used to look for sub-
groups among the evaluation questions. While cluster analysis
preserves the identity of individual questions, grouping them into
larger and larger groups based on their similarity (see Norussis,
1988, pp. 71-101), factor analysis actually constructs single factors
from combinations of multiple questions. These two complemen-
tary approaches both shed light on the internal structure of these
multivariate data sets.
Neither of these analyses, however, incorporates the background
variables, so multiple regression analysis was used for this purpose.
—
FIGURE 1
Evaluation Questionnaire
RESULTS
Tests for Subgroups
In testing whether there were subgroups among the 16 evaluation
questions, we looked at the two programs independently. For the
intensive program, factor analysis suggests that the evaluation
questions fall into two subgroups, reflecting what we call a teacher
TABLE 1
Factor Loadings for the Intensive Program
Factor 1 Factor 2
TABLE 3
Multiple Regression Analysis of Teacher Subgroup in the Intensive Program
Regression
Variable coefficient SE P
Ethnic background (Japan = baseline)
Indonesian
Thai
Korean
European
Latin American
Arabic speaking
Chinese
Course type (Grammar = baseline)
Listening
Electives
Reading
writing
Level
Time in program
Age
constant
2 Students self-selected ethnic backgrounds from a list of categories which represented the
typical student population of the programs.
TABLE 4
Multiple Regression Analysis of Learning Experience Subgroup in the Intensive Program
DISCUSSION
It is evident that systematic bias did occur in the evaluation
process, due most significantly to level, course type, ethnic
ACKNOWLEDGMENTS
Support for this project came from the University of Washington Extension
English as a Second Language Programs. We would like to thank Director Bill
Harshbarger for his help and encouragement during our research. We are grateful
to Andrew F. Siegel, Gerry Gillmore, and David Carrell for their assistance with
statistics and computing. We would also like to thank all the students and teachers
who participated.
THE AUTHORS
Ann K. Wennerstrom is coordinator of the international teaching assistant training
course at the University of Washington Extension English as a Second Language
Programs, where she also teaches academic English. She is currently a doctoral
student in Linguistics.
Patty Heiser, Acting Academic Coordinator at the University of Washington
Extension English as a Second Language Programs, teaches in both intensive and
academic English programs. Her work in developing the programs’ Performance
Appraisal System led to an interest in bias in student evaluations.
289
determining main ideas, finding supporting details or arguments,
and guessing unfamiliar vocabulary by using context clues), and
exercises to expand linguistic competence (e.g., word study and
sentence analysis exercises). In this skill-building approach, it is
assumed that practice of basic skills will enable students to handle
actual content-area reading assignments.
For students beyond the beginning level of language proficiency,
however, we must ask whether this discrete-skills approach is the
best we can offer to equip them to meet the demands of real
content classes. The emphasis in this traditional instruction is on
facilitating short-term reading comprehension. Study skills often are
not taught, or are taught generically, without reference to specific
academic assignments (criterion tasks), and different academic
disciplines. In academic content classes, students must not only
comprehend texts, but over the long term, critically react to the
content (e.g., in class discussion some time after reading an
assignment), recall main points and details when tested (perhaps
several weeks after initial reading), and synthesize information
from reading with other related information, such as from lectures,
discussion, and independent reading. The concentration, memory,
critical thinking, and study planning skills needed to learn and
demonstrate learning in this academic process are demanding for
native English speakers, and can be very discouraging for students
being educated in a second language and in an unfamiliar
educational system. In addition, in content classes, students face
lengthy, conceptually dense prose in textbook and supplementary
reading assignments. Typically, ESL students experience a large
leap in moving from the relatively short, varied readings of ESL
classes to the complex discourse they must manage in their content
classes.
Indeed, difficulty reading and studying content-area texts is high
on the list of problems cited in surveys of ESL students who have
exited from intensive, preuniversity ESL programs (Christison &
Krahnke, 1986; Ostler, 1980) as well as from college developmental
reading and writing programs (Smoke, 1988). ESL students
experience great difficulties when they make the transition to the
English-medium academic mainstream, whether it be at the
elementary or secondary level (Collier, 1987) or at the college level
(Benesch, 1988; Snow& Brinton, 1988a, 1988b).
EAP reading instruction should and can assist ESL students to
make the transition from “learning to read” to “reading to learn,”
but a fundamentally different approach is needed. Reading materi-
als and tasks should resemble materials and tasks students face in
CRITERION TASKS
Content-area instructors guide and assess learning by the kinds of
tasks that they assign to students (Doyle, 1983). Academic tasks may
Before Reading
When the goal of reading is in-depth comprehension and good recall
of information from expository text, previewing (surveying,
overviewing) facilitates the process because it familiarizes a reader
with the basic content and organization of the text and helps to
activate relevant prior knowledge. Students need to learn why and
how to preview texts of various types (e.g., textbook, textbook
During Reading
Knowledge of the organization of a particular text and of common
textual signals can help a reader identify important information as
well as relationship between ideas in the text. Van Dijk (1979)
provides a list of types of signals which can be used to identify
important ideas:
1) graphical: type size, italics, underlining; 2) syntactical: word order,
topicalization, 3) lexical: words like important, relevant, the subject is,
the conclusion is; 4) semantic: thematic words and sentences,
summarizing or introductory sentences, repetition; 5) schematic/
After Reading
After initial reading of a text (immediately afterwards and in the
days preceding a test or assignment due date), students can make
use of a variety of strategies to organize, reduce, and rehearse
important information from their reading to facilitate recall on a test
and to stimulate thinking in order to tackle other assignments such
as papers.
Note-taking and summarizing are useful strategies for organizing
and condensing information to be remembered for a test or ideas to
be applied to an oral presentation or written assignment.
“Theoretically, notetaking has great potential as a study aid, for it
allows the student to record a reworked (perhaps more deeply
processed) version of the text in a form appropriate for the criterion
task (Anderson & Armbruster, 1984b, p. 666). In general, studies
report significant positive effects on recall for students who both
take notes and review them in a timely fashion (see studies
reviewed by Hidi & Klaiman, 1983; McAndrew, 1983; and Smith &
Tompkins, 1988). Students can benefit from formal training in note-
taking with an emphasis on paraphrasing and on connecting ideas to
prior knowledge.
Notes may take many possible forms. Note cards or concept
cards (term, person, concept on one side of an index card, its
definition, description, or related ideas on the other) are useful for
reviewing factual material (Nist & Diehl, 1990a). Note cards are
also useful when collecting material for a multiple-source research
paper, as they are easy to manipulate. An informal outline form for
notes is a good way to show relationships between ideas. Two-
column notes (narrow lefthand column for key concepts, righthand
column for elaboration), also called the Cornell notetaking system,
facilitate organization of ideas and self-testing (see Santa, Havens,
& Harrison, 1989, who highly recommend this system for science
classes, and Pauk, 1989). Another note-taking format is “structured
note-taking,” a blend between graphic organization and an informal
outline (Smith & Tompkins, 1988). If students are aware of alterna-
tive formats for note-taking, they can choose formats suitable to
specific tasks and personal learning styles.
Writing summaries, that is, succinct statements of the main
idea(s) and key supporting points of a text or text segment, is an
Support Strategies
Successful academic learning involves not only effective use of
cognitive and metacognitive strategies, but also techniques to deal
with problems due to affective factors and practical constraints,
problems such as lack of an appropriate study environment,
THE AUTHOR
May Shih is Assistant Professor of English at San Francisco State University, where
she teaches in the ESL and MA TESL programs. She has coordinated and
developed materials for a two-semester, freshman ESL course in reading,
composition, and study skills.
REFERENCES
Adams, T. W. (1989). Inside textbooks: What students need to know.
Reading, MA: Addison-Wesley.
Adamson, H. D. (1990). ESL students’ use of academic skills in content
courses. English for Specific Purposes, 9, 67-87.
Alessi, S. M., Anderson, T. H., & Goetz, E. T. (1979). An investigation of
lookbacks during studying. Discourse Processes, 2, 197-212.
Anderson, T. H. (1980). Study strategies and adjunct aids. In R. J. Spiro,
B. C. Bruce, & W. F. Brewer (Eds.), Theoretical issues in reading
comprehension (pp. 483-502). Hillsdale, NJ: Lawrence Erlbaum.
Anderson, T. H., & Armbruster, B. B. (1982). Reader and text-studying
strategies. In W. Otto & S. White (Eds.), Reading expository material
(pp. 219-242). New York: Academic Press.
Anderson, T. H., & Armbruster, B. B. (1984a). Content area textbooks. In
R. C. Anderson, J. Osborn, & R. J. Tierney (Eds.), Learning to read in
American schools: Basal readers and content texts (pp. 193-226).
Hillsdale, NJ: Lawrence Erlbaum.
Anderson, T. H., & Armbruster, B. B. (1984b). Studying. In
P. D. Pearson, R. Barr, M. L. Kamil, & P. Mosenthal (Eds.), Handbook
of reading research (pp. 657-680). New York: Longman.
Anderson, T. H., & Armbruster, B. B. (1986). Readable textbooks, or,
selecting a textbook is not like buying a pair of shoes. In J. Orasanu
(Ed.), Reading comprehension: From research to practice (pp. 151-162).
Hillsdale, NJ: Lawrence Erlbaum.
319
believe that readers actively control this hidden process, and that
this control directly affects their ability to understand and to learn
from text. (See Baker & Brown, 1984; Garner, 1987; Paris, Wasik, &
Van der Westhuigan, 1988, for reviews of research on metacogni-
tion.)
This control, commonly called metacognition, involves thinking
about what one is doing while reading. It is an ability that develops
relatively late because it involves the ability to stand back and
observe oneself. It is also an ability often related to effective
learning and to competent performance in any area of problem
solving. Experts plan, predict outcomes, and monitor their
performance more consistently than do novices.
Although “most characterizations of reading include skills and
activities that involve metacognition” (Baker & Brown, 1984,
p. 354), little is known about what happens during the metacogni-
tive process. This paper investigates one aspect of that process,
comprehension monitoring, to see how it operates for first and
second language readers.
To date, most of the research involving comprehension
monitoring has been conducted with native speakers of English, but
there are reasons to believe that comprehension monitoring is of
particular importance for L2 readers. Indeed, Casanave (1988) has
called comprehension monitoring “a neglected essential” in L2
reading research. For one thing, L2 readers can be expected to
encounter more unfamiliar language and cultural references while
reading authentic or unadapted texts than L1 readers would. They,
therefore, may have to “repair” more gaps in their understanding
than L1 readers.
Information from related areas supports the idea that second
language learners may be particularly able to reflect on their
cognitive processes. Metalinguistics awareness seems to play a
special part both in learning to read and in learning a second
language (Bialystok & Ryan, 1985). Hakuta, Ferdman, and Diaz
(1987) report that bilingual profit from sensitivity to metalinguistic
information. Although metalinguistic data is not synonymous with
metacognition, both areas provide evidence for a kind of internal
control that increases the efficiency of some cognitive processes.
Yet, to date, we know little about how detection and regulation
processes operate in L2 readers.
The results of research involving monolingual first language
speakers of English indicate that comprehension monitoring
operates rather automatically, particularly in good readers, and is
not readily observable until some triggering event, some confusion
or failure to comprehend, occurs (Baker & Brown, 1984). A reader
TABLE 1
Steps in Monitoring a Referent Problem
20. It says from English to Urdu, as languages, and I don’t know where
that originated from.
These 3 readers seemed unconcerned with defining this unknown
word and focused on other issues. The first reader summarized and
generalized from the sentence; the second and third questioned the
information presented.
A second group (3 more of the 8) identified the problem more
explicitly and guessed that Urdu had something to do with Africa.
(Steps in the process are indicated within brackets.)
21. [PROBLEM RECOGNITION + SOURCE IDENTIFICATION] I
don’t know what Urdu is. [SOLVE] At first I thought it was Africa
‘cause it just has that sound. [REVISE] Then I saw that it must be
languages.
22. [SOLVE] It’s just probably another language I never heard of, like
African, or something like that.
23. [SOLVE] I guess it [Urdu] might be in the Middle East or in Africa.
Only the first reader explicitly checked his response and de-
scribed his strategic plan.
24. Before I chopped the sentence up because of the word Urdu. Now
I understand that they’re saying we all have something in common,
baby talk.
The other two readers mentioned that they didn’t understand Urdu,
but took no action.
Thus, for most of these proficient readers, the monitoring process
for this vocabulary problem involved the same steps as that used for
ACKNOWLEDGMENTS
This paper is a revision of one originally presented at the 23rd Annual TESOL
Convention, San Antonio, TX. The research for this paper was supported in part by
grants from the Research Award Program of the Professional Staff Congress and
The City University of New York (CUNY), and the CUNY Office of Special
Programs. I thank both for their support. I also thank Marta Martino and Jack
Gantzer, fellow CUNY ESOL teachers, for their careful reading of versions of this
paper and for their supportive friendship throughout.
REFERENCES
Adams, M. J., & Collins, A. (1985). A schema-theoretic view of reading. In
H. Singer & R. B. Ruddell (Eds.), Theoretical models and processes of
reading, third edition (pp. 404-425). Newark, DE: International Reading
Association.
Afflerbach, P. (1986). The influence of prior knowledge on expert readers’
importance assignment processes. In J. A. Niles & R.V. Lalik (Eds.),
Solving problems in literacy: Learners, teachers, and researchers
(pp. 30-40). Chicago, IL: National Reading Conference.
Alderson, J. C., & Urquhart, A. H. (1984). Introduction: What is reading?
In J. C. Alderson & A. H. Urquhart (Eds.), Reading in a foreign
language (pp. xv-xxviii). New York: Longman.
Anderson, R. C., & Pearson, P. D. (1984). A schema-theoretic view of
basic processes in reading. In P. D. Pearson (Ed.), Handbook of reading
research (pp. 255-292). New York: Longman.
August, D. L., Flavell, J. H., & Clift, R. (1984). Comparison of compre-
hension monitoring of skilled and less skilled readers. Reading Research
Quarterly, 20, 39-53.
Baker, L. (1989). Developmental change in readers’ responses to unknown
words. Journal of Reading Behavior, 21, 241-260.
Baker, L. (1985). How do we know when we don’t understand? Standards
for evaluating text comprehension. In D. L. Forrest-Pressley, G. E.
MacKinnon, & T. G. Waller (Eds.), Metacognition, cognition, and
human performance (Vol. 1, pp. 155-205). Orlando, FL: Academic
Press.
Baker, L. (1979). Comprehension monitoring: Identifying and coping with
text confusions (Tech. Rep. No. 145). Champaign: University of Illinois,
Center for the Study of Reading. (ERIC Document Reproduction
Service No. ED 177 525)
Baker, L., & Anderson, R. I. (1982). Effects of inconsistent information on
text processing: Evidence for comprehension monitoring. Reading
Research Quarterly, 17, 281-294.
Baker, L., & Brown, A. (1984). Metacognitive skills and reading. In
P. D. Pearson (Ed.), Handbook of reading research (pp. 353-394). New
York: Longman.
Bialystok, E., & Ryan, E. (1985). A metacognitive framework for the
development of first and second language skills.In
D. L. Forrest-Pressley, G. E. MacKinnon, & T. G. Waller (Eds.),
Metacognition, cognition, a n d h u m a n p e r f o r m a n c e ( V o l . 1 ,
pp. 207-252). Orlando, FL: Academic Press.
APPENDIX
TALKING TO BABIES1
All of the World'S languages, from English to Urdu, share one special kind of speech: baby
talk. Recent research has confirmed that in spite of the great differences among cultures and
languages, the general properties of speech used with babies who are learning to talk remain
the same.
Baby talk sounds different from adult speech. When talking to 1- and 2-year olds, adults
usually raise the pitch of their voices and adopt a “sing-song” intonation, in which the voice
rises and drops dramatically, often ending a sentence at a high point. (Imagine the way you
would say to a baby, “Hi, Johnny. You’re playing with your teddy, aren’t you.”)
What is the point of these peculiarities? Research has shown that babies prefer sounds in
higher pitch ranges (Kearsley, 1973). Adults may quickly learn that they are more likely to get
a smile or a satisfied gurgle from a baby when they raise their voices a bit. And the melodious
rise and fall of the speech signal may hold the baby’s attention—something that isn’t easy to
do. For the toddler who has begun to utter a few words, the rising voice at the end of the
sentence serves as a signal: “Your turn.” It marks the end of the adult’s verbal offering and
invites the child to make a response.
Adult speech to toddlers is also characterized by short sentences, limited vocabulary, and
straight-forward grammar. There are lots of questions and there is plenty of repetition (Snow,
1972). Furthermore, speech to beginning talkers tends to be tied to the here and now, with
few references to the past or future. A father is much more likely to say, “See the birdie,
Franny?” than “Do you remember the bird we saw yesterday?” The grammatical simplicity
and concreteness of baby talk help make the structure and rules of language clearer to
someone just starting to learn it, and they help ease communication with a small person who
cannot yet understand much speech.
Adults seem to catch on to baby talk quite naturally. Catherine Snow (1972) found that
non-mothers (who had almost no experience with babies) made the same speech changes
when they talk to babies that mothers did. And Marilyn Shatz and Rochel Gelman (1973)
found that even 4-year-old children will make similar speech modifications when talking to
2-year-olds. Babies themselves help to shape baby talk, through their reactions to adult
utterances. When mothers were asked to talk to an imaginary baby, they did not simplify
their speech as much as when they spoke to a real one (Snow, 1972). The child’s presence—
giving evidence of comprehension, boredom, or pleasure—was necessary to elicit “true”
baby talk from the mothers. True baby talk, with its particular grammatical simplifications,
does not appear in parents until the baby is about 18 months old and begins to demonstrate
some understanding of what is being said (Phillips, 1973).
Roger Brown (1977) suggests that there is something else baby talk can do besides helping
babies learn to talk: It can express affection in ways that normal speech can’t. He points out
that sometimes baby talk occurs between adults, but that such behavior is usually limited to
lovers. And this may be as important a function as language learning and communication.
Children need to learn to talk. They need to understand “Stay away from the stove” and
“Don’t eat the Swedish ivy.” But they also need to hear “I love you” and to feel the meaning
of these words even before the words themselves are actually understood.
1 The
sentences discussed are italicized. Other problems mentioned are underlined. The text
was presented in normal type for the readers in the study.
PATRICIA DUNKEL
The Pennsylvania State University
345
Although understanding lectures in English is perceived to be a
vital component of academic survival for international students
studying in English-speaking universities (Dunkel & Davey, 1989),
many students whose native language is other than English appear
to have difficulty understanding and retaining lecture information
in English (Dunkel, Mishra, & Berliner, 1989). Their attempts to
comprehend and retain English lecture information may be
thwarted by a number of cognitive and linguistic factors as well as
academic and cultural issues, including: (a) inability or lack of
opportunity to engage in communicative interaction with the
second/foreign language teacher or lecturer (Pica, Young, &
Doughty, 1987); (b) inability to detect the main points of the
lecture, or “to grasp the usual goals of particular genres of discourse
situation of which the discourse is a part” (Olsen & Huckin, 1990,
p. 41); (c) unfamiliarity with the structure and type of the discourse
(Barnitz, 1986); (d) inability to apprehend discourse markers and
logical relationships in the English lecture (Chaudron & Richards,
1986; DeCarrico & Nattinger, 1988); (e) inability to comprehend
lecture speech delivered at faster rates of speed (i.e., discourse
delivered at “broadcast” speed, or 165 words per minute (wpm),
rather than “lecturelike” speed, or 107 wpm) (Dunkel, 1988a); (f)
limited short-term memory for English input (Dunkel, 1985;
Dunkel, Mishra, & Berliner, 1989); (g) failure to use appropriate
cognitive or learning strategies (Dunkel, 1988b; Oxford, 1990;
Padron, Knight, & Waxman, 1986; Wenden & Rubin, 1987); (h) poor
inferencing abilities in English (Carrell, 1984a); (i) limited
proficiency in English (Dunkel, Mishra, & Berliner, 1989); (j) lack of
prior knowledge about the content of the spoken or written text
(Aron, 1986; Carrell, 1984d, 1987; Carrell & Eisterhold, 1983;
Connor, 1984); and (k) inability to process L2 input devoid of
speech modification such as elaborations or redundancies (cf.
Chaudron, 1983b). In the present study, we explored the effects of
three of the many difficulties confronting L2 learners when they (a)
have limited listening proficiency in English; (b) lack prior
knowledge about the topic of the L2 lecture; and (c) are not
supplied with modified speech (i.e., speech containing elaborated
and redundant information) during the L2 lecture presentation.
We focused on these particular issues for several reasons.
Whereas it has been demonstrated that certain types of speech
modification, such as restatements and redundancy, have a
facilitative effect on listeners’ comprehension of L2 input (see
Chaudron, 1983b), it is not clear that the beneficial effect of
redundancy holds equally well for higher and lower levels of L2
proficiency alike, and for learners of English as a foreign language
and English as a second language alike. The latter is not known
BACKGROUND
Speech Modification and L2 Discourse Processing
In communicative interactions with nonnative speakers of
English, native speakers of English often adjust or modify their
speech in their attempt to make it more comprehensible to the
second language listener (Long, 1983). According to Long, the need
to provide comprehensible input for nonproficient listeners is a
central component of Krashen’s input hypothesis, which postulates
that mere exposure to L2 input does not ensure comprehension and
intake of the L2 information; rather learners need to have
comprehensible (oftentimes “modified”) input for second language
comprehension and acquisition to occur. Speakers modify their
speech to help the nonnative listener better understand the
information conveyed or to help the nonnative listener continue to
communicate with the native speaker (cf. Brown, 1977; Brown &
Hilferty, 1986; Chaudron, 1983a, 1986; Faerch & Kasper, 1986;
Hatch, 1983; Henzl, 1973, 1975; Kelch, 1985; Krashen, 1980a, 1980b;
Long, 1983; Pica, Doughty, & Young, 1986; Snow & Hoefnagel-
Hohle, 1982; Wesche & Ready, 1985; Wong Fillmore, 1982, 1985).
The speech modifications can entail a simplification of linguistic
form involving an alteration in the syntax (e.g., the use of two
simple sentences rather than one complex sentence) and/or a
change in the lexis of the message (e.g., using “to hold on tightly to”
rather than “to cling to”). (See Parker & Chaudron, 1987. )
Although the notion of providing L2 listeners with modified input
is intuitively appealing and widely accepted, relatively little is
known about precisely which types of modifications actually
Materials
The unfamiliar-unmodified lecture. An unmodified version of the
650-word lecture on “The Amish People and the Pennsylvania
Dutch Country” was adapted from a reading passage in Duffy
(1986). The passage was used by Markham (1988) in a study on the
effect of a speaker’s gender and perceived level of expertness on
ESL students’ listening recall of a speaker’s message. It was assumed
1 Twenty eight subjects who scored 19 on the CELT test were randomly assigned to one of
the four experimental conditions because they could not be excluded from taking part in the
experiment conducted during a regularly scheduled class session. However, the data
accrued on these 28 subjects was not included in the ANOVR procedure. These were
omitted in order to separate the HILP from the LILP levels of listening proficiency by at
least 1 score point.
TABLE 1
Composition of the Four Lectures
Procedures
The experiment was conducted in the language laboratory at the
Chinese Naval Academy in Taiwan. Before the experiment began,
3 A T unit is defined by Hunt (l965) as a single main clause plus whatever other subordinate
clauses or nonclauses are attached to, or embedded within, that main clause. For example,
the sentence “The man who persuaded John to be examined by the doctor was fired”
contains only one T unit and three S nodes: “The man was fired; “The man persuaded
John”; and “John was examined by the doctor.” An S node is defined here as a clause,
whether it is a main clause or a subordinate, or an embedded clause (e.g., “John was
examined by the doctor”). An S node may also be a simple sentence (e.g., “I like you”).
4 For the final form of the Amish lecture test, the average difficulty index of the passage-
independent items was .83; for the passage-dependent, it was .53. For the Confucius test,
the average difficulty index for the passage-independent items was .91; for the passage-
dependent items, it was .66. The Kuder-Richardson reliability indexes of the tests were the
following: “’Confucius and Confucianism,” K-R 20 = .89 “The Amish People and Pennsyl-
vania Dutch Country,” K-R 20 = .88.
It should be noted that, technically speaking, in this study, listening comprehension was
operationalized as lecture comprehension, and lecture information comprehension as
performance on the 15 passage-dependent test items since the 15 passage-independent
items test prior knowledge of the topic, for the most part.
Statistical Analysis
The data were analyzed by a 2 x 2 x 2 x (2) mixed analysis of
variance with repeated measures (ANOVR). The between-subjects
factors of speech modification (i.e., information redundancy), prior
knowledge, and listening proficiency combined with the within-
subjects factor of test type. There were two levels of speech
modification (redundant vs. nonredundant speech), two levels of
prior knowledge (familiar vs. unfamiliar topic), two levels of
listening proficiency (high-intermediate vs. low-intermediate
listening proficiency) and two levels of test type (passage-
independent vs. passage-dependent items). The analysis was
conducted using the ANOVR software package (Games et al.,
1985).
RESULTS
A synopsis of the findings is first presented and is followed by an
in-depth explanation of the results of the statistical analysis. A
5 In all 390 students took part in the study, including 2 non-Taiwanese nationals who were
excluded from the statistical analysis although they took part in the experiment. Of the 388
Taiwanese participants, 28 of these subjects who scored 19 on the CELT were excluded
from the ANOVA procedure (see Footnote 1); this left a data set on 360 subjects for the
ANOVA procedure.
FIGURE 1
Means of the Postlecture Comprehension Score
for Interaction Between Modification
and Listening Proficiency
DISCUSSION
Interactive Effect of Speech Modification and L2 Listening
Proficiency on L2 Lecture Comprehension
The HILP students of EFL benefited from speech modification
to a significantly greater extent than the LILP students did. In the
present study, speech modification only involved repetition of the
lecture information tested in the passage-dependent items of the
postlecture comprehension test. However, it was noted that the
HILP students who listened to the modified lecture achieved higher
aggregate scores than the HILP students who listened to the
unmodified lecture. This was not the case for the LILP students.
The comprehension of the lecture information was significantly
improved among the HILP students as a result of the discourse
redundancies. It may be that repetition of even selected pieces of
information by the lecturer allows students more time to process the
information so that, among other things, the relationship of
syntactic forms and the meaning of the lexical items in the lecture
become clearer, as has been suggested by Hatch to be a potential
benefit of speech modification (cited in Chaudron, 1983b). The
results of the present study also revealed that the HILP subjects
scored higher than the LILP subjects on the postlecture comprehen-
sion test whether they listened to the modified or unmodified lec-
ture. It appears that a “language competence ceiling” (Clarke, 1979,
p. 138) prevented the LILP subjects from performing as well as the
HILP subjects, even when redundant information was supplied.
The empirical findings suggest one possible answer to the
question Chaudron (1988) has raised, “If input to learners must be
comprehensible, what factors make teacher talk in classrooms [or
lecturer talk in the lecture hall] appropriate for L2 learners’
differing proficiency levels?” (p. 8). For higher levels of
intermediate EFL listening proficiency (i.e., CELT scores greater
than 19), the provision of redundant information in extended
discourse appears to augment listeners’ comprehension of the
academic discourse, whereas it does not appear to affect as
supportively the comprehension of EFL listeners of lower levels of
listening proficiency (i.e., CELT scores less than 19). It may be that
FIGURE 2
Means of the Postlecture Comprehension Score
for the Interaction Between Prior
Knowledge and Test Type
THE AUTHORS
Chung Shing Chiang is Associate Professor of Speech Communication at the World
Journalism and Communication College, Taiwan. His research interests focus on
listening comprehension and teacher talk.
REFERENCES
Adams, M., & Bruce, B. (1982). Background knowledge and reading
comprehension. In J. A. Langer & M. Trika-Smith (Eds.), Reader meets
author: Bridging the gap (pp. 2-25). Newark, DE: International Reading
Association.
Allen, E. D., Bernhardt, E. B., Berry, M. T., & Demel, M. (1988).
Comprehension and text genre: An analysis of secondary school foreign
language readers, The Modern Language Journal, 72, 163-172.
Anderson, B. V., & Barnitz, J. G. (1984). Cross-cultural schemata and
reading comprehension instruction. Journal of Reading, 28, 102-108.
Anderson, R. A. (1984). Role of reader’s schema in comprehension,
learning and memory. In R. A. Anderson (Ed.), Learning to read in
American schools (pp. 243-272). Hillsdale, NJ: Lawrence Erlbaum.
Anderson, R. C., Spiro, R. J., & Anderson, M. C. (1978). Schemata as
scaffolding for the representation of information in connected discourse.
American Educational Research Journal, 15, 443-440.
Aron, H. (1986). The influence of background knowledge on memory for
reading passages by native and nonnative readers. TESOL Quarterly,
20 (1), 136-140.
Barnitz, J. (1986). Toward understanding the effects of cross-cultural
schemata and discourse structure on second language reading
comprehension. ]ournal of Reading Behavior, 18, 95-116.
Bartlett, F. C. (1932). Remembering. Cambridge: Cambridge University
Press.
375
informal contact with and access to male networks. This volume
presents a myriad of examples of discrimination, many pervasive
and unconscious; yet there is a commonality in experiences that
women in academe have had, and this commonality runs through all
the articles.
For example, two articles share a common theme—that interpre-
tation of events and data are often gender based. Molly Hite, in her
article “Sexual Harassment and the University Community” con-
tends that males and females tend to view sexual harassment differ-
ently. Men tend to see more gray areas and tend to be unable to
grasp the concept of sexual harassment and unable to identify with
the victim, generally a woman in a lower position than the male who
sought sexual favors. Hite sees the differing versions of incidents of
sexual harassment as tending “to stratify that entity we call the uni-
versity community—first and most obviously along the lines of gen-
der, and only second along the lines of institutional status” (p. 160).
Another interpretation and evaluation that is gender related is the
way women’s and men’s work is evaluated differently. Virginia
Valian in “Success and Failure: Expectations and Attributions”
contends that women are less successful in terms of salary, rank, and
time needed to get tenure for two reasons: Women’s performance is
evaluated more negatively than men’s, and women’s successes tend
to be attributed to luck and hard work, whereas men’s successes
tend to be attributed to ability and effort. “To oversimplify a bit:
We see men as deserving their successes, and women as deserving
their failures” (p. 132).
The theme of gender-based communicative styles and language
use is another theme found in this volume and commonly found in
popular books and media as well as in feminist literature. Linguists
Robin Lakoff (1975, 1990) and Deborah Tannen (1986, 1990) have
done much to explain and popularize this issue. In addition, sex
discrimination in academic settings has recently gained wide media
coverage with the cases of Jenny Harrison, a mathematician denied
tenure at the University of California, Berkeley, who has filed suit
charging sex bias, and Francis Conley, the top female neurosurgeon
at Stanford Medical School, who resigned abruptly, citing rampant
sexism in the School of Medicine.
However, the message from this volume is not one of despair but
one of cautious hope and movement toward change of institutional
settings. Even Hite’s article on sexual harassment shows guarded
optimism as she points out that more and more women are now on
university campuses as administrators, professors, and graduate and
undergraduate students. Concrete suggestions for change are pre-
sented in each paper. Examples given in some detail are (a) setting
REFERENCES
Lakoff, R. (1975). Language and women’s place. New York: Harper &
Row.
Lakoff, R. (1990). Talking power: The politics of language in our lives.
New York: Basic Books.
Pennycook, A. (1989). “The concept of method, interested knowledge,
and the politics of language teaching.” TESOL Quarterly, 23 (4), 589-618.
Tannen, D. (1986). That’s not what I meant! Conversational style makes or
breaks your relationships with others. New York: Morrow.
Tannen, D. (1990). You just don’t understand: Women and men in
conversation. New York: Morrow.
REVIEWS 377
Building Better English Language Programs: Perspectives on
Evaluation in ESL.
Martha C. Pennington (Ed.). Washington, DC: NAFSA: Association
of International Educators, 1991. Pp. xi + 259. (Available from
Publications Order Desk, NAFSA, 1860 19th St. NW, Washington,
DC 20009)
DANIEL L. ROBERTSON
University of Guam
REVIEWS 379
BOOK NOTICES
The TESOL Quarterly welcomes short evaluative reviews of print and nonprint
publications relevant to TESOL professionals. Book notices may not exceed 500
words and must contain some discussion of the significance of the work in the
context of current theory and practice in TESOL.
381
incongruities between teachers’ and minority parents’ expectations,
provide concise summaries of the research. Quotations from language
learners and teachers enliven the discussion. In addition to the theoretical
framework, Scarcella points out implications for teaching with specific
strategies, which classroom teachers will appreciate. For example, the
chapter on feedback lists 15 practical techniques to help teachers provide
more effective feedback to students of diverse cultural backgrounds. And
the chapter on interaction includes not only suggested activities for
developing speaking proficiency but also specific strategies for reducing
racism.
Because this book pulls together so much information in a very readable
form, it is also well suited as a textbook for teachers in training. Discussion
questions and activities at the end of each chapter provide opportunities to
respond to the ideas presented, to use ethnographic techniques of
observing and interviewing, and to develop class activities. Annotated
recommendations for further reading and an extensive bibliography are
valuable to those wanting to explore a subject in more depth. Chapter
appendices include lists of useful journals, pleasure reading books for
students, and resources for information about various minority groups in
the United States.
I used this book quite successfully as a text in a culture learning class for
ESL teachers. It could also be used in a class on multicultural education for
K-12 teachers to broaden their understanding of what multicultural
education should accomplish. I recommend it highly for teachers who
work, or plan to work, with language minority students of all ages,
including those in adult and higher education.
MARJORIE TERDAL
Portland State University
GREG JEWELL
Tokai University, Numazu Campus, Japan
ROGER GRIFFITHS
Nagoya University of Commerce and Business Administration
385
THE STUDY
Hypotheses
Hypotheses tested were as follows:
1. Mean listening comprehension test scores for the passages delivered at
slow SRS (approximately 127 wpm / 2.5 sps) would be significantly
higher than for passages delivered at fast SRS (approximately 250
wpm /5 sps).
2. Mean listening comprehension test scores for the passages delivered at
slow SRS (approximately 127 wpm / 2.5 sps) would be significantly
higher than for the passages delivered at average SRS (approximately
188 wpm / 2.75 sps).
3. Mean listening comprehension test scores for the passages delivered at
average SRS (approximately 188 wpm / 3.75 sps) would-be significantly
higher than for the passages delivered at fast SRS (approximately 250
wpm /5 sps).
Subjects
The subjects (Ss) for the study were 24 young adult Omani Elementary
School teachers taking part in a university in-service training course. When
they entered the 5-week course, their language proficiency was estimated
as varying between upper elementary and intermediate on a university
examination. Their average level can best be described as lower
intermediate.
Materials
Three passages, actually stories, of 454, 451, and 442 words (544, 537,
and 520 syllables; word/syllable ratio = 1.19) were selected from the SRA
Mark 2 Reading Laboratory 2a Power Builders materials (Parker, 1978).
(The passages were designed for native speakers (NSs) of reading aged
8.5.) Using the same conventions as described in Griffiths (1990a), type-
token ratios for the three texts were calculated as 0.42 for Text 1, 0.41 for
Text 2, and 0.46 for Text 3.
As in the previous experiment, actual SRs in the nine recordings came
extremely close to the targets. These, and other information on the texts,
are shown in Table 1.
Results
Mean scores on the individual texts and over the three texts, are given in
Table 2. This clearly demonstrates the relationship (at these SR levels and
with these subjects) between SR and comprehension.
TABLE 2
Mean Scores and Standard Deviation on the Three Texts
and on the Combined Texts
A two-way ANOVA was performed to assess the significance of the
observed difference in means between the treatments, the blocks, the
texts, and the interactions between them. The results of this analysis
together with the F test and p values are given in Table 3. All two-factor
interactions were nonsignificant.
TABLE 3
Two-way Analysis of Variance for Scores Related to SRs,
Blocks, and Texts
DISCUSSION
Input studies might be expected to provide the data from which
practical teaching recommendations can be drawn on language-classroom
performance dimensions. In terms of SR, this study, and those upon which
it builds, indicate the direction these recommendations may follow, but
clearly further experimentation will be necessary before these can be
made with the required level of conviction on a wider scale.
However, should the present finding and that of the previous study
(Griffiths, 1990a) be confirmed in future studies, the oft repeated teacher-
training direction to speak at normal rates to beginners (e.g., see Hatch,
1983) looks increasingly suspect, as even lower intermediate students can
be seen to benefit (in terms of comprehension) from below-average rates
(in the region of 2.5 sps). The issue appears important enough to merit
continued investigation.
REFERENCES
Conrad, L. (1989). The effects of time-compressed speech on native and EFL
listening comprehension. Studies in Second Language Acquisition, 11, 1-16.
Griffiths, R. T. (1990a). Speech rate and NNS comprehension: A preliminary study
in time-benefit analysis. Language Learning, 40,311-336.
Griffiths, R. T. (1990b, March). Language classroom speech rates: Life in the fast
lane. Paper presented at the 24th Annual TESOL Conference, San Francisco,
CA.
Hatch, E. M. (1983). Psycholinguistics: A second language perspective. Rowley,
MA: Newbury House.
Higgins, J. M. D., & Griffiths, R. T. (1990, September). Listening comprehension
materials: Why don’t we rate them. Paper presented at the British Association of
Applied Linguistics Conference, Swansea, England.
Editor’s Note. The editor is deeply saddened to report the death of Roger
Griffiths.
8. They do not encourage their children to mix with the opposite sex, but they
do let them interact to certain extent. (Ll Malay) (2 T units/1 sentence)
9. When you see a group of Asians talking, if they are speaking their native
language, I think you do not know which native they come from, but if you
hear that among their conversation there are some English single words
between their native language, I can say that they are Chinese from Hong
Kong. (Ll Chinese) (2 T units/1 sentence)
1 Thatis not to say that a sentence-based analysis simply changes the intervals on the scale,
however. Nonconjoined sentences such as those in Example 2 are unaffected. In Example
2 there are 2 clauses/T unit and 2 clauses/sentence. The mean number of clauses per unit
of analysis changes in direct proportion to the number of main clause coordination in a
language sample.
TABLE 1
Percentage of Sentence Combinations Resulting from Coordination
ACKNOWLEDGMENTS
An earlier version of this report was presented by the author and Theodora Bofman
at the 22nd Annual TESOL Convention in Chicago, March 1988. I thank Cheryl
Engber for her assistance in coding the compositions.
2 Theincrease in coordination at Level 6 may be an artifact of program placement. In an
unrelated study with different students from the same program, Level 6 showed a similar
deviation (Bardovi-Harlig, 1990). Although this merits further investigation, the scores of
Level 6 do not detract from the clear overall pattern.
KEITH BAKER
Silver Spring, MD
397
District, 1990). There are differences between BIP and the program
to which it was compared, a typical Texas transitional bilingual
education program, but nothing in the El Paso study supports the
use of all-English immersion, as Porter claims.
Porter describes a structured immersion program in San Diego
(p. 151). Since I invented the term structured immersion (see Baker&
de Kanter, 1981), I am comfortable in saying there is not now, nor was
there ever, a structured English immersion program in San Diego. Like
El Paso, San Diego had a dual, two-language, immersion program.
There is some evidence that the dual immersion program was better
than TBE. The San Diego study, if anything, argues for maintenance
bilingual education programs instead of TBE. Nothing in either the San
Diego or El Paso studies support Porter’s claims.
Porter describes a program in Paramount, California, in which
she says students in an English immersion program “show a far
higher rate of English-language learning than the children in the
Spanish bilingual program” (p. 152). Not recognizing this study, I
consulted Porter’s reference for it, a report prepared for the Reagan
Administration by a group of educators opposed to bilingual
education programs. There was no data in that report either, nor
was there any reference to any study supporting Porter’s claim.
I have test scores from this program for the year in which Porter
wrote her book. The school system did have both a bilingual
education program and an all-English immersion program. Of 12
comparisons between the two programs (reading, language, math,
and total scores for three grades), the bilingual education program
students had the higher score for 8 of the 12 comparisons. The
evidence points to a conclusion just the opposite of Porter’s.
Porter misrepresents some of my research, writing “federal
statistics show that up to 60 percent of the children in bilingual
education programs are English dominant” (p. 66). I quote the
sentence from the article she cited where the figure 60% appears:
“Title VII requires by law a minimum of 60 percent LEP [limited
English proficient] enrollment” (Baker & Rossell, 1987, p. 263).
In discussing the English language amendment, Porter says
“Among my professional colleagues, I have heard unexpectedly
inflammatory opinions on the topic” (p. 217). To support this
conclusion, she quotes at some length from an article by Elliott Judd
and then says “The logic in Mr. Judd’s reasoning seems absurdly
inverted” (p. 217). Judd (personal communication, September 24,
1991) told me that by selectively omitting parts of his statement,
Porter severely altered and misrepresented his meaning. Porter also
misrepresents findings of the U.S. Department of Education’s
survey of language minority parents (I was the U.S. Department of
Education project director for this survey). Porter says “The report
REFERENCES
Baker, K. (1987). Comment on Willig. Review of Educational Research,
57(3), 351-362.
Baker, K. (1990). Bilingual education: Partial or total failure? Proceedings
of the 10th Second Language Research Forum. Eugene: Department of
Linguistics, University of Oregon.
Baker, K., & de Kanter, A. (1981). The effectiveness of bilingual education
programs: A review of the literature. Final draft report. Washington,
DC: U.S. Department of Education.
Baker, K., & Rossell, C. (1987). An implementation problem: Specifying
the target group for bilingual education. Education Policy Analysis, 1 (2),
249-270.
Burkheimer, G. J., Jr., Conger, A., Dunteman, G., Elliott, B., & Mow-
bray, K. (1989). Effectiveness of services for language minority limited
English proficient students. Raleigh-Durham, NC: Research Triangle
Institute.
Collier, V. (1987). Age and rate of acquisition of second language for
academic purposes. TESOL Quarterly, 21 (4), 617-641.
Collier, V. (1987/1988). The effect of age on acquisition of a second
language for school (FOCUS: Occasional Papers in Bilingual Education
No. 2). Wheaton, MD: National Clearinghouse for Bilingual Education.
Cummins, J. (1991). Forked tongue: A critique. Canadian Modern
Language Journal, 47 (4), 786-793.
El Paso Independent School District. (1987). Interim report of the five year
bilingual education pilot project. El Paso, TX: Author.
El Paso Independent School District. (1990). Bilingual education
evaluation: The sixth year. El Paso, TX: Author.
Ramirez, J. D., Pasta, D. J., Yuen, S. D., Billings, D. K., & Ramey, D. R.
(1991). Longitudinal study of structured English immersion strategy,
early-exit, and late-exit bilingual education programs for language
minority children (Vols. 1-2, U.S. Department of Education Report,
Contract No. 300-87-0156). San Mateo, CA: Aguirre International.
.
THE FORUM 403
The Reviewer Responds. . .
SUZANNE IRUJO
Boston University
REFERENCES
Baker, K. A., & de Kanter, A. A. (1981). The effectiveness of bilingual
education programs: A review of the literature. Final draft report.
Washington, DC: Department of Education, Office of Planning, Budget,
and Evaluation.
Burkheimer, G. J., Jr., Conger, A., Dunteman, G., Elliott, B., & Mow-
bray, K. (1989). Effectiveness of services for language minority limited
English proficient students. Raleigh-Durham, NC: Research Triangle
Institute.
Collier, V. (1987). Age and rate of acquisition of second language for
academic purposes. TESOL Quarterly, 21 (3), 617-641.
Ramirez, J. D., Pasta, D. J., Yuen, S. D., Billings, D. K., & Ramey, D. R.
(1991). Longitudinal study of structured English immersion strategy,
early-exit, and late-exit bilingual education programs for language
minority children (Vols. 1–2, U.S. Department of Education Report,
Contract No. 300-87-0156). San Mateo, CA: Aguirre International.
An Educator Comments. . .
MARIANNE CELCE-MURCIA
University of California, Los Angeles
THE AUTHOR
Marianne Celce-Murcia is Professor of TESL and Applied Linguistics at the
University of California, Los Angeles. She has coauthored two books used to
prepare ESL teachers to teach English grammar.
REFERENCES
Canale, M. (1981). From communicative competence to language pedagogy. In
J. Richards & R. Schmidt (Eds.), Language and communication (pp. 2-27).
London: Longman.
Collier, V. P. (1989). How long? A synthesis of research on academic achievement
in a second language. TESOL Quarterly, 23 (3), 509-531.
Cummins, J. (1979). Linguistic interdependence and the educational development
of bilingual children. Review of Educational Research, 49(2), 222-251.
Frodesen, J. (1991). Grammar in writing. In M. Celce-Murcia (Ed.), Teaching
English as a second or foreign language (pp. 264-276). Boston: Newbury House/
Heinle & Heinle.
Higgs, T. V., & Clifford, R. (1982). The push toward communication. In
T. V. Higgs (Ed.), Curriculum, competence, and the foreign language teacher
(pp. 57-79). Lincolnwood, IL: National Textbook Company.
STEPHEN D. KRASHEN
University of Southern California
It is significant that this question should be asked. Not long ago, it was
thought that formal grammar instruction was the only means of
developing second language competence. Current research, however,
shows that second language competence is developed in another way.
My interpretation of the research is that we acquire language by
understanding messages, by obtaining comprehensible input. Direct
evidence supporting the input hypothesis includes studies showing that
when acquirers obtain more comprehensible input, they acquire more of
the target language. This is the case both outside of school (exposure and
length of residence studies) and inside of school (method comparison
studies) and holds for both second language acquisition and the
development of literacy (Krashen, 1991).
There are also several serious problems with the hypothesis that direct
instruction plays a major role in developing language competence. It has
been argued that language is too complex to be deliberately taught and
learned, and there is evidence that people develop high levels of second
language competence without formal instruction (Krashen, 1991).
Does grammar study have any effect? My interpretation of the research
is that grammar learning does have an effect, but this effect is peripheral
and fragile. I have argued (Krashen, 1982) that conscious knowledge of
grammar is available only as a monitor, or editor, and that there are three
necessary conditions for monitor use: Performers need to know the rule,
have enough time to apply the rule, and need to be focused on form. When
these conditions are met, application of grammar rules can indeed result in
increased accuracy, but the performer pays a price in decreased
information conveyed, and a slower, more hesitant speech style. There are
other risks, such as editing one’s next sentence while the other person is
talking, which results in grammatically improved but sometimes
ACKNOWLEDGMENTS
I thank Joe Allen and Eula Krashen for their helpful comments on earlier versions
of this paper.
THE AUTHOR
Stephen D. Krashen is Professor of Education and Linguistics at the University of
Southern California.
REFERENCES
Elley, W. (1991). Acquiring literacy in a second language: The effect of
book-based programs. Language Learning, 41, 375-411.
Harley, B. (1989). Functional grammar in French immersion: A classroom
experiment. Applied Linguistics, 10, 331-359.
Krashen, S. D. (1982). Principles and practice in second language acquisition. New
York: Prentice Hall.
Krashen, S. D. (1991, April). The input hypothesis: An update. Paper presented at
the Georgetown University Round Table on Languages and Linguistics,
Washington, D.C.
Lightbown, P. (1991). What have we here? Some observations on the influence of
instruction on L2 learning. In R. Phillipson, E. Kellerman, M. Sharwood Smith,
&M. Swain (Eds.), Foreign/second language pedagogy research (pp. 197-212).
Clevedon, England: Multilingual Matters.
Lightbown, P., & Spada, N. (1990). Focus-on-form and corrective feedback in
communicative language teaching: Effects on second language learning. Studies
in Second Language Acquisition, 4, 429-448.
Pienemann, M. (1984). Psychological constraints on the teachability of languages.
Studies in Second Language Acquisition, 6, 186-214.
Pienemann, M. (1989). Is language teachable? Psycholinguistic experiments and
hypotheses. Applied Linguistics, 10, 52-79.
White, L. (1991). Adverb placement in second language acquisition: Some effects
of positive and negative evidence in the classroom. Second Language Research,
7, 133-161.
White, L., Spada, N., Lightbown, P., & Ranta, L. (1991). Input enhancement and
L2 question formation. Applied Linguistics, 12, 416-432.