|
Home Courses Faculty Useful Links Publications Alumni Articles Research Resources |
||
|
Introduction to each Chapter
Each chapter in the dissertation should begin with a brief introduction of what the chapter contains. This should be typed in such a way that it stands out as a separate section of the chapter. An example is provided here for Chapter Two. The focus of this study was the teaching and testing of writing.
Chapter Two Review of Related Literature
2.
The Nature
of Writing It is important to identify the skills involved in written communication to devise effective techniques to teach and test writing. To identify the skills we need to know what writing actually involves. Hence this section reviews the processes involved in writing, the difference between speech and writing and the factors that affect written communication.
2.1.
What is writing? What
writing is and how it is developed has been a subject of discussion and debate
for centuries, from the time of Aristotle, Cicero, Quintillian to the present.
Through there are different viewpoints, it is commonly agreed that writing is
much more than the mere production of graphic symbols.
Given below are some of the views of various writers.
They are presented in the following format for clarity of expression.
It should be noted that the concepts of various writers overlap.
a.
Writing – a complete ‘text’
According to Donn Byrne (1979), writing is not
the mere production of graphic symbols. In
his book ‘Teaching Writing Skills’ he discusses the importance of producing
a coherent ‘text’, by arranging the graphic symbols to form words, that in
turn are arranged to form sentences, which are arranged in a proper sequence and
linked to form a coherent whole. According
to him writing involves a lot of mental effort because we have to keep the
reader in mind when we write. The
reader may not be present physically and in some cases the reader may not even
be known to us. So we have to
ensure that what we write is “...
As explicit as possible and complete in itself”.
(Donn
Byrne 1979:1) That
is, the reader should be able to understand what we have written without any
further help from us. b.
Writing – a communicative occurrence
Liz Hamp-Lyons and Ben Heasley (1984) in their
article ‘Survey Review’ in ELT Journel (Vol. 38) define writing as,
“… a communicative occurrence between a
writer and an intended reader in which the writer creates a discourse with the
imagined reader and derives from this a text by which an actual reader may
approximate to the original discourse.”
c.
Writing – a series of episodes Writing
proceeds through a series of writing episodes, in which there is an interaction
going on between an overall but general plan, a specific plan of sentence or
paragraph and what is written on the page.
There are periods of transcription,
the actual writing of words and reflection, where what is written is
reread and decisions are made for
further writng. Infact, several
operations will be going on simultaneously, with interaction taking place
between thinking of what is going to be expressed, planning the text,
composition a sentence and transcribing it.
d.
Writing – a series of schemes According to Bereiter (1980) a number of schemes must be put into operation by a writer when he writes. He mentions three major schemes and a number of sub – schemes under each head. The main schemes are as follows : 1. A general executive scheme : a general scheme that selects the general structure of writing (a letter rather than an
essay) 2.
A content processing scheme. 3.
A language processing scheme. As
the writer gains experience his repertoire expands.
Bereiter has given a model of skill systems which represents integration
in writing developments. This model
(figure 1) shows the development of the individual as he moves from speech to
writing and through various stages of writing.
A new cognitive dimension is added to each of the stages and the
development is traced through the process and product of writing.
e.
Writing – knowledge & experience Stein, Nancy l. (1983), emphasizes that there is a close relationship between the amount of knowledge an individual has about a topic and the ease with which a coherent piece of prose can be constructed. The generalisability of certain types of writing instruction may be severely constrained by the amount and type of knowledge that has been acquired about a particular content area. According to Donald M. Murray (1983) writing is concerned with ideas, the production and organization of ideas and finding out what it is that one wants to express in a written message. Through the process of using language in writing we discover meaning in experience and try to communicate it to others.
f.
Writing – Social Context Florio-Ruane, Susan (1983) suggests that without attention to the social contexts of writing, both in the classroom activity and in the relation between audience and author, teachers cannot be certain that practising discrete skill will actually transfer to tasks elsewhere. Mosenthal Peter (1983) argues the need to consider the sociopolitical dimension of writing competency in addition to the conceptual and design criteria dimensions. The
above discussions emphasise the fact that a writer needs to employ a number of
schemes to produce a coherent text which communicate effectively
his message to the reader. A
brief review of the difference between oral and written communication could be
useful for a better understanding of the procedures involved in transcribing
ideas into graphic symbols.
2.
1.1
Speech and writing Cognitive
psychologists treat writing and developments in wring as distinct from speech
and general language development. Some
of the reasons for this distinction between speech and writing are as follows: a.
Written language in most language systems has its own conventions and
purpose separate from spoken language. b.
Written language posits a different relationship between the writer and
reader that between the speaker and listener. c.
Written language may be supported by a kind of thought different from
that associated with spoken language. (Dillon,
1981) . Done Byrne (1997) also agrees with the view that writing is different from speech in a number of ways. Speech takes place against the background of a situation and much of what we say can be understood from the situation. Besides the listener is physically present and offers us constant feedback so that we can modify our message to make our meaning clear. We can also use number of prosadic features like pitch, loudness, rhythm and pauses, as well as, facial expressions and gestures to help the listener understand what we want to convey. All these facilities are not available to us when we write. “Writing
by contrast, is the whole of the relevant activity and we create the context as
we write . . . there can be no
interaction between the writer and reader.
Although we may try to anticipate reactions and build them into the text,
we have to sustain the whole process of communication on our own and try to stay
in contact with our reader thorough words alone”. (Donn Byrne, 1979 : 3) Though
writing seems to be a very difficult activity, it has some definite advantages
over speech. We can write at our
speech. We can write at our own
pace while writing whereas
in speech we need to have adequate fluency so as not to test the
listeners patience. We can also
rewrite and revise our sentences and paragraphs till we are satisfied with the
result. The reader can also read at
has own pace and reread what we have written as often as he likes.
These advantages of writing can be put to maximum use if we understand
the factors that affect written communication.
2.1.2.
Factors affecting written communication A
number of factors have to be kept in mind to communicate effectively through
writing. The message we want to
convey has less chances of being mis-understood if we have some background
information about the intended reader, and his previous knowledge of whatever is
realeted to our message. Some of the factors which play an important part in our
selection of what to convey, how to convey and how much to convey are as follows
: Ø
The relationship between the writer and the reader whether it
is at a formal or intimate level. Ø
The purpose of the
activity - whether the message is conveyed for giving information, seeking
permission, soliciting advice and so on. Ø
The previous
knowledge of the reader – whether the message is new to him, partly known or
known from a different angle. Ø
The type of message -
whether it is simple, complex, involves technical expressions or not. Ø
Intended response -
whether the writer wants to please the reader, persuade him, threaten him or
enrage him. The
writer should keep all these factors in mind if he wants the reader to
understand his message properly and react in the way he wants him to. Having
analysed the nature of writing, the problems involved in communicating through
writing, and the factors that affect written communication, we need to undertake
a study of how to teach writing. It
could be useful to think of the place allotted to writing in Language
instruction and go on to trace the development of instruction in writing from
the ancient times to the present. 2.2
Teaching writing There
has been considerable change and development in the teaching – learning
process over the years. Along with
it the importance given to the various skills of language has also been
changing. The changes in the
importance given to writing have affected the types of topics used and the
teaching and testing of writing. Hence
this discussion begins with an analysis of the importance given to writing in
the past and present. 2.2.1
Place of writing in Language Instruction. If
we consider the importance given to writing in the objectives of a language
class, we can observe three main
stages of developments. These
stages of developments are as follows : a.
In the first stage, before the 1930’s most of the class time was spent
in writing. The writing assignments
aimed at developing the learners’ ability to answer comprehension questions
based on texts, completeing structure manipulation exercises, essay writing and
working out translations. b.
During the second stage, when the structural approach was introduced
writing was given only secondary importance, because the emphasis was on oral
skill. Writing was not included
during the initial stages of learning. It
was used in the later stages to reinforce and consolidate grammer and vocabulary
items learnt orally. c.
The present day curriculum expresses language teaching objectives in
terms of language use. Equal
importance is given to speech and writing. Both speech and writing enable the
learners use the language they are learning and hence both are emphasized.
But,
as far as India concerned particularly in Gujarat, the structural syllabuses are
in use and writing skill has been given a secondary place. Through there has not
been much change in the way writing is taught in Gujarat, we can see a considerable amount of change and development in
the teaching of writing in different parts of the world. Tracing these developments could help us to build on the
available source of knowledge.
Broadly
speaking the techniques of teaching writing fall under three categories. a.
A heritage models, using classical texts and imitation (See 2.2.3, a.). b.
A Competance model, using analysis and emphasizing correctness
(see 2.2.3, b). c.
A process model, using free expression and emphaisng growth
(see 2.2.3,e). (Mandel
1980) Through
a number of approaches have been proposed for each of these categories, five
dominant approaches can be said to be important. The
five main approaches are as follows : a.
Fixed
product : This
approach aims at teaching a select number of specific types of writing, e.g.
business letter or the academic essay, and it emphasizes correct forms,
structures and language. The composition work undertaken in our schools and
colleges would fall under this category (see 2.2.3.a). b.
Variable
product : This
approach aims at teaching a variety of different forms and types of compositions
dependent on the audience and tasks and it emphasizes appropriate structural
forms and language
(see 2.2.3. e). c.
Phase
Instruction : This
approach emphasizes the various stages of writing like pre-writing and revision
and aims at developing security in the process (See 2.2.5). d.
Content
Instruction : This
approach aims at the writing skill indirectly.
It emphasizes discourse about a subject – e.g. literature or history. e.
Knowledge Instruction : This approach emphasizes the teaching of
information about language and writing. It
aims at correct use of structures, forms and language through the acquisition of
such knowledge. Each
approach bears implications for what would go on in class, the selection of
topic and the type of feedback. In
practice teachers do not use a single approach exclusively.
Most teachers are eclectic or pragmatic but one or the other of these
approaches tends to dominate the thinking of a particular teacher. Tracing the
approaches used by different teachers from the past to the present and the
themes they have use could help us decide which of these approaches is better
suited to the learners in Gujarat.
2.2.3
Types of themes used – past and present As
the teaching methods of general education have been undergoing changes and as
the objectives of a language curriculam have been looked at from fresh points of
view, the types of themes used and the way writing is taught also have changed.
The change that we can see here is a gradual evolution and not a sudden
change. An overall view of the
teaching processes reveal four obvious times of change.
They are the Italian Renaissance with
Guarino and Vittorino, the 17th century scientific movement
with Comenius, the romantic reconstructive period of the late 18th
and early 19th century of Pestalozzi, Herbart and Froebal and the
early 20th century of the Progressive educators in the communist
countries. These changes and
developments are worked out in some detail in the following sections.
a.
Early developments upto the 16th century From
the time of Iscocrates through the following 800 years in the general design of
the European literary pattern of education there were three areas of study :
Grammar, Style, and Eloquence. In Grammar the focus was on usage. Learners were
supposed to memorise the rules and work out exercises.
Style was meant for developing oral and written expression.
The teaching methods aimed at leading the learners from appreciation of
written works to production of compositions.
In the beginning learners were asked to appreciate the works of great
writers. Textual analysis was the
main focus of his approach. The
teacher provided the pupils with all possible examples of rhetorical
compositions. First the teacher
commented on these works. Learners
analysed them carefully. They
looked into the purpose of each composition.
They sought out the general structure of each passage.
They studied the manner in which various rhetorical devises were used and
the desired effects produced. For
teachers such as Iscocrates and Quintillian it was a search for excellence in
expression and the study of the way in which the intended effect was produced.
This analysis later led to production of compositions of similar kind. Eloquence,
the third area of study in the European literary pattern of education, was meant
for giving practice in public speaking. But
here writing preceded speech. Whatever
was to be spoken was first written down, memorized and then presented.
In preliminary exercises learners wrote on topics such as:
Stories based on
fables
biographies of famous
men
comparision of good
and bad characters
arguments for and
against well-known devisions in history, and
carefully structured
discussions of well-known sayings and debatable propositions. More
advanced learners composed substantial orations on fictitious legal cases or on
abstract themes. The topics were so
selected that the learners would learn virtue while learning rhetoric.
Chinese
literacy education Chinese
literary education was based on more or less similar methods.
Here also similar topics were used.
The goal of literary education was a composition in prose or a poem
well-structured, subtly expressed pure in language and attractive in
calligraphy. Learners were closely
involved in active participation with the teacher and other learners at all
levels, culminating in the creative work of individual compositions and the
delivery of major orations in the later stages of education. b.
Language teaching in the Renaissance A.
distinctly Renaissance pattern was produced by the effective blending of the
three educational traditions – the Chinese traditions, the later medieval
education and the literary education. The
main exponents of this method were Vittotino de Felltre, Guarino da Verona and
Erasmus. The
composition work of this period was based on the model of Cicero.
There were graded compositions which took into account the learner’s
age, ability and stage of learning. For
the first time a number of sequentially organized large classes were formed. Play activities were introduced and the motivation of
learners was emphasised. Competition,
usually called emulation, developed as a useful and appropriate form of
motivation. Learners were graded
and promoted to the next classes by regular examinations. c.
The beginning of a science of teaching Comenius
(1592-1670) made the first comprehensive attempt to construct teaching methods
on scientific principles. He tested
a number of processes in many years of teaching and incorporated them in a
series of graded textbooks. His two great works, the Great Didactic (1632) and
the Analytical Didactic (1948) emphasise the importance of sense experience and
nature’s contribution to education. According
to Comenius “nothing
should be taught to the young,
unless it is not only permitted but actually
demanded by their age and mental strength”. Here
is the beginning of the developmental view of educational psychology.
In this age the spiral curriculum came into existence wherein the same
things are taught in a different manner at successive levels.
This was done with a view to utilizing the knowledge of the stage of
intellectual development reached by the learner in each case. The
topics selected for written work at the time of Comenius were quite different
from the earlier ones. In Comenius’ developmental and activity type approach, the
nature of the leaner, the relevance of the process to him and his reactions to
the teaching methods were given importance.
The subject – oriented approach of the past changed into a learner –
oriented approach. Acording to
Comenius, an educated human being did not accept truth merely on authority but
examined and probed ideas for himself. Hence
the teachers should encourage learners to seek and discover things by their own
efforts. This was a move away from
dependence on imitation, memorization and observance of rules that characterized
much of the practice of traditional literary education. d.
Developments in the 18th and 19th century Pestalozzi
(1746-1827) wanted to make innovations in the field of education through
experimention. He wanted to
psychologise education which means two things : a.
To develop methods in line with the developmental pattern of children’s
growth, and b.
To make the progress of perception the central element in his teaching
method. There
was concrete and persistent effort to make the intellectual development iof
children the starting point of the teaching process.
The teacher should follow a process which would turn initial sensory
contact into clear and distinct ideas. A
sense perception must be –
Related to others
already in mind,
The essentials should
be distinguished from the unessentials and
The essentials should
be described and possibly classified so that it becomes distinct and capable of
use. All
these activities should be in accord with the learners’ intellectual
development. The principle tools in
the process were language, form and number. By asscociating language with sense impressions through the
process of analysis, description and classification, he considered that ideas
would be developed and classified into thought patterns. To facilitate the
process, Pestalozzi developed object lessons, an elementary form of discovery
leraning. The procedure was to use the sense perceptions of objects such as a
piece of mineral, classroom objects, or objects available in the environment.
The sense perceptions of these objects were used as the basic for
examination, classification, and development into ideas appropriate to the
object. Pestalozzi puts more
emphasis not on learners’ sense impressions but on self activity.
He had great concern for the learners’ emotional and intellectual
development. The teacher was to
develop the individual creative force, keeping in mind how to relate it to other
individuals and to the world they live in.
Here for the first time, the concept of looking at the written work from
the readers’ point of view was introduced. Herbart
(1776-1841) developed Pestalozzi’s embryonic ideas into a substantial
cognition centering on the process of apperception.
This is the process of fusing with an acceptable group and being related
to the ideas within the group. The
instructional steps were – preparation, presentation, association,
assimilation and application. The
first step was to stir up in the learners’ mind the ideas upon which the
teacher wished to graft the new material. The
second was to present his material clearly, succinctly and attractively. The
third was to associate it with ideas previously in the learners mind, knitting
it skillfully into the existing pattern. Then the fourth step was to examine the
fresh pattern formed out of the association mass that had been formed.
The final step was for fixing the new material in the learners’ mind by
applying it in a variety of ways, in tests, classroom exercises and assignments
for homework. The
instructional sequence was associated with what the Herbartians reffered to as
the “doctrine of interest”. The
use of interest meant that the material should be within the range of
learners’ apperception. There should be scope for self activity through
stimulation of curiosity, inquiry, imagianation and reflection. There should be
a constant drive towards the mastery and permanent acquisition of what was being
learnt. e.
Progressive education -20th century Progressive
educators merged in several European countries and in the US about the turn of
the 20th century and remained an important influence on educational
theory and practice until about 1950. The
essential element in the methods of all progressive educators was activity based
learning. The
activity method emphasizes the following :
Learners’ needs and
interests as perceived from current social conditions and aspirations as well as
individual’s own expectations are important.
Learners should
acquire functional knowledge through purposive work and problem solving. Learners should be given practice in gathering and evaluating
data and putting forward and testing hypotheses; reaching approapriate
conclusions and presenting them effectively.
Appropriate
opportunity for expression is very important because expression makes
understanding of knowledge and experience better.
Teachers’ task is to emphasise not elegance but sincerety, that is, to
teach learners to express their experience aptly and accurately in whatever was
the appropriate medium.
Involment of the
learners in cooperative experiences should be given importance.
The course was neither teacher centred nor learner centred but was
evolved with a cooperative effort between the teacher and the learner. In
early 20th century in England the prevailing method of teaching English was
criticised because it was based on the teaching of classics and not on the
teaching of modern languages and it suppressed personal expression and
spontaneity. Hence the progressives
argued for more activity and individual expression. Some
of the improvements brought about by the progressive educators of the 20th
century are as follows : $
Grady produced a
textbook on composition which omitted grammar and encouraged learners into the
art of writing through experimentation with various styles. $
Caldwell Cook
inspired his learners with a play-way approach which stimulated their
imagination and gave them constant practice in writing spontaneous compositions
on activities in which they were interested. $
In the 1980s
emotional and intellectual growth were linked with language development and the
study of English literature was given importance.
Linguistic theories supported the movement away from traditional methods
by directing attention to language as was currently used and by looking for a
grammatical structure that fitted the usage of the living language.
The
Bullock report
The
Bullock report entitled ‘A language for life’ written for the British
Government in 1975 integrated a number of 20th century trends.
It tried to fuse together the orderliness and quality of the traditional
process with the thrust, relevance and freedom of a more recent approach. The
traditional Boundaries of grammar, reading, dictation, composition and
literature and to allot each separate time and place were not considered useful.
The grammatical structure of language was taught as and when learners needed it,
in the course of their own speech and writing. Learners
learnt the language by using the four modes of talking, listening, wtriting and
reading in close relationship with one another.
Interplay of these modes and the interactive process were emphasied.
In writing for example, “....
the first task for the teacher is one of encouraging vitality and fluency in the
expressive writing that is nearest to speech.
Children will move out into other modes in their own various ways and at
various times that no one can predict in any detail.
Their reading interests will be an influential factor, particularly in
the early stages. To develop they
must take in written forms of the language and articulate these with their own
general language resources, built up by years of listening and speaking.
And they must do this in such a way that the whole corpus is within call
when they sit down to write”.
(Bullock
Report 1975) Versatility
and precision in written expression were encouraged by writing for various
audiences. The teacher created
conditions for fluent expression, helped the learners develop technical control
of the process of expression and gain an understanding of a range of
communication styles and increasing control over the quality of their own speech
and writing. Language experiences
were related to learners’ life and their further intellectual, emotional and
linguistic development. The teachers ensured that the learners perceived this
relationship. The
gradual change we see here from the time of Aristotle to the twentieth century
progressive educators is a process of evolution.
The changes in the teaching learning process of native speakers of
English has changed the methods of teaching written English in TESOL (Teaching
English to Speakers of Other Languages ) situations too.
Tracing the changes in TESOL situations could help us draw useful
conclusions for devising effective techniques and materials for teaching written
English.
2.2.4
Writing in TESOL Situations There
are a number of differences between learning to write in mother tongue and
learning to write in any other language. Donn
Byrne (1979) discusses the problems involved and how they are related to the
tasks we assign to the learners. a.
Types of Tasks The
learners when they learn to write in their – mother – tongue, usually have a
command of the spoken language. Though
they have to learn to form the letters and so on and very few of them really
become proficient in writing, they still have the advantage of having a fairly
good knowledge of the language. They
might also have been exposed to the written form through having been read to in
their mother – tongue. In a
foreign or second language classroom the learners have very little knowledge at
their disposal. At the same time
they are more mature than they were when they learnt to write in their mother
– tongue. They are also conscious
of the limitations which the language imposes on the expression of their ideas. According
to Donn Byrne (1979) it is important to consider the learners’ problem of
having more ideas than what they can successfully express. “To
resolve this problem it will be necessary to strike some sort of balance which
prevents them from going beyond their linguistic attainment in the foreign
language and provides them with writing activities which satisfy them onan
intellectual level.”
(Donn
Byrne, 79:6) As
Donn Byrne rightly points out, in a classroom situation writing gets relegated
to the level of exercises partly because it is treated as a compendium to the
lesson rather than as a worthwhile learning activity.
He offers the following guidelines for a writing programme : $
The learners have to
be taught how to write. $
The learners have to
be exposed to the written form of the language and to appropriate varieties. $
The learners have to
be shown how writing functions as a system of communication. $
The learners have to
be taught how to write texts - that is, they need to practise the devices of
written language and see the purpose of what they are writing . $
The learners have to
be taught how to write different kinds of tests. $
The learners have to
be set realistic writing tasks. $
The learners have to
be supported in their writing tasks. $
The learners efforts
need to be viewed sympathetically. The
main activities suggested by Donn Byrne for the early stages are dialogue
writing and letter – writing. According to him letter – writing has many advantages and
it fulfills a main purpose of teaching writing.
He also discusses a number of meaningful copying activities and free
writing activities, which can be easily carried out in class so as to make the
learners understand that “.....
effective communication can take place through the medium of writing.”
(Donn Byrne, 79:49) It
is important to select suitable tasks which create a need to communicate
throught he medium of writing. But
selecting the tasks alone is not enough to develop the writing skill of the
learners. It is also necesssary to
think of effective procedures which help the learners to attempt the tasks with
confidence and learn to write to the best of their ability.
Especially the variety of procedures that can be used effectively in
TESOL situations need to be discussed. b.
Variety of Procedures Different
approaches emplow various procedures to teach writing.
For example, sentence practice, grammar, punctuation and spelling or
vocabulary may be taught in som instructions.
Some others may involve the learning of rules and the correction of
incorrect sentence. According to
D’ Hare (1973) practice in sentence combining with or without grammer
instruction increases the stylistic maturity of many learners and also increases
the scores they receive in tests of composition.
But according to Elley (1976) instruction in grammar separated from the
actual writing, revision and editing of learners compositions has little effect
on writing performance. According
to Donn Byrne (1979) the graphalogical resources orthography, punctuation and
other devices used to convey patterns of meaning – should
be assessed in terms of their value as part of the resources of the
written form of the language and their relative importance in a writing
programme. He emphasises on the
communicative value of the written text and hence is against adopting a
normative attitude towards these features.
Even punctuation should not be taught mechanically, as something to be
added after the writing task is completed.
Learners should realise the importance of the punctuation mark as an
essential part of the written system. Hence
instead of giving the learners rigid rules it would be better to encourage them
to consider the effect on the reader if, for example, sentence or paragraph
boundaries are not marked. This way
the communicative value of punctuation can be demonstrated. Another
procedure of writing instruction emphasises the practice of paragraph structures
or essay structures following a particular format.
The format could be, cause effect, classification, narration etc.
Recent approaches suggest that learners should study the rhetorical
devices, which are essential to produce a text in which the sentences are
organised into a coherent whole, in such a way that they fulfill the writers’
communicative purpose. The devices
may be logical, grammatical or lexical. Logical
devices include words or phrases, which indicate meaning relationships between
or within sentences. The rhetorical
devices help the writer organise his ideas properly so that the reader is able
to follow him from one sentence to another.
Even if the learners are familiar with these devices they will still have
to learn to use them in writing. Therefore
the writing programme requires an extensive understanding of these resources and
considerable practice in using them in appropraite forms of written expression. To
familiarise the learners with the devices, which are needed for effective
communication, adequate exposure to the language through the medium of writing
is necessary. True understanding of
a text depends on an appreciation of the devices, which the writer has employed
in order to convey his meaning through the medium of writing.
Hence Donn Byrne (1979) suggests exposure to good models of written work
as the first step to teach writing. According
to him this exposure is as important as listening is to speech.
He suggests that learners should be made to understand that writing has a
communicative purpose. This
understanding will come to them when they learn to find out the resources of the
written language that are used to get the message across. A
similar analysis of written work used to be carried out with the help of
classical texts as far back as 4th century BC (See 2.2.3. a).
But the type of analysis suggested by Donn Byrne is slightly different.
The classical analysis looked into the various rhetorical effects, which
went into the making of an excellent oratory. The modern analysis tries to find
out what is the message conveyed, to whom is it addressed, and how the contact
with the reader is established and maintained. 2.2.5
Stages of Instruction Though
there has been a lot of controversy about how writing should be taught,
instructions in writing include four stages, generally. a.
Pre-writing b.
Composition c.
Revising d.
Editing Pre-writing
includes all the activities which precede the actual writing of the first draft
of a composition. Composing includes all the activities related to the
production of the draft. Revising
includes the activities involved in reordering or modifying a composition
between the first and the final draft. Editing
includes the activities concerned with the production of a final copy. a.
Pre-wrting Pre-writing
is more or less synonymous with invention, being the act of discover of at least
two things:
What is to be said
and
The ways by which it
might be organised and displayed. Pre-writing
generally refers to mental activities but it may also refer to a number of
things like - discussion, outlining and notemaking.
Teaching
pre-writing
A
number of pedagogical approaches have been advanced for the teaching of
pre-writing. The most classical is
the discussion of arguments and strategies of argument as well as logical
analysis of the topic. Alternative
models of topic analysis include problem solving, dramatism and tagmemics
(Young, 1976). All the approaches to teaching pre-writing agree on one point
– learners (together with the teacher or separately) should analyse the
assignments in terms of three main points: (a) Content, (b) purpose, and (c) the
intended or target reader of the composition. Approaches differ in the importance they give to one of these
three aspects of an assignment. For
example, problem-solving approaches stress originally over conventional or
appropriate ways of handling the assignments. (See 2.2.3 e). Some other approaches emphasis the role and the personal
involvement of the writer in the assignment as opposed to the analysis of the
audience and what will interest the reader ( See 2.2.3.d). Most
of these approaches agree on the point that much work should be done before
writing begins. But
recent approaches suggest that invention occurs within the act of writing.
For example, Macrorie (1970) discusses an approach wherein learners are
allowed to put the pen to paper and let the ideas flow freely.
So their first draft is filled with ideas in the order in which it comes
to their mind. Later it is analysed
and revised in order to produce a finished product. Britten
(1975) also supports the impotance of “expressive” writing particularly for
younger leaners. Expressive writing
is defined as writing in which the writer seeks to explore his or her own ideas
about a topic with little regard to others as audience.
These approaches have their own merit, but learners with limited
knowledge of the language, who have little experience in free writing, find it
difficult to express their ideas freely. Hence
a number of attempts have been made to gradually lead the leaner from guided
compositions to free writing. These approaches think it important to isolate
various difficulties involved in the production of a text and present them
gradually in a systematic way, in
the pre-writing stage. Alexander
(1971) devised a scheme where the learners were gradually led to write free
compositions in six stages. He
started with the organisation of compound sentences and complex sentences and
followed it up with connecting notes and then finally writing notes for free
composition. Moody (1974) discusses the types of writing tasks assigned by
teachers who followed the ‘grammer translation method’ or the ‘direct
method’. Here the learners were
assigned a task like, ‘My Family’. They
are made to write guided compositions in the beginning.
Later the control was reduced by forcing the learners to make meaningful
choices. The learners contribution
in these approaches are very slight. Arapoff
(1968) and Lawrence (1975) considered writing as a thinking process. They
attempted to construct rhetorical frames for guided writing.
For the most part all these writing activities were very much on the
level of exercises, focussing on the paragraph as the unit of expression.
Spencer (1967) also suggests a number of exercises, which gradually lead
the learner to writing free compositions. In
Gujarat learners are used to being assigne topics like `The postman` or `My
friend` (See Chapter 1). Any
programme designed for them need to be based on what they are actually doing
now, so that the new techniques and materials help them proceed from known to
unknown gradually. Having
discussed the first stage of writing instruction, in some detail,
we need to look into the other stages like-composition, revising and
editing. b.
Composition A
number of studies have been carried out to understand the various factors
involved in composing and their pedagogical implications.
Emig (1971), Graves (1975), Britten (1975), Flower (1979), Hayes (1979)
and Lindell (1974) have conducted studies involving learners of various ages as
they are engaged in writing a composition.
Most of these studies have either interrupted the composer in the act of
writing or have transcribed the composer’s comments while writing. The
results of these studies are as follows: $
The Composing process
is complex. $
Pre-writing and
revision are not necessarily separated in sequence from actual writing. $
The writer is
simultaneously concerned with the content (what is said) and the form of style
(how it is said) in the composition. $
Writing improves if
there is feedback during the course of writing rather after it.
(Zoollner
1969) A
number of factors of composition have been identified and the fact is
established that feedback during writing is more effective than correcting the
mistakes after the activity is completed. But
the pedagogical means of providing feedback to learners have not been developed.
It is still not clear how much intervention by the teacher is beneficial
to learners. DonnByrne (1979) also
suggests that learners should be supported in their writing tasks.
But too much intervention may curb their flow of ideas or spontaneity in
free expression. Because of these problems is most cases instruction focusses on
pre-writing and revision. c
& d Revising
and Editing PERC
Communications, New York, a communications firm conducts in-house courses on
effective writing and speaking for businessess and other associations. Ms.
reimold, its President, provides guidelines and hints on writing for effective
communication. According
to Ms. Reimold (1987)
“As
far as the West is from the East..... so far should the act of writing be from
that of editing. They are distinct,
independent activities, performed; it seems, by different halves of the brain.
Writing is putting your throught into words.
Editing is making the verbal expression palatable and understandable to
the people who will read it.” (The
Hindu, Focus When you sit down to write May 31 1987) In
his book `Writing with Power` Peter Elbow says that the writer should write his
first draft for atleast ten minutes without stopping just to separate the
producing from the revision process. Much
of the direct instruction in writing in classrooms takes place in revising and
editing. The instruction usually
focusses on the following two aspects: 1.
Development and organisation of ideas 2.
Style, form and mechanics The
first part deals with the content of the text while the second it concerned with
the language aspect. The first
aspect mainly takes into account what is written while the second aspect looks
into how it is written. Moira
Chimombe (1986) in his article “Evaluating Composition with large classes”
(ELT Vol. 40 Jan.86) offers a number of suggestions for editing and
revising learners’ compotitions. He
suggests techniques for dealing with sentence, paragraph and composition level
errors, which he has tried out at the secondary school level at Africa. The
process of instruction could be of two types.
In cases where the teacher is in control all the time, whatever is
written by the learners is checked by the teacher, suggestions are made for
revising the written work. In some cases learners are asked to work in groups or pairs
to discuss whatever is written. They discuss about development and organisations
of ideas as well as style, form and mechanics like spelling and punctuation.
They help each other in revising and editing the compositions. The
two types of approach for instructions in revising and editing could be
fruitfully combined. Learners could
be asked to work in groups to correct each others’ mistakes and the teacher
could offer help whenever necessary. This
way the teacher stays in control but does not interfere too much.
It is also better to make the learners aware of the mistakes and how they
hinder communication. Having
discussed about the instructions in writing it would be useful to think about
the implications that can be drawn for the present study. 2.2.6
Implications for the
present study The
discussions about the types of themes used from the ancient days to the present,
and the types of writing activities suitable to the learners who are non-native
speakers of English are helpful in drawing implications for the types of tasks
that can be tried out in the present experiment.
The discussions on the various approaches to teaching writing and the
variety of procedures that can be adopted in TESOL situations help us draw
implications for the teaching of writing. The
following are the implications drawn for material preparation as well as
techniques of teaching writing: 1.
$ Learners
should be engaged in meaningful writing activities.
They should not be asked to write anything mechanically. 2.
$ Learners
should be
made aware
of the
communicative purpose of
writing. They should be
helped to think about the reader and the message they want to convey and choose
their language appropriately. 3. $ A letter given in the textbook could be used as a model (appendix 5). Learners could work in groups, discuss and decide how to write a reply to this letter. As suggested by Donn Byrne the linking and sequencing devices could be introduced using this informal letter. Various other aspects like, the lay out of a letter, modes of address and certain opening and closing formulas could also be discussed. 4.
$ Other
writing activities could be selected keeping in mind the composition topics
suggested by the syllabuses presently in use in Gujarat (Appendix 2).
5.
$ In
keeping with the discussions undertaken in this chapter, learners could be given
a choice as to what they want to write about and how they want to write it.
They need to be shown models of coherent pieces of writing and made aware
of the need to have and introduction and conclusion and the need to have an
properly organise their sentences and link them so as to write a unified
paragraph. 6.
$ An
electric approach to the teaching of writing needs to be evolved keeping in mind
the needs of the learners in Gujrat. The
present approach used in most of the schools in Gujrat is the fixed product
approach (See 2.2.2). This approach
gives importance to specific types of writing
(letter or essay) and emphasises the imporatance of grammatical accuracy
and the mechanics of writing like handwriting, spelling and punctuation.
To make the learners pay more attention to what is appropriate in a given
situation, a combination of fixed product, variable product and phase
instruction needs to be thought of
(See 2.2.2). 7.
$ Learners
could be asked to work in groups, discuss a topic, take notes of what points
they want to include in a write up, write individual compositions developing the
points they have noted down and then work again in groups for revising and
editing their written work.
2.3
Testing Writing This
section begins with an overview of the historical perspective of writtten
examinations and then goes on to discuss different types of tests like the essay
test, the interlinear test, the objective test and the pragmatic test.
A comparison of the different types of tests helps in drawing
implications for the testing of writing.
2.3.1. Historical Perspective Written
examinations have a long history. Kuo
reports that the Great shun, a model emperor of antiquity whose reign ended in
2205 BC tested his officers through written examinations every third year and
after three examinations either gave them a promotion or dismissed them from
service. European universities from the beginning emphasised
examinations as the basis for the awarding of degrees and honours. The Cambridge Tripos is a well-known example of such
examinations. In the 19th century
Horace Mann administered uniform written examinations to a selected sample of
learners from the Boston public schools. His arguments were influential in
bringing about substitution of written for oral examinations. Horace Mann (1845) advocated the use of a large number of
specific questions in place of fewer general questions and a search for more
objective standards of educational achievement. This
search for objective evaluation of written work continues even today.
While the teaching of writing emphasise the need for developing
individuality, creativity and personal involvement, the testing of writing looks
for the common factors which can be objectively evaluated so as to measure the
learners’ proficiency in written expression.
2.3.2
Essay Tests Educators
have realised the value of extended discourse for assessing learners’
understanding and for interpreting their academic and personal experience, since
the time of Aristotle. Essay examinations are widely used in school systems
throughout the world. They are
given during school terms to monitor the development of subject matter and
writing skill, at the end of the courses and schooling levels to certify
achievement, and as entrance examinations to determine qualifications for
admissions to a higher level. Though
many countries have now abandoned essay examinations in favour of more easily
scored objective tests, in India we still use it to a large extent.
Even in countries like the US where multiple choice testing has replaced
essay examinations at all levels a lot of criticism is voiced.
It is said that the learners ability to engage in disciplined thought and
the ability to express it in coherent, supported discourse is seriously
deficient. The NAEP (National
Assessment of Educational Progress, 1981) challenges the construct validity of
multiple choice questions for measuring the subject matter and especially
writing skill development. They
think more emphasis should be placed on test formats which stimulate learners to
use higher level reasoning processes as they formulate extended discourse, solve
complex problems or apply subject matter concepts and principles.
The ETS (Educational Testing Service, 1983) research report describes the
attempt made to determine the extent to which the current version of TOEFL is a
valid indicator of the English Writing Skills’ which mainly consists of
multiple choice items. TOEFL (Test of English as Foreign Language) has conducted a
survey research to suggest that a well-constructed test can serve both the
functions. The same test could help us evaluate the level and development of the
learners as well as compare them normatively to the progress of other population
of learners. a.
Components of Essay Examinations Essay
examinations have often been criticised for their lack of objectivity.
Critical components of essay examinations methodology need to be
identified and analysed, if we want to make better use of essay examinations. Some
of the important components identified are as follows: $
The skill to be assessed, $
The essay problem assignment, and $
The scoring criteria The
skill to be measured should be sufficiently defined if the test is to be
reliable. The first step in formulation test specifications is to define the
skills assessed. Skill specifications are generally considered to include
definitions of the content and behaviour. In subject matter essay examinations the content would be
facts, concepts and principles. The
behaviour would not be just the observable behaviour “write”, but the
procedure, strategies and solution routines the learner was to apply to the
content. In tests of writing
ability the focus is not on content points covered but on the discourses
features of the requested essay, for example, whether the composition is a
well-formed example of narrative or expository writing. b.
Structures of assignment In
tests of writing ability the structures of assignments have varied considerably.
At one end of the continuum essay tasks are described as topics.
Topics could be a simple one word clue which might bring out different
kinds of responses. At the other
end of the contiuum essay tasks direct learners treatment of discourse, mode,
topic and audience or the reader. The
one word prompt implies the view that writing is a skill that can be equally
demonstrated in response to any one of the myriad writing tasks.
The kind of writing tasks
presented in class is often criticised as they do not present full rhetorical
contexts that sufficiently inform the learners about the writing purpose, topic,
audience, writers role and intended criteria for judging the essay
(Britton1975). Recent
rhetorical studies suggests that different rhetorical purposes (to express,
persuade, inform) place different cognitive demands on the writer and
consequently, learners write differently when writing for different rhetorical
aims and audience. In a study
conducted by Quellmalz, Capell and Chou (1982) writing competency profiles
derived by tests differing in discourse mode and response mode were compared.
Their findings establish the fact that levels of performances vary on
tasks with different writing purposes. Measures
of writing which demand different discourse modes, such as narrative or
expository, tap different cognitive skills and hence it is important to clarify
the demands that are required by different, specific writing tasks. Tests
of written assignments should also take into accout the time alloted for
planning, writing and at least reviewing, if not revising the written work.
The amount of time scheduled for essay writing varies widely across
countries. Time can support or
constrain learners chance to demonstrate their competence.
The current test theory and research support the advisability of
structuring essay examination prompts that clearly specify the aim, topic,
audience, writers, role and evaluation criteria and that which permit sufficient
time for learners to engage in all aspects of the writing process. c.
Scoring criteria & Rating scale formats The
criteria used to judge the essay examination operationally define which content
features and test structure constitute a “good “or at least a
“competent” response. To be
credible, criteria should not reflect the preferences of only a few individuals,
but should represent standards endorsed by a community of professionals
knowledgeable about the subject matter. Secondly
the criteria should refer to these features of content and written expression,
which are amendable to instructional intervention.
We cannot test what we do not teach in the classroom.
For example, dimensions of “depth”,
“flavour”, and “creativity” may enhance the quality of the essay
but a growing number of educators contend that it is neither logical nor fair to
hold the learners accountable for subject matter or writing expertise that the
schools cannot demonstrate they can teach. The
criteria used to evaluate learners’ content and written expression vary along
a number of dimensions. The
variation may be as follows: $
From qualitative
value judgements to quantitative counts of information and test features; $
From global reactions
to analytical judgements; $
From comprehensive
attention to a range of concepts and text features to isolated focus on
particular information or text feature; $
From vague guidelines
to replicable precise definitions. Generally,
readers’ reactions to learners’ essays involve three levels of judgement.
i.
Subjective, global impressions of overall quality ii.
Analytic judgements about component test features iii.
A holistic quality judgement combining subjective impressions with
judgements about the quality of the combinations of text elements. i. Global judgement
In
general impression scoring, a rater reads an essay once and assigns it a quality
score. General impression ratings
are global, heavily qualitative and are based upon vague guidelines that may not
refer to component text features or their differential weighting or importance. ii.
Analytic judgement The
most quantitative, detailed and replicable scales are analytic rating scales
where readers assign several scores for various features of the essay.
Analytic scores vary considerably in the range of content, rhetorical,
structural and syntactic elements referenced and in the relative weights of
these elements. The analytic scores
differ in the importance they give to different features of written assignment. S Mohanraj (1981) discusses analytical rating scales of Caroll (1961), Alan & Campbell (1965), Cooper (1972), Davies (1977) and Pilliner. He has prepared a model of his own which includes twelve features of writing. He has further simplified it and has arrived at a model suited to our situation where teachers cannot spend much time in correcting compositions. This model is quite practicable and easy to use. The following is the model suggested: iii.
Holistic
judgement Holistic
scales, where readers assign a single score, often combine characteristics of
both general impression and analytic approaches. Holistic schemes vary widely in the range of text elements
contributing to eaah score point and the specificity with which score levels are
defined (Ingenkamp 1977, Quellmalz 1980). Since
the focus, specificity and objectivity of critia informing impressionistic,
holistic or analytic approaches vary considerably, an examination programme
should weigh carefully the nature of the criteria selected and their underlying
rationale. Otherwise the programme
may find that the criteria do not match well with the aims of the assessment and
instructional programmes and do not provide a useful status report or diagnostic
feedback. The need for explicit
critia is also apparent for scoring subject matter essay examinations.
Learners commonly complain about the ambiguous subjective criteria used
for subject matter essay examinations in the classroom assessments.
When results of large scale achievement exams have serious consequences
for learners’ explicit public and rational scoring keys are imperative. d.
Rating Procedures. When
a large number of papers must be scored by a pool of readers, an assessment
programme must ensure that evaluation criteria are uniformly interpreted and
appiled. Such standardization
involves both the formulation of explicit criteria and procedures for trainning
raters. In the US rater training
follows a fairly standard procedure. The
following steps are employed to train raters. $
There is a brief
introduction to the rating scale. $
Then the raters begin
to practice applying criteria to a set of papers representing the test sample. $
A trainer leads a
discussion of the features of each paper that result in the classification of
the paper to a particular grade. Training
time varies according to the number of separate scores recorded for each paper
and according to the clarity of the criteria.
The rigor of the procedures used to decide if acceptable rater agreements
levels have been attained at the end of the trainning vary from a show of hands
to pilot tests requring independent scoring of essays. In
India through essay examinations are widely used, there is no programme to train
raters. Failure to conduct any
structured trainning or to check on prior agreement levels may increase the risk
of unreliable scoring. e.
Reliability The
reliability of an examination programme depends on the degree to which it
eliminates measurement error. Four potential sources of error or score fluctuations
identified for examinations of writing ability (but applying as well to tests of
subjects matter skills) are as follows: $
The writer – within
– subject individual diferences. $
The assignment
variations in item or task content. $
Between - rater
fluctuations $
Within - rater
instability The
writer within – subject errors can be avoided if the learners are asked to
write a series of essays instead of one single essay.
Thus the reliability of learners’ performance can be determined by
gathering data on a pool of homogeneous items or assignments.
Since essay writing requires atleast twenty or thirty minutes it is often
difficult to have them write many essays in examinations. But studies of the consistancy of learners’ performances
accross a series of essay often report low reliabilities for a single essay.
According to Spencer (1979) analysis of the stability of learners writing
performance accross several essays is also not reliable because of the
variability brought in by the difference in topics. Some
ways of overcoming the problem of reliability are as follows: $
Essay tasks should be
based on specific skills of writing. This would reduce error variance due to the assignment. $
Essays should be
collected on at least two parallel assignments.
This would reduce error associated with individual variability. $
Scores on several
essays should be combined to increase the reability of subject matter essay
examinations. Inter-rater
agreement is the most prevalent issue concerning reliability in essay
examiantions. Statistical indices
of agreement levels include co-efficient alpha, generalisability co-effecients,
point biserial corelations and simple percentages of agreement.
The most effective method of reducing inter-rater variability is to
provide training on clearly specified criteria.
To reduce error due to within – rater score fluctuations over time (
rater drift ) due to reader fatigue and / or carelessness, some form of
interspersed check procedure seems helpful, according to Quellmalz (1980).
Although some studies report that readers tend to get more lenient or
more harsh as rating progresses, few assessment programmes routinely moniter
this problem. Mike
Hayhoe (1983) in his article, ‘A Historical Review of Essay Marketing’
discusses the problem of reliability in marking essays.
According to him this problem has been persistent for a long time in the
history of marking essays. If
Rowntree was concerned about marker reliability in the 1880’s, Raleigh (1980)
is equally worried about the same problem.
Mike Hayhoe says that an error of twenty five percent is grading an essay
may be conservative estimate and it has been suggested that the problem of
unreliability in markings essays exists in internal assessment as well as
external. Reliability
is inextricably linked with validity. The
reliability of an essay examination depends on how valid the examination is and
how valid the markers are in their assessment.
A brief consideration of the problems faced by examiners in designing
valid examinations is necessary if one wants to integrate testing and
instruction. f.
Validity The
validity of an examination derives from evidence that the test accurately and
dependably measure the specified skills. Evidence
for the validity of an examination may take several forms. i.
One form focuses on the test content, that is, the test items or essay
assignnent, and gathers judgement of subject matter experts regarding a number
of things like - $
The content validity,
face validity or the descriptive validity of the item or essay tasks, $
The objectives or
skills defined to be important and representative of subject matter
competencies, and $
The way these skills
are elicited in the item, problem or writing assignments. ii.
Other forms of validity focus on test performance to examine the
following things: $
Concurrent validity
– whether the scores are comparable to scores on other tests of the same
skills, $
Predictive validity
– if the score levels predict future success, and $
Construct validity
– if the performance pattern appears to measure the underlying trait. The
most common methods of attempting to establish the validity of essay
examinations have been comparisions of scores to ‘related’ measures.
In the case of tests of writing ability, the ‘other’ measures chosen
as criterion variables are often reading tests, multiple choice or class grades. The
heart of the validity of a test is whether it measures the underlying skill
construct, that is, whether it taps the hypothetical mental store of infromation
and strategies. According to
Raleigh (1980) the validity of an examination can be described in terms of the
degree to which it ‘measures well’ what it is intended to measure.
According to Mike Hayhoe (1983) there is a posibility to think of
‘Markers’ validity that is the degree to which he ‘measures well’ what
the assessment systems sets out to measure. g.
Factors affecting marking The
marks awarded to an essay depend on a number of things.
For example, Thorndike (1986) discusses the problem of ‘uniqueness’.
Uniqueness raises the issue of divergence, the individuality of the work,
and convergence, notions of correctness and orderliness.
How far a marker is affected by divergence and convergence will decide
the marks he gives to a particular assignment.
Wiseman and Wrigley (1958) identified two schools of thought as far as
assessors’ value base are concerned. One
school values ‘imponderables’ of validity, freshness and fluency.
The second school of thought sees the writer as ‘a craftman able to
show his skill whatever type of materials he works in’. Britton (1963) found some evidence to suggest that teachers may well group towards valuing one end or the other of the following two poles: A
number of studies conducted in America suggest that teachers tend to clusters in
favouring certain criteria ideas, form, flavour, machanic, wording - and that
the clusters of criteria adopted by the teacher can affect grading. Deale
(1975) feels that ‘adequacy’ of writing rather than ideas affects the marks
awarded. Soloff (1973) argues that
lack of consonance between the writers’ values and those of the assessor on a
topic may affect the grade awarded. The London Association for the teachng of English shares his
opinion. In its pamphlet, Assessing
Compositions (1965) it expressess concern about how an assessor may react to
experiences and attitudes in an essay which are unfamiliar to him and the
potential for under or over assessing the work. Marshall
(!960) suggests that assessment in terms of the features of a pieces of work
which ‘float’ to the examiner – his intuitions about the texts – is the
proper activity of an alert and sensitive marker. Markers
can be affected by visual features at the expense of such aspects as
organisation, fluency, appropriatness in terms of task, audience and so on.
According to Mike Haydoe (1983) this may be because the visual features are more
immediately obvious, especially when they are flawed, and because there is a
greater degree of consensus about them than there is about what ‘coherence’
or ‘clarity’ or other more global criteria may be. Marshall
(1967) and Scannel (1966) have found assessors particularly adversely affected
by spelling errors, with errors of grammer and punctuation coming next.
Handwriting also has a great impact on the assessors and many researchers like
Chase (1968), Briggs (1970), and Soloff (1973) have demonstrated the power of
this feature in affecting marking. In
his more recent work Briggs (1980) goes further, suggesting that there may be
borderline areas in grading in which this value aspect of a piece of writin may
be the major factor in deciding what it is worth. Yates
and Pidgeon (1957) found that the setting of an essay affected the markers’
response. If an ‘average’ piece
of work followed several fine pieces, it was likely to be marked hard; if it
followed several poor ones it was likely to be upgraded. The
analysis of the present situation in Gujarat also reveals the fact that teachers
are more concerned with spelling errors and punctuation.
Next comes the grammatical error. Though
all the teachers marked a number of features in the questionnaire (appropriacy,
organisation, overall writing ability etc.) as very important, all of them
assign one single grade on the basis of the overall impression of the
composition. i)
Drawbacks of Essays Examinations Essay
examinations are said to test learners’ ability to engage in disciplined
thought and the ability to express it in a coherent, supported discourse.
But a number of points need to be taken into account if essay
examinations are used to measure writing ability. Some
of the problems involved in using essay type tests are as follows: It
is difficult for an average teacher to structure such prompts for essay tests
that clearly specify the aim, topic, audience, writer’s role and evaluation
criteria. The problems of
reliability, validity and the factors that affect marking discussed in this
section prove that it is very difficult to measure the skills of writing ability
through essay examinations. Teachers
cannot spend a lot of time in checking essays using analytic or holistic rating
scales. The general impression
score usually assigned by teachers is not a reliable method of scoring. The
method of training of raters is expensive and time-consuming and is not
practicable as far as the school teachers are concerned. Since
it is not easy to structure, administer and score essay examinations, we need to
consider other types of tests which are easy to construct, are easy to evaluate
and which give a reliable and valid indication of learners’ proficiency to
communicate through writing.
2.3.3
The interlinear test Findley
and warren (1953) made an attempt to overcome the defects of essay examinations
arising from its unreliability of scoring, by the development of ‘semi –
objective’ tests of writing ability termed the Interlinear Test.
This test overcomes most of the objections to objective tests of writing
ability. Objective tests usually
present the learner with poorly written material and provide him with several
options regarding the corrections, which should be made.
According to Swinford, France (1956), the interlinear test structures the
learner’s response to such an extent that the reliability of scoring is of a
very high order. The
interlinear test presents the candidate with a triple spaced copy of a badly
garbled piece of writing. The learner is allowed thirty minutes to indicate the
necessary co-relations and deletions but is instructed not to add his own ideas.
The learner’s paper is then ‘scored’ for his treatment of predetermined
errors. The reliability of the interlinear test compares favourably with that
obtained for objective tests of the same working time and length. The validity of the interlinear test also is as valid as that
of the objective test. It
would be useful to analyse the objective test in detail so as to get a clear
understanding of its advantages and disadvantageas.
2.3.4
The Objective Test The
objective type test may be of the short answer type or the choice item type. A
number of studies have considered the relative validities of short answers and
choice items. Cook (1955) found
that the correlation between scores of knowledge of contemporary affairs for
college students and multiple-choice test over the same item of information was
so high, when correlated for attenuation, that it was impossible to say that the
two tests were measuring two different kinds of achievement.
Hurlburt (1954) on the other hand, reported significant differences
between completion and multiple-choice tests as measures of precise knowledge of
word meaning. a.
Short answer questions The
short answer items require the learner to writh a word, phrase, number or
symbol, while the choice items ask him to choose one of the many alternatives
given in the test itim itself. The short answer type questions may be of the recall of a
word or number. The choice items
often present new problem situations and suggest alternatives, which the
examinee has never seen before. So
they call for more than recognition.
i.
He must concentrate on detailed and highly specific questions to which
brief but quite unique verbal or numerical answers can be given. ii.
He must be prepared to deal with frequent and difficult decisions as to
whether a given answer is just barely adequate or not quite adequate. Choice items may be one of the following
types: $
Classification $
Matching $
Multiple-choice $
True / false $
Rearrangement items. The
advantages of the choice items are as follows:
Choice items can be
made very difficult, without involving ambiguity and as searching of high levels
of competence as items in any other form.
To make wise choices
it is necessary to perceive clearly the implications or implications or
consequences of choosing each alternative. b.
Multiple-choice items A
number of books discuss the construction and administration of multiple choice
items. ‘Language Testing’ by
Robert lado (1961), ‘Modern Language Testing’ :
‘A Handbook’ by Rebecca Valette (1967), ‘Testing English as a
Second Language’ by David Harris (1969), Foreign Language Testing : Theory and
Practice by John Clark (1972), ‘Testing and Experimental Methods’ by J P B
Allen and Alan Davies (1977), Revision of Modern Language Testing by Valette
(1977) are some of the important books which deal with the construction of
discrete point tests. Discrete
point multiple-choice tests assess one skill at a time, listening, speaking,
reading or writing. They assess
only one aspect of the skill – i.e. productive
versus receptive, oral versus visual, etc.
They attempt to focus attention on one point of grammar at a time.
Each test item is aimed at one element of a particular component of a
grammar item. According to Lado
(1961) within each skill, aspect and component, discrete items focus on
precisely one and only one phoneme, morpheme, lexical item, grammatical rule or
whatever the appropriate element may be. Remmers
and Adkins (1942) studied the reliability of multiple-choice tests as a function
of the number of responses per item. They
found that reduction in the number of distractors tended to lower the test
reliability. Spearman - Brown formula gave reasonable good predictions of
the reduced reliability when distractors were eliminated at random.
Williams and Ebel (1957) started with four-response forms by
systematically eliminating the least effective distractor. They found that in a
test period of fixed time limit, a greater number of two response items would
produce more reliable scores than a smaller number of three of four response
items. According to Weitzman and
Ellis (1946) the essential characteristics of the distractors of multiple-choice
items is that they should be plausible to those who lack the knowledge or
ability for which the item is testing. Hence
a lot of care should be put into the selection of the distractors. c.
Drawbacks of discrete item tests The
construction of multiple-choice items is very difficult.
Lot of care needs to be taken while preparing the ‘stem’ or the main
sentence and the different choices from which the learner has to select one.
The main sentence or question should be unambiguous and explicit.
All the choices should look plausible for those who lack the knowledge.
At the same time there should not be more than one correct answer. Standardizing
discrete item tests require pre-testing, statistical evaluation and rewriting
techniques, which is quite time-consuming and require a lot of technical
knowledge. Hence it is not
practical for and ordinary classroom teacher who may not have the time or
technical skill to prepare these discrete item multiple-choice tests. John
W Oller Jr. (1979) criticizes the discrete item tests.
According to him discrete point tests view language as form and usage
rather than of process and use. In
actual language use, language is not used in bits and pieces.
A proficient user of language is not overtly conscious of the isolated
phonomes or graphemes or any such bits of language.
Again proficiency in using isolated bits does not indicate that the
learner can put together these bits and use the language for communication.
To test language as communication we need to think of a different kind of
test, which tests the learners’ ability to use the language. 2.3.5
Pragmatic Tests John
W Oller Jr. (1979) discusses pragmatic tests and criticezes the discrete point
tests at length and offers an alternative in the form of pragmatic tests and
suggests ways of constructing, administering and scoring pragmatic tests.
To understand his concepts it is necessary to get a clear picture of his
views on language proficiency, expectancy grammar and pragmatics. a.
Pragmatic Tests & Language Proficiency According
to Oller there are two aspects of language use:
i.
Factive use – when language is used to convey information about people,
things, events, ideas and states of affairs. ii.
Emoitive use – when language is used to convey our attitude about the
factual information we want to convey. Every
time we use language, we use both the aspects of language.
It is quite possible for people to agree on the factual information
conveyed but differ on the attetude towards those facts. There
are two major contexts of language use:
i.
The linguistic context which refers to the verbal and gestural contexts
of language; and ii.
The extralinguistic context, which refers to, the states of affairs
constituted by things, events, people, ideas, relationships, feelings,
perceptions, memories and so forth. The
objective aspect of extra linguistic context, the world of existing things, may
be distinguished from the subjective aspect of extra linguistic context, the
world of self - concept and inter-personal relationships.
According to Oller there are systematic correspondences between
linguistic and extralinguistic contexts. Linguistic contexts are pragmatically
mapped onto extralinguistic contexts, and vice versa. b.
Pragmatics Pragmatics
is concerned with the relationship between linguistic contexts and
extralinguistic contexts. “Pragmatics
is about how people communicate information about facts and feelings to other
people, or how they merely express themselves and their feelings through the use
of language for no particular audience, except possibly an omniscient god.”
(Oller, 79:19) Quite
often we know much more than what we actually express in words.
We also leave a lot of it unsaid and we depend on the receiver to fill in
what is unsaid and interpret our message. “In
normal use of language, no matter what level of language or mode of processing
we think of, it is always possible to predict partially what will come next in
any given sequence of elements. The
elements may be sounds, syllables, words, phrases, sentences, paragraphs, or
larger units of discourse. The mode of proccessing may be listening, speaking,
reading, writing, or thinking, or some combination of these.
In the meaningful use of language, some sort of pragmatic expectancy
grammar must function in all cases.”
(Oller, 1979:25) c.
Expectancy Grammar According
to Oller the notion of an expectancy grammar characterizes the psychologically
real system that governs the use of a language in an individual who knows that
language. The characteristic of such an expectancy system helps in two
ways:
To explain why
certain kinds of language tests apparently work as well as they do; and
To device other
effective testing procedures that take account of these salient characteristics
of functional language proficiency. A
valid language test should press the learners’ internalized expectancy system
into action and must further challenge its limits of efficient functioning in
order to discriminate among degrees of efficiency.
According to Oller, a language test to be valid should meet the pragmatic
naturalness criteria. A test is
said to meet the pragmatic naturalness criteria when it invokes and challenges
the effeciency of the learners’ expectancy grammar by causing him to process
temporal sequences in the language that can conform to normal contextual
constraints and by requiring him to understand the systematic correspondences of
linguistic and extralinguistic contexts. 2.3.6
Test which meet the pragmatic naturalness criteria There
are two closely interrelated criteria of construct validity, which need to be
imposed on language tests to find out if they meet the pragmatic naturalness
criteria.
i.
The test must cause the learner to processs – either produce or
comprehend or possibly to comprehend, store and recall, or some other
combination – temporal sequences of elemints in the language that conform to
normal contextual constraints which may be linguistic constraints or extra
linguistic constraints. ii.
The test must require the learner to understand the pragmatic
interrelationship of linguistic contexts and extralinguistic contexts. Some
tests which meet the pragmatic naturalness criteria are as follows: a.
Dictation b.
Cloze c.
Combined Cloze and Dictation – A cloze
passage is prepared deleting single words, parts of words or sequences of
words and given to the learner in the written form.
The same passage, without any deletions, is heard by the learner either
live or on tape. The learner is
asked to complete the cloze passage with the help of what he hears. d.
Oral cloze procedure – A cloze passage with deletions is dictated for
the learners to copy down and complete the deleted portions with appropriate
words. e.
Dictation with interfering noise – Taped verbal material is super
imposed with `white noise`. If the
linguistic context under the noise is fully meaningful and subject to the normal
extralinguistic constraints, this procedure qualifies as a pragmatic testing
technique. For example, if it is a
telephone conversation with one party calling from a market place, the noise
superimposed will have sounds of the market place. f.
Paraphrase recognition – Learners are asked to read a sentence,
paragraph or longer passage and then select from several alternatives the one,
which best represent the central meaning or idea of the given piece. g.
Question answering – Four answers are given for each question. Learners
listen to the question orally and select the best answer.
There may be a short dialogue followed by a question.
Four or five answers are given and learners select the best answer.
This type of test is used in TOEFL examinations. h.
Bilingual syntax measure – A picture or cartoon is shown and learners
are asked some questions based on the picture.
Burt, Dulay and Hernandez (1975) made learners answer questions based on
colourful cartoon style pictures. i.
Oral interview – Where learners are asked questions as would happen in
a normal interview for a job or admission to a course. j.
Composition or essay writing k.
Narration l.
Translation – Which is similar to the on taking place in a real life
context. Having
discussed the nature and types of pragmatic tests in general, it would be useful
to consider dictation and cloze in more detail because they meet the criteria
like validity, reliability and practicality, being easy to construct, administer
and score. a.
Dictation Though
dictation is not accepted as an efficient means of language testing by Lado
(1961), Harris (1969), Anderson (1953), Somaratne (1957), J B Heaton (1975) and
Davies (1977), according to Oller (1979) it meets the pragmatic naturalness
criteria and is an efficient tool to measure language use. Anderson
(1953), considers dictation as a very indirect and inadequate test of auditory
comprehension, while Somratne (1957) and Ingram (1977) consider it as a test of
spelling only. According to Lado
(1961), dictation does not test word order or vocabulary since they are given by
the teacher and it measures very little of language.
J B Heaton (1975) also thinks dictation is not effective in providing a
means of assessing any one skill because it measures too many language features. Davies (1977) also suggests that dictation is too imprecise
in diagnostic information. But
Oller (1979) while admitting the limitations of dictation, considers it to be a
reliable means to test languages proficiency, if it is administered and scored
properly. According to him, any
proposed testing procedure, which is to qualify as pragmatic language processing
task, must meet two naturalness criteria, viz.
i.
It must require the processing of temporal sequences of elemints in the
language constrained by the normal meaningful relationships of such elements in
discourse, and ii.
It must require the performer of the task to releate the sequences of
elements to extralinguistic context via pragmatic mappings.
In short, pragmatic tasks require time constrained processing of the
meaning coded in discourse. According
to Oller, dictation meets both the criteria of pragmatic tests, if the sequences
of words or phrases to be dictated are selected from normal prose, dialogue or
some other natural form of discourse, and if the presentation of the material
challenges the short-term memory of the learners. “.... a simple tradional dictation meets the
natuaralness requirements for pragmatic language tests.
First, such a task requires the processing of temporally constrained
sequences of material in the language and second, the task of dividing up the
stream of speech and writing down what is heard requires understanding the
meaning of the material - i.e., relating the linguistic context (which in a
sense is given) to the extralinguistic context (which must be informed).”
(Oller, 1979; 39) i.
Types of dictation There
are diffferent types of dictations. Some of them are as follows: $
Standard dictation – The complete passage is read out and learners are asked to write down
what they hear. $
Partial dictation –
Part of the passage is given in writing. Learners
hear the complete passage and try to fill in the missing parts.
This technique combines dictation with cloze. $
Dictation with
competing noise – The dictation passage is read out on tape. Some noise is
superimposed on the taped version of the passage. The noise may be such as we find in real life situations.
For example, talking to somebody in a factory while the machines
operating are making a lot of noise. $
Dictation –
composition – Before starting to write, learners listen to a passage two or
three times. Then they try to write
from memory the passage as they heard. $
Elicited imitation
– Learners listen to a passage two or three times. Then they try to recount orally the passage as they listened
to. ii.
Selection of material & administration procedure
Once
we decide the purpose of testing and the procedure which is most suitable to out
learners, we can select the material. The
material should be appropriate to the level of the learners.
Once the material is selected the difficulty level can be decided.
There are a number of ways of influencing the difficulty level of the
task even after the difficulty level of the material has been set by the
selection process. Factors
influencing the task difficulty are as follows:
The conceptual
difficulty of the word sequences themselves (other factors being held constant)
The overall speed of
presentation
The length of
sequences of material that are presented between pauses
The signal to noise
ratio - i.e. the amount of noise added to the material
The number of times
the text is presented
The dialect and the
enunciation of the speaker and the dialect the hearer is most familiar with
A miscellany of other
factors. Since
the purpose of the test is decidedly not to assess the speed with which
examinees can write, the pauses must be long enough to ensure that the task is
not turned into a speed writing context. A
rule of thumb suggested by Oller is for the examiner to subvocalize the spelling
of each sequence of verbal material twice during the pause while the learners
are writing it. iii.
Scoring Procedure Standard
dictation is usually scored by allowing one point for every word in the text.
There are two methods of scoring.
Error – counting
method – Here the number of errors are counted and the sum is subtracted from
the total number of words in the text.
Correct words – in
– sequence method – Here the number of correct words in sequence are counted
and assigned one mard each. The
total is given out of the total number of words in the original text. These
two methods are not perfectly equivalent if intrusions are counted as errors.
For example, if two sentences are written as follows:
‘This is a Ramanbhai.
His is a good doctor’. As
per the error counting method ‘His’ will be counted as ans error.
It shold have been ‘He is’. So
thelearner will get two less than the total number of words - i.e. six out of
eight. As
per the correct words-sequence method, if the errors of intrusion are counted,
then the article ‘a’ in ‘This is a Ramanbhai’ will also be counted as an
error. So the learner will get
three less than the total number of words -i.e. five out of eight. In
word-for-word scoring errors counted counted could be of the following types:
Errors of deletions
– some words are left out by the learners
Errors of distortions
– of form or sequence – The wrong form of the word is written by the learner
– ‘gets’ instead of ‘get’ – or
the word order is not proper.
Errors of instrusion
– Some words are added by the learner in the writtin passage, though it was
not read out as part of the original passage. Spelling
errors can be distinguished as a special category.
Only those spelling mistakes, which distort the form of meaning of the
word, can be counted as errors. For
example, if ‘tree’ is the word given in the passage, and if the learner
writes ‘three’ or ‘try’ it will be counted as an error.
If the learner writes ’tre’ or ‘tiri’ it will not be counted as
an error. Like
dictation, cloze procedures are also considered as pragmatic tests because they
require temporally constrained sequential processing and pragmatic mapping of
linguistic elements on extralinguistic contexts. b.
Cloze The
Cloze procedure was first applied as a reliability measure with native speakers
by Taylor (1953). It has since been
demonstrated in many studies to have substantial concurrent validity as an
integrative test of overall proficiency, in Englis as a second language.
In the studies carried out by Oller & Conrad (1971), Oller (1972),
Stubbs & Tucker (1974), Irvine, Atai & Oller (1974) Hinofotis (1980) and
Edith Hannia & May Shikhani (1986) high correlations scores on an
established measure of language proficiency. Cloze
is considered an intergrative rather than a discrete point test because it draws
at once on the overall grammatical, semantic and rhetorical knowledge of the
language. To
reconstruct the textual message, learners have to understand key ideas and
perceive inter – within a stretch of continuous discourse and they have to
produce, rather than simply recognize an appropriate word for each blank.
The focus of the task involved is more communicative than formal in
nature and it is therefore considered to reflect a person’s ability to
function in the language. According
to Moller (1981), both cloze procedure and paragraph writing are integrative in
nature. They require the learner to
draw upon several language skills simultaneously and involve complex processsing
of language while the focus is on content.
Both require the production of language rather than mere recognition of
correct items, although writing may be considered to include the communicative
dimension more directly. There
is some disagreement among researchers about the suitability of cloze to test
high – order language abilities. According
to Alderson (1979) cloze provides a measure of core linguistic skills of a
relatively low order. According to
a number of other researchers like, Chihara, Oller, Weaver and Chavez (1977),
Bachman (1982) and Brown (1983), cloze procedures can test not only lower –
order linguistic skills, but also higher – level ability involving discourse
constraints across sentences. i.
Types of Cloze Some
cloze use rational deletion procedure to ensure the inclusion of cohesive items.
Bachman (1982) in his study used the rational deletion procedure.
Some other studies use systematic deletion procedure where the blanks
occur at regular intervals. In a
study conducted by the American University of Beirut cloze passages were
carefully selected so that blanks systematically include both syntactic and
cohesive factors and therefore covered higher – order skills. Edith Hanania
and May Shikani (1986) in their article in TESOL Quarterly (Vol.20) report a
recent research carried out at the American University of Beirut where the inter
– relationship of three types of measures – A standardize ESL test, a cloze
and a written composition test – was studied.
The results indicate that there is a high correlation between cloze and
written composition test. Oller
(1979) gives detailed instruction for the selection of cloze passage and for
scoring procedure. The
difficulty level of the passage should be suited to the level of the learners.
The passage should be of some general topic which does not require technical
knowledge. The standard test
construction technique known as the fixed ratio method involves deleting every
‘n’ th word (where ‘n’ usually varies from five to ten) and replacing
each one with a standardized blank (usually about fifteen typed spaces).
The standard length of cloze is fifty items – thus the passage length
is approximately fifty times ‘n’. Another
procedure is to delete words on some variable ratio usually decided by a
rational selection procedure – e.g. delete
only content words. Taylor (1957)
demonstrated that the every nth word deletion technique yielded cloze items of
somewhat greater reliability and validity than deliberate selection of words to
be deleted, i.e. deleting only function or content words. iii.
Scoring criteria There
are two methods of scoring a cloze passage. The
exact word method – The word in the original passage is considered as the
correct one and any other word which the testee might supply is not accepted. Contextual
appropriateness – Any word supplied by the testee which is appropriate to the
context is accepted. General
guidelines given by Oller for contextual appropriateness are as follows:
If it is the exact
word as in the original passage it is marked correct.
If not, it should be
checked to see if it fits the immediate surrounding context; whether or not it
violates any local constraints in the same sentence or surrounding phrases.
It should also be
checked to see if it is consistent with all of the preceding and subsequent text
(this includes previous and subsequent responses in other blanks as filled in by
the examinee). If
the response passes all these checks it is marked correct, otherwise it is
considered incorrect. Naccarate
and Gilmore (1976) have shown that contextually appropriate scoring
can be done either by a single rater working alone or by several raters,
with equivalent results. Having
discussed in detail the pragmatic tests, it is time to compare them with
discrete point and integrative tests. 2.3.7
Comparison - Discrete point / Integrative / Pragmatic Tests John
Carroll (1961) first proposed the distinction between discrete point and
integrateve language tests. Though these two are not always different for
practical purposes there are two basic differences.
The theoretical bases
of the two approaches contrast markedly.
Predictions
concerning the effects and relative validity of the two procedures differ. Discrete
tests take language skills apart and attempt to test the knowledge of language
one bit at a time. Integrative tests put the skills back together and attempt to
assess learner’s capacity to use many bits all at the same time and possibly
while exercising several presumed components of a grammatical systemand perhaps
more than one of the skills or aspects of skills. Pragmatic
tests go a little beyond the integrative tests.
The pragmatic tests meet the pragmatic naturalness criteria while the
integrative tests do not reach upto that point.
So unlike the integrative tests, pragmatic tests invoke and challenge the
developing grammatical system of the learner.
This requires processing sequences of elements in the target language
subject to temporal contextual constraints.
In addition to this, pragmatic tests are such that learners need to
relate the linguistic sequences to extralinguistic contexts in meaningful ways. 2.3.8
Implications for the present study $
The above discussions
indicate that pragmatic tests like dictation and cloze can be used effectively
to test language proficiency. These
two tests are valid and reliable measures of language use.
They are practical because it is not very difficult to prepare the
material, administer the test, score the test and interpret the results.
They also have diagnostic value, and error analysis based on the results
could offer suggestions for further instructional programmes. $
Scoring of cloze
passages could be based on contextual appropriateness and that of dictation
could be of the correct word-in-sequence method.
(See 2.3.6 biii) $
Since objective,
multiple-choice items do have some advantages, some vocabulary and grammar items
could be tested using this method. $
To test their
communicative efficiency, a letter could be given for which they are to write
the reply. The reply could also be
given in part thereby structuring the learners’ response partly so as to make
the evaluation more effective. This
could again be scored using both contextual appropriateness criteria and correct
word-in-sequence method.
2.4
Review of Research Studies Though
not much work has been done in the area of writing at the school level in India
and particularly in Gujarat, a number of studies carried our in other countries
could help us identify the various problems involved and the probable solutions.
A number of studies carried out form the early decades of the twentieth
century reveal how our concern has been changing from what is written to how it
is written and from how reliable the tests are to what aspect of language use do
they test. Before
the 60’s many of the studies were concerned with the reliability of the essay
tests. After the 60’s there were
a number of studies, which identified the features affecting marking.
In the 70’s our concern has been to find out what writing includes and
how it can be taught. The recent
researches of the 80’s are concerned with teaching writing as communication
and testing writing to see whether to see whether the message has been
successfully communicated.
2.4.1
Studies up to the 60’s The
majority of the studies made prior to 1940 were concerned with problems of
reliability in essay tests. Huddleston
(1921) presents a comprehensive and well -
organized review of the literature on the reliability of essay tests covering a
period from 1900 to 1940. This
review points out the lack of any intensive and well-organised attack upon the
problem of reliability upto that time. J
M Rico was one of the forerunners of the scientific movement in education, which
during the early decades of the 20th century produced substantial
accumulation of research studies on the statistical properties of all kinds. Mainly
these studies were of three kinds: a.
Those related to the construction, use and scoring of objective tests; b.
Those related to the construction, use and scoring of essay tests; c.
Those contrasting the merits of objective and essay tests in measurement
evaluation, placements and prediction. These
comparative studies of subjective and essay tests were meant for finding out
which of the two types of tests is easy to score, more objective, and more valid
in predicting learners achievement level. The
main problem of essay tests have the lack of reader reliability – the extent
to which different individuals can agree on the score which should be assigned
to a particular question. Some
of the findings of significant studies are as follows: $
The experience or
maturity of the reader can bring about variation in scores.
Skilled readers tend to mark on more abstract qualities such as
‘style’ and thought content. So
unskilled readers are more reliable than skilled readers.
(Vernon &Millican 1954) $
Highly trained
readers are more reliable than untrained ones.
(Diederich Paul 1957) $
Long responses are
more reliable than short ones.
(Vernon & Millican 1954) $
The more precise and
detailed the marking criteria, the higher the reliability.
(Sharp
Lawrence 1925) $
The greater the
structuring of the question for the examinee, the higher the reliability.
(Swinford 1956) $
If there are optional
questions from which the candidate has to select one, some topics are more
reliable than others.
(Seinford, Francis & Vernon 1956) $
Marks of papers drawn
from homogeneous population are much less reliable than marks of those from
heterogeneous population.
(Vernon, 1956) $
Markers well
acquainted with the work of the student are more reliable than those who do not
know the students.
(Vernon, 1956) If
the research studies upto the 60’s were concerned with the reliability of
essay tests, the later studies were concerned with the mechanical aspects of the
written work which affect marking.
2.4.2
Studies of the 60’s and 70’s A
number of mechanical aspects of written work affect marking, even if they have
very little communicative value. This
is provided by a number of studies. Some
mechanical features which affect marking are as follows: $
Spelling errors
adversely affect marking, with errors of grammar and punctuation coming next. (Marshall,
1967 & Scannell 1966) $
Handwriting has a
great impact on the markers. This is provided by chase (1968), Briggs (1970
&1980), and soloff (1973). Some
other general features which affect marking are as follows: $
According to Marshall
(1960) an alert and sensitive marker bases his assessmint on the features of a
piece of work, which ‘float’ to him. That is, he relies on his intuitions about the text. $
Soloff (1973)
suggests that lack of consonance between the writer’s values and those of the
marker may affect the grade awarded. The
London Association for the teaching of English (1965) shares his opinion. In
the 70’s research studies looked into what writing includes and how it can be
taught. The studies of Zoellner
(1969), Macrorie (1970), Alexander (1971),
Emig (1971), Lindo;; (1974), Graves
(1975), Britten (1975), Flower (1979)
and Hayes (1979) looked into the factors involved in composing and thier
pedagogical implication. Cognitive
research in writing has examined various aspects of writing.
It has examined the
aspects of pre-writing stage and the application of various heuristics. It has focussed on the revision and editing phases and the various strategies and demands that are involved.
2.4.3
Studies of the 80’s As
Humes Ann (1983) points out, writing researches of the present day have
undergone a transformation. He
discusses the methodologies employed in recent research concerned with the
composing process. Studies of the
80’s are more concerned with analysing the compositions of successful writers
to find out ways of effective instructions for teaching communicative writing
and devising reliable and valid tests which go beyond the mechanical aspects of
writing. Some
of the significant studies of the 80’s are summarised and discussed under
different heads. a.
Reasearch on writing and their application. Dominic,
Joseph F (1989) examines the range of relationships between research on writing
and its applications to classroom instructions.
He discusses different approaches to the study of writing instruction,
collaborative interactive research on instruction, the process approach to
writing instruction and writing as a cognitive process.
Human Ann (1983) also discussess different methodologies employed in a
number of case studies of the composing process, naturalistic studies, quasi
product studies that interpret result in terms of the process, and studies that
use unique procedures. The results
are presented in terms of the processes and of the sub-processes of writing -
planning, translating, reviewing and revising. Stephen
P Writte (1980) proposes a conceptual framework or model for conducting and
evaluating research in written composition, a frame work or model from which may
be derived ‘an adequate understanding of the term composition’.
This conceptual framework attempts to do four things:
It tries to
accomodate the entire field of written composition and, at the same time,
indicates the boundaries of that field.
It can be used as a
tool for classifying empirical research in written composition, research already
completed and research yet to be completed.
It provides a basis
for testing or validating theories which attempt to explain all or part of the
field of written composition.
It is useful as a
houristic device for generating basic research questions.
The model provided by Stephen Witte includes four components: (see
fig: 2) b.
Features of Written
Expression Bruce
B, Collins A, & Rubin A D (1982) explore the process of writing from three
perspectives: writing as a communicative act, writing as a taxonomy of
communicative acts and writing as a decomposable process whose product must
still fulfill an overall communicative function.
In the first perspective, the observation that to write is to
communicate, has major implications for a theory of writing.
It forces one to focus on the active role of the reader and leads to an
emphasis on the audience in choosing tasks for beginning writers.
In terms of the second perspective the difference between writing and
participating in a conversation and theoretical and practical implications of
these differences are discussed. From
the third perspective various sub-processes of writing – discovering,
manipulating ideas, and generating text at different structural levels
- are discussed. Spikes
W C & Spikes L A (1983) attempted to identify the skills necessary to write
a successful essay. Learners
preparing to take an essay test received instruction for sixteen to eighteen
days in development, rhetoric, and mechanics of writing.
The data simply that instruction in concepts, skills, and relationships
in essay writing, considered in conjection with learners’ diagnosed needs can
result in improvement. Hull,
Glynda (1983) tested the effects of interruping visual feedback on writing in
two groups of subjects by preventing them rereading as they produced written
texts. They performed two tasks,
one in visible and the other in invisible ink. Their texts were then analysed
for errer, syntax, overall quality and sentence connectedness by four raters.
While both groups were able to produce relatively well-formed sentences
when they could not reread, both were hindered at the level of discourse
production. c.
Teaching writing A
number of studies deal with the actual teaching of writing, the various
activities that can be carried out in class, and how much teacher intervention
should be there to facilitate writing. Cognitive
psychologists conducted a number of research studies to find out what writing
actually involves and how it can be taught.
They have investigated the effects of teaching what Scardamalia and
Bereiter (1981) called ‘Procedural facilitators’.
Procedural facilitators can range from such simple strategies as asking
the writer to ‘say more’ to presenting the writer with complex models of
syntactic patterns to imitate in the revision.
The results of using these facilitators showed increase in length and
quality of the writing. This
research suggests that instruction focussess on two parts – the actual text,
and the various mental representations of the text – from graphical
presentation to plans for a whole text. This
mental representation is meant to affect not only the immediate task but also
the representation in the next task. Bereiter
and his associates have shown that young beginning writers, from age eleven
onwards can be helped to plan and evaluate their compositions if they are
provided with procedural facilitation. Children
are given procedural cues without giving any hints as to the context.
They are helped in making rhetorical decisions.
In these way learners potential is utilised. According
to Bereiter the two main problems of composition are - relative shortness, and
low judged quality. These problems arise because of slower speed and mechanical
constraints associated with writing. According
to the Bereiter group when learners are prompted to write more, they often can
double or triple the quantity of composition which tend to be judged better than
dictated texts. This
line of research suggests the efficacy of an approach that combines phase
instruction – which stresses on the various stages of writing – and variable
product instruction which stresses on appropriacy.
This research also establishes that instruction in general procedure
rather strict rules has an effect on learners’ performance. The
testing of efficacy of instruction in ‘general procedures’ as opposed to
other approaches needs further study. At
present efforts have been made only to define the general procedures.
The instructional techniques are not yet fully developed. Giordano
Gerard (1983) discusses seven remedial exercises that constitute a model
communicative writing programme: copying, automatic writing, restoration,
outlining, paraphrasing, projection and correspondence. The exercises are
communicative because they embody the transmission of meaningful information to
attentive readers. Each exercise
emphasises a precise writing skill that can be complemented with one or more
reading skill. Grinnell
P C & Burrie N A (1983) uses the process of differentiation, negotiation and
revision to trace the graphic communication process in young learners as it
emerges spontaneously and through formal instruction. Even
after they learn to write, drawings continue to contribute to the communicating
process by helping the learners think about what they want to write and by
expressing information too difficult to put into words.
Sinatra, Richard (1983)
employs a visual / spatial technique to teach writing which has three
components; pictures, model sentence configurations, and function words.
The first components suggests the ideas to be expressed in a new
sentence; a visual pattern illustrates the required form or configuration of the
new sentence; the third component function words and correct punctuation for
each particular type of sentence are visibly displayed in the visual pattern.
As learners compose new sentence that follow the model patterns, they
learn to comprehend meaning and construct new sentence on their own. Shaw
Robert (1983) presents guideline for the planning of teacher’s interventions
during a wring lesson that enable the teacher to overcome the constraints that
hamper efforts to teach writing -i.e. administrative procedures, standardised
testing, commerical textbooks and the lack of resources for training teachers in
writing instructions. In
particular, four facilitative activities - reviewing, orienting, evaluating and
writing – provide a framework for making practical devisions about response to
problems learners encounter as they write. d.
Intergrating writing skill with other skills A
number of studies establish the fact that when writing skill is integrated with
other skills there would be significant improvement in learners’ ability to
communicate through writng. Noyce,
Ruth M S (1983) research findings support S Stotsky’s (1975) contention that
experiences that integrate listening, speaking, reading and writing promote in
reading and written composition. Markham
(1984) in his work ‘Assisting
speakers of Black English as they begin to write’ says that the strategies for
facilitating the success of young black writers are the same as these
appropriate for any beginning writers. A good deal of classroom time should be spent on oral
activities to develop the ability to communicate ideas clearly. Reading to the learners provides models of syntax and form of
the written language and also expands their knowledge of the world. In teaching
writing, learners should be helped with both ideas and the mechanics nor should
the teacher correct too frequently or without consideration to the learners
feelings. Barenbaum
E M (1983) presents a survey of the relationship between writing to the content
area of reading and oral language. He
devises instructional strategies for promoting writing which include the
establishement of a safe enviroment motivation, the provision of an audience and
a purpose, conference for revision and developing an oral language base. e.
Testing writing The
research studies of the testing writing mainly deal with scoring systems for
direct writing assessments or with comparing different types of tests. The
studies of Quellmalz (1980), Chapman, Fyans & Korin (1984) Quellmalz (1984),
and Mullis (1984) deal with the prepartion of rating scales, while the studies
of Hinofotie (1980), Bachman (1982), Brown (1983), Edith Hanania and May Shikani
(1986) deal with the preparation and administration of cloze procedure. Quellmalz
(1984) discusses large – scale writing assessment with regard to features of
successful writing assessments, what is being tested, developing writing prompte,
rating criteria, training and scoring, and assessment validation and follow
through. Chapman,
Fyans & Kerin (1984) describe a writing assessment programme in lllinois
designed to annually assess the knowledge and skills of learners in developing
convincing points of view, events or ideas in functional writhing.
The assessment uses and analytic scoring system, and a rating guide for
functional writing and provides score categories that describe increasing levels
of writing skill development. The
guide measures five areas of functional writing: focus, support, organisation,
mechanics and overall effectivencess. Mullis
(1984) describes three scoring systems for direct writing assessements that are
based on score point values; holistic scoring, primary trait scoring, and
analytic scoring. Holistic scoring
provides information on overall writing quality, primary trait scoring focuses
on whether the writing communicates necessary information effectively, and
analytic scoring rates prominent characteristice of writing according to
quality. It is concluded that it is
best to use several systems of scoring whenever possible due to the varying
strengthe and weaknesses of the individual systems. Edith
Hanania and May Shikani (1986) tested the ‘Interrelationship among three tests
of language proficiency: standardized ESL, cloze and writing’ which is
reported in the TESOL quarterly (Vol. No.20).
They tried to find if cloze could be used as an alternative to a written
composition test, as cloze combines the advantages of integrative testing and
objective scoring. The research was
carried out at the American University of Beirut (AUB).
The main purpose of the work was to study the interrelationship amoung
three types of measures: i.
A standardized ESL test of two hundered multiple choice items distributed
over four sections – structure, vocabulary, reading comprehension and
miscellaneous abilities. ii.
A Cloze test of carefully selected four passages dealing with a general
theme that did not require specialized knowledge to comprehend, with fifty
systematically spaced blanks, to be scored by exact word method. iii.
A composition test of different topics that were related to the
learners‘ general experience and interest, requiring the learners to write
about 250 words choosing one of the two given topics. Each composition was graded by two experienced teachers, who
using the general impression method considered grammar, mechnaics and rhetorical
aspects. The
results of the study were as follows: $
The close and
composition writing provided additional information about proficieny beyond that
provided by the ESL test.
$
The combination of
any two of the three tests improved the predictablity of the third. According to the authors the task involved in a Close test is integrative in nature, tapping overall abilities similar to those required in communicative language use. The incorpartion of a close procedure can be expected to promote communicate language teaching in classrooms. 2.4.4 Overall Implications
|
||
|
H M Patel Institute of English Training & Research, Vallabh Vidyanagar - 388120, Gujarat, India Phone : 091-2692-230193, 091-2692-230079 eMail : info@hmpenglish.com |
||