М. Н. Аверина, Современный урок иностранного языка, Ярославль, 2004 H. Douglas Brown, Teaching by Principles: An Interactive Approach to Language Pedagogy, San Francisco State University, 1994
М. Н. Аверина, Современный урок иностранного языка, Ярославль, 2004 H. Douglas Brown, Teaching by Principles: An Interactive Approach to Language Pedagogy, San Francisco State University, 1994
1
М. Н. Аверина, Современный урок иностранного языка, Ярославль, 2004
2
H. Douglas Brown, Teaching by Principles: An Interactive Approach to Language Pedagogy, San Francisco
State University, 1994
1
perception with:
1. a carefully constructed, well thought-out format
2. items that are clear and uncomplicated
3. directions that are crystal clear
4. tasks that are familiar, that relate to their course work
5. a difficulty level that is appropriate for your students
6. test conditions that are biased for best-that bring out students' best
performance.
3. The principle of authenticity
Make sure that the language in your test is as natural and authentic as possible. Also, try to give
language some context so that items aren't just a string of unrelated language samples. Thematic
organization of items may help in this regard.
4. The principle of "washback"
"Washback" is the benefit that tests offer to learning. When students take a test, they should be
able within a reasonably short period of time to utilize the information about their competence that test
feedback offers. Formal tests must therefore be learning devices through which students can receive a
diagnosis of areas of strength and weakness. Their incorrect responses can become windows of insight
about further work. Your prompt return of written tests with your feedback is therefore very important
to intrinsic motivation.
3
Jim Scrivener, Learning Teaching, Macmillan Books for Teachers, 2007
3
Diagnostic tests
Diagnostic tests identify students strengths and weaknesses. They provide the teachers with the
information on what further teaching is necessary and what problems the students might have in
coping with the instruction demands.
Placement tests
Placement tests provide information that helps to place the students at the most suitable stage of the
teaching curriculum, bearing in mind their level of the language achieved so far. (Adapted from
Hughes, A., 1996. Testing for Language Teachers. p. 9-21).
Performance-based testing
Instead of just offering paper-and-pen-cil single-answer tests of possibly hundreds of discrete
items, performance-based testing of typical school subjects involves:
open-ended problems
hands-on projects
student portfolios
experiments
labs
essay writing.
Testing Techniques
Gap-fill4
Gap filling refers to tasks where the test-takers are given separate sentences with some words
or phrases deleted. The task is to restore the missing words. In these tests answer keys can sometimes
have more than one answer for a space. Some missing words can have a structural value for the
sentence (e.g. prepositions or conjunctions). Other words can have full lexical meaning. Sometime a
list of the words can be given to the test-takers to be used in filling in the gaps. In such cases the
number of words in the list is usually larger than the number of gaps in the text.
Single sentence
Fill in the blanks. Use only one word in each space.
I'd ……. go to the cafe than the pub.
Answer: rather
(If answers of more than one word are allowed, then other answers are
possible; instructions need to be clear!).
Using given words
Put one word from the list below in each gap. thought switched
4
М. Н. Аверина, Современный урок иностранного языка, Ярославль, 2004
4
unlocked arrived
He (1) ………. home late that night. As he (2) ………..the front door, he (3)…….
he heard a noise in the sitting room. He tiptoed carefully into the room and
(4)….. on the light.
Answers: 1 arrived 2 unlocked 3 thought 4 switched
Using other clues (e.g. pictures, anagrams, first letters, lines indicating how
many letters in word, etc.)
He looked through the …………… and was amazed to see that she had finally come ………..
.(Students have pictures of a window and a house.)
Answers: window, home.
Transformation of a given word
He could produce no ……………. evidence to support his argument, (photograph)
Answer: photographic
Cloze
A cloze test is a gap-fill exercise using a longer text and with a consistent number of words
between gaps (e.g. every ninth word). The word 'cloze' is often incorrectly used to describe any gap-
filling task.
Cloze procedure involves deleting a number of words in the whole text, requiring the test-
takers to restore the original words. The procedure of based on the assumption of gestalt psychology
that human psyche tends to “complete the closures” in the elements of the surrounding world that is
being perceived. This makes the cloze procedure authentic to cognitive processes. The first short
passage of the text is usually left not mutilated. After this brief “lead-in” approximately every seventh
word is deleted. Disadvantages of the test are that some words prove more difficult to restore than
others. There could be more than one answer for any one gap. It is not always easy to say what
language area (grammar, lexis, prepositions etc) or skills (receptive or productive) are actually
measured by the cloze procedure.
Exploratory task:
Do the cloze procedure and comment on the difficulties that you have experienced
The amount of physical education taught in primary schools is decreasing because
of the government's emphasis on the "three R’s", according to a survey. It shows
that half a million hours of …lessons were lost in the past year because more …was
spent on literacy and numeracy. Teachers have warned that more PE time could
be… from September, as schools concentrate more on … numeracy.
Multiple choice
Choose the word or phrase which best completes each sentence.
If I went to Jakarta, ………. buy some jewellery.
a I'll bl c I will dl'd
Answer: d
(Multiple choice is, of course, a very widely used testing technique and can be
used for more than simple gap-filling tests.)
Multiple-choice tests have a “stem” (the basic and unaltered part of the sentence) and a
number of “options” , only one of which is correct. The other options are wrong in the particular
context and are called “distracters”.
The advantages of the multiple-choice test are that they can produce a reliable and
economical scoring. A test can include a fairly long list of items and increase the reliability of
5
procedure, thus decreasing the randomness of the results.
The disadvantages of the multiple-choice test are that it checks only recognition knowledge.
Guessing can have an effect on the scores. The plausible (looking correct) distracters are not always
available and this makes test writers include “fool-proof” distracters. The “correct answer” can in quite
a few cases be questioned.
Exploratory task:
Choose the correct answer of the multiple choice and comment on your difficulties
Why hasn’t your mother come? – A/ can’t
Well, she said she ______________ B/ won’t
leave the baby. C/ couldn’t
D/ wouldn’t
Two-option answers
True/false
Often used after a reading passage e.g. Paul wanted to visit the cattle. True/False?)
Correct/incorrect
Write * if the following sentence is in correct English. If it is incorrect put a X. They always play football
on Sundays.
Answer:
Defined options
Jill is a fifteen-year-old schoolgirl. Mary is a one-year-old baby. Write J next to the things that belong to
Jill. Write M next to the things that belong to Mary. (List of words: teddy, Walkman, calculator, cot.)
Information transfer
Information transfer means that the test-takers have to transfer material from the text on to a
chart, table or map. Such like tasks are sometimes performed in real life settings (arranging
information during a lecture or finding out the details of the train timetable) and therefore can be
viewed as authentic.
Exploratory task:
Do the following information-transfer test and comment on your experience. “You are a road-
safety officer. Listen to the story about a road accident and draw a sketch picture of the situation”
(After Hughes, A. 1996. Testing for Language Teachers. CUP. P. 138)
7
I was riding along the street and a little boy ran into the road from my right. He ran
out from between the two buildings on my right. One building is on the corner. The
next one to it is the Post Office. When the boy ran out, I turned left away from him
and hit one of the parked cars. It was the second car back from the cross road on
the left. It was parked right outside the police station. The policeman heard the
bang and came out at once.
Draw your sketch map here:
Editing tests
Editing tests consist of sentences or text passages, in which errors have been introduced. Test-
takers are to identify the errors and to write out the missing or erroneous elements at the end of each
line. The main difficulty with this type of test is to ensure that an element deemed as erroneous by test
writers should indeed be erroneous with all exceptions excluded.
9
is some evidence that more complex
utterances and longer discourse can be
produced.
(Hughes, A. 1996. Testing for language Teachers. CUP. P. 102)There are three general formats for
testing oral ability:
interview,
interaction with peers
response to an image, written or heard text.
Interviews can be structured and unstructured. Structured interview means having
predetermined questions with limited possible answers. Unstructured interview means that the
questioning is guided by the responses to the previous questions. Interviews can be administered on a
certain topic or cover a wider range of themes. Interaction can be arranged between the two test-
takers discussing a topic, giving explanations or making plans. E.g. “Discuss how you make an
omelet”. “Describe a stapler”. “Explain how to use a public pay-phone”. Candidates can be asked to
assume roles in a particular situation. A protracted exchange between the two candidates can be
stimulated by the following task: “You want your mother to increase your pocket money, but she is
resistant to the idea. Try to make your mother change her mind”. Discussion between the candidates
can also be an important source of information about their language performance. E.g. “Your school
can spend money on either of the items to improve facilities: video equipment, a mini bus, computer
equipment, a sauna, library resources. Discuss with your partner all the advantages and disadvantages
of each suggestion and try to reach agreement on the most suitable decision”.
Response to a picture can take the form of description and comment (a picture is expected to
be either vague in its form and reference, or deep in the message). A response can be given to a text for
reading.
Exploratory task:
A response can be given to a recorded text of the telephone talk. A candidate is to restore what the
other person on the phone is saying. Perform the activity and reflect on the difficulties
Hello. What can I do for you?
___
Hold on a moment. What’s the name of the play?
___
When’s it on exactly?
___
Sorry, to mention it, but in what range are you prepared to pay for the ticket?
___
Well, what night would you like to go?
___
O.K. That’s all right. Hope you will have a nice evening out. Bye.
In order to assess the fluency of oral ability, the following scales can be used: background
knowledge, vocabulary sufficiency, grammar adequacy, message communication, interactive skills,
logic of the utterance, fluency. Grades are given for every scale. Only when examines can be relied
upon to score with consistent accuracy video-recordings, should they be entrusted with “live scoring”
(Hughes, A. 1996. Testing for language Teachers. p.101-115).
10
Testing reading skills
The following operations are necessary to test if the task is to evaluate candidates’ language
performance in reading: scanning the text to locate specific information, skimming the text to obtain
the gist, identifying examples in support of an argument, restoring the sequencing relations between
parts of the text, inferring from the text.
Techniques for testing reading include multiple-choice, sequencing, cloze, information
transfer, comments, drawing conclusions. In the multiple choice tests the candidates give evidence
of successful reading by ticking off one out of a number of alternatives (usually out of three, four or
five alternatives).
True-False questions are just a variety of the multiple choice format. E.g. “Choose the picture
(A, B, C, D), which the following text describes”. In the cloze test the task is to complete the gaps in
the text.
Exploratory task:
Do the following cloze activity and reflect on the problems you had with completing the gaps in the
text. “A man goes out of prison … twenty years. He decides to go … to the neighborhood where
he lived. … he gets there he cannot … the place. Everything has changed a …. The places he
used to … have all disappeared. Even the pub has ….He is very tired and would like to have …
to eat. He goes into a small … and has a coffee and a sandwich. When he takes … his wallet he
finds a … ticket in it. He then remembers that the … thing he had done before being arrested
was to take a … of shoes to the shoemaker's. He … to go there and try. What a wonderful thing!
The shoemaker is still at the … place. He gets into the shop and tells the … that about twenty
years before he … him a pair of shoes to have them …. The shoemaker has a look at the ticket
and …: "O.K. Come back tomorrow. They will be ready then." Some things … change” (Answer
key: after, back, when, recognize, lot, know, moved, something, cafe, out, shoe, last, pair, decides,
old, shoemaker, gave, fixed, says, never).
Information transfer demands on the candidates to supply information from the text in a table,
map, picture etc.
Restoring the sequencing relations between the parts of the text can be done in at least two
ways. Candidates can be given a rambled order of text fragments, which they are expected to rearrange
in the correct sequence. As an alternative, the candidates are given a text and a separate passage. Their
task is to decide where in the text this separate passage belongs.
11
Testing Language Skills
Testing grammar
Testing grammar can be done with multiple choice items, paraphrase (say it differently
using a different beginning of the sentence or a different word), sentence completion, cloze
procedure (e.g. testing the knowledge of prepositions or articles), error correction etc.
Exploratory task :
Read the text below and look carefully into each line. Some of the lines are correct, and some have a
word, which should not be there. If a line is correct, put a tick . If a line has a word that should not
be there, write this word in the right column.
Sentences Tick
or word
a) Last Sunday was definitely not a good day for me.
b) It was all started when I got into my car and it refused to start.
c) I immediately realized that I had left the lights on.
d) I telephoned to my friend and he came round and helped me
start it.
e) I then drove into town to see my brother.
f) I waited for him for an hour despite of the freezing weather
g) There was nothing I could do but drive back home
h) He did not even apologize himself for not waiting for me
(After Paran A. 1996. First Certificate Gold. Practice Exam. Longman. p. 41).
Testing vocabulary
Testing vocabulary is essential to demonstrate linguistic skills. Test tasks can include
synonyms (Choose the alternative ABCD, which is closest in meaning to the given words. E.g.
Gleam: a/shine, b/glitter, c/glare, d/glittering. Answer key: “gleam” has the implication of feeling joy.
That is why “shining” is closest in meaning to it).
Definition task can have a multiple choice format (“Loathe” means a/ to dislike intensely, b/ to
hate the look of, c/ to feel sick at the smell of. Answer key: “to dislike intensely” is the best
definition).
Gap filling or cloze procedure can also be used in testing the vocabulary. Tasks with pictures
can be as follows: Write down the names of the objects that you see in the picture. This technique is
restricted to concrete nouns. Another technique is elicit words from definitions (E.g. … is a person
who performs operations on patients. … is what becomes of boiling water. … is what a coward needs.
Answer key: surgeon, steam, courage).
Exploratory task :
Read the text below and decide which answers ABCD best fit each space
Text Answers
The findings of a 1 … survey showed 1. a/late b/recent c/latest d/fresh
that teenagers do not spend as much 2. a/included b/contained c/counted
money as their parents suspect. The d/numbered
survey 2 … three hundred teenagers 3. a/entire b/all over c/complete d/the
from 3 … Britain. Although they have whole
more cash, worry about debt is 4 … 4. a/gaining b/heightening c/increasing
among the teenagers. The economic d/building
recession seems to have encouraged 5 … 5. a/careful b/suspicious c/reserved
12
attitudes to money. d/cautious
(After Paran A. 1996. First Certificate Gold. Practice Exam. Longman. P.16-17)
Psychological Testing
Psychological testing is sometimes used in teaching English.
The purpose of psychological testing in the communicative language lessons is to boost the
discussion about learners individual characteristics.
Glossary
Achievement tests measure the command of the course studied
Cloze tests offer the test-takers a task to complete the gaps in a coherent discourse
Concurrent validity is coincidence of the testing results with the results obtained by other means
including teacher’s continuous assessment
Consistency is agreement between parts of the text in terms of difficulty and results
Construct validity is the ability of the test to measure what it claims to measure (e.g. a test claiming
the ability to measure speaking performance is not to measure lexical or grammar competence instead)
Contextualization tests offer the test-takers a task to produce an oral or written discourse out of a
graphical form (tables, graphs, charts etc)
Diagnostic tests measure strengths and weaknesses of the test takers
Gap-filling tests offer the test-takers a task to complete the gaps in sentences
Information-transfer tests offer the test-takers a task to transfer information from a text into a
graphical form (tables, graphs, charts etc)
Interactive tests consider the background knowledge and other individual traits of the test-takers
Matching tests offer the test-takers a task to find consistent pairs of language samples (another option
is to find consistent pairs of language and pictures)
Multiple choice tests offer the test-takers a choice of the correct answer out of a number of
“distracters”
Ordering tests offer the test-takers a task to sequence correctly randomized parts of a discourse
Placement tests are used to find the right stage of the curriculum for the learners and to teach them the
adequate language difficulty level
Practicality is convenience of the test as a measuring tool (time saving etc)
Proficiency tests measure general language competence
13
Reliability is permanence of measuring results produced by the same test in different circumstances
(testing speaking and writing is less reliable, than testing reading and listening)
Test is a tool for measuring success of performance or ability to do it
Testing format is the design of a test
14