Testing
Testing
● It is practical in terms and but not always scientific in nature. It evaluates a) Rational Deletion - This method focuses on deleting words that are
the real life communication of a learner. crucial for understanding the text, such as key vocabulary, grammatical
● Pragmatic Tests are of two types - structures, or words that are difficult to guess. This approach is designed
i) Cloze Test to be more challenging for learners because the deleted words are more
● This is a technique used to measure reading comprehension and general difficult to predict. Its purpose is to assess specific language skills, such
language ability. This is originated to assess the difficulty level of reading as understanding vocabulary, grammar, or discourse coherence. It is done
passages for the native speakers. The cloze test is derived from the by deleting words based on their significance in the text. It can be More
‘gestalt theory’. Though it looks like an objective test, that is not true. It challenging and may be more indicative of the learner's language
cannot create any answer key. Under this type, two types of scoring proficiency. However it can be more complex to create and score.
procedure are used; the exact word method and the appropriate or b) Fixed - Ratio Deletion - This involves deleting words at regular
acceptable word method. intervals, such as every 5th, 7th, or 8th word. This method is simple to
● A cloze test, also alternately referred to as cloze procedure, consists of a apply and is often used in Cloze tests. It is used to assess general reading
set of techniques for measuring, for example, reading comprehension. In comprehension and vocabulary. It deletes words at regular intervals. It is
a cloze test words are removed from a reading passage at regular simple to create and score. However it may not adequately assess the
intervals, leaving blanks. For example every fifth word may be removed difficulty of understanding the specific context or grammatical structures.
● The cloze test can also be used to judge the difficulty of reading
materials. If the cloze procedure is being used for language testing, the 8. Merits & Demerits of Objective Tests
test-taker is given a score according to how well the words guessed match
the original words, or whether or not they make sense ❖Merits
● Evaluates candidate’s understanding of the subject and its concepts 10. Merits & Demerits of MCQs
● Understand the thinking and problem-solving ability of the candidate
● Evaluate how each candidate approach the same question and select the ❖Merits
one with the best approach
● Evaluates the writing and communicating ability of the candidate ● Quick and easy to score, by hand or electronically
● Easily prepared and compiled. ● Can be written so that they test a wide range of higher-order thinking
● Did not give many opportunities to speculate or chancy. skills
● Encourage students to dare to express opinions and to develop in the form ● Can cover lots of content areas on a single exam and still be answered in
of good sentences. a class period
● Provide opportunities for learners to express his point by style and his ● MCQs are straightforward for students to answer and are suitable for
own way. various learning levels, including beginning learners.
● MCQs can be designed to test specific language skills like grammar,
vocabulary, or comprehension. ❖Merits
● When carefully designed with plausible but incorrect answer options
(distracters), MCQs can minimize the chance of guessing and encourage ● Quick and easy to score
students to think critically ● Used to measure ability to identify whether statements of facts,
● versatility in measuring all levels of cognitive ability. principles, generalizations, relationships, or evaluative statements are
● Highly reliable test scores. ... scoring efficiency and accuracy. correct
● Objective measurement of student achievement or ability. ● Can be factual or can be a thought question that requires reasoning
● A wide sampling of content or objectives. ● Can be used in most disciplines
● A reduced guessing factor when compared to true-false items. ● Used to quickly poll a class as an introduction to a discussion or
● Different response alternatives which can provide diagnostic feedback. determine knowledge of topic
● True-false items are especially useful for questions where there are only
❖Demerits two reasonable answers.
● True-false items are especially useful in testing misconceptions.
● Often test literacy skills: “if the student reads the question carefully, the ● True-false items can be expressed in a few words, making them easy to
answer is easy to recognize even if the student knows little about the understand and less dependent on reading ability.
subject” ● the widest sampling of content or objectives per unit of testing time.
● Provide unprepared students the opportunity to guess, and with guesses ● scoring efficiency and accuracy.
that are right, they get credit for things they don’t know ● versatility in measuring all levels of cognitive ability.
● Expose students to misinformation that can influence subsequent thinking ● highly reliable test scores.
about the content ● an objective measurement of student achievement or ability.
● Creating effective MCQs with good distractors requires considerable time
and skill, and poorly designed questions can be confusing or misleading ❖Demerits
● MCQs may not fully assess deeper understanding, critical thinking, or
creativity. ● Considered to be one of the most undependable forms of evaluation
● MCQs often focus on recall of facts rather than application of knowledge ● Often written so that most of the statement is true save one small, often
or higher-order thinking skills trivial bit of information that then makes the whole statement untrue
● Unprepared students may have a chance to guess the correct answer, even ● True-false items are especially subject to guessing. Half the items would
without understanding the material. be expected to be correct by chance. (But the likelihood of obtaining a
● MCQs primarily focus on reading and listening comprehension, and don't substantially higher score by guessing alone is very small).
directly assess writing or speaking abilities. ● In general, individual true-false items are less discriminating than
● Are difficult and time consuming to construct. individual multiple-choice items.
● Lead an instructor to favor simple recall of facts. ● There is a tendency to write trivial true-false items, which lead students to
● Place a high degree of dependence on the student's reading ability and verbatim memorization.
instructor's writing ability. ● No diagnostic information is available from incorrect responses to
true-false items.
11. Merits and Demerits of True and False Questions/ Yes or No Questions
● True-false items are not amenable to questions that cannot be formulated ● Solving rearrangement questions can be time-consuming, especially for
as propositions complex or lengthy passages.
● incorporate an extremely high guessing factor. For simple true-false ● May not fully capture the complexities of natural language.
items, each student has a 50/50 chance of correctly answering the item ● Some students may find rearrangement questions difficult or prefer other
without any knowledge of the item's content. methods of language assessment.
● Can often lead an instructor to write ambiguous statements due to the
difficulty of writing statements which are unequivocally true or false. 13. Merits and Demerits of Match the Following
● Do not discriminate between students of varying ability as well as other
item types. ❖Merits
● Can often include more irrelevant clues than do other item types.
● Can often lead an instructor to favor testing of trivial knowledge. ● Matching questions are quick and easy to mark, saving teachers time.
● They can provide a more objective assessment of knowledge, as there are
12. Merits & Demerits of Re-arrangement/ Transformation predetermined correct answers, reducing subjectivity in scoring.
● They allow for the assessment of multiple concepts or relationships
❖Merits within a single question, making them useful for covering a broad range
of material.
● Sort of controlled writing ● They can add some variety to assessments, keeping students engaged.
● Develop student’s awareness of sentence and paragraph structures ● They can be used to test vocabulary, grammar, and even higher-order
● Rearranging sentences requires students to analyze the relationship thinking skills like analysis and application
between words, phrases, and clauses, enhancing their understanding of ● Learners with poor vocabulary, poor grammar, poor handwriting, poor
grammatical rules and sentence construction. spelling are also able to make a reply
● Students must identify logical connections and relationships between ● Validity and reliability is higher than essay type of questions
sentences to create a coherent passage, fostering their critical thinking
and problem-solving abilities ❖Demerits
● evaluate a student's ability to understand the flow of ideas and create a
readable and logical text. ● Students can sometimes answer correctly by guessing or using
● While not true writing, rearrangement questions can be a controlled way elimination, rather than understanding the underlying concepts
to practice writing skills and sentence construction. ● If not carefully crafted, matching questions can encourage rote
● Require students to analyze and apply their knowledge of language, memorization rather than deeper understanding
rather than just recall memorized facts. ● Creating effective matching questions that assess higher-order thinking
skills can be more challenging than multiple-choice questions.
❖Demerits ● They are primarily suited for assessing recognition and recall, and may
not fully assess complex learning or higher-order thinking skills.
● Gives a chance of guessing ● The nature of matching questions can allow students to use clues from
● Limits student’s creativity other questions to answer correctly, even if they don't fully understand the
● Students can fail if they place even one word incorrectly, which can be concept
frustrating and demotivating.
● Since there are many choices elimination other possible answers is harder ● Essays cannot measure a large amount of content or objectives.
than compared to MCQs ● Essays generally provide low test and test scorer reliability. If a test is
● have difficulty measuring learning objectives requiring more than simple given on more than one occasion, the inherent plasticity of scope, content
recall of information. & style of the essay makes it unlikely that the students will perform
● Are difficult to construct due to the problem of selecting a common set of exactly the same way as on the previous occasion. Hence they may not
stimuli and responses. provide a good assessment
● They require an extensive amount of instructor's time to read and grade.
14. Merits & Demerits of Essay type questions ● Essays generally do not provide an objective measure of student
achievement or ability (subject to bias on the part of the grader). This is
❖Merits because of variability in assessment by different examiners. The
unlimited scope of the essay leaves considerable room for subjective
● Essay items are easier and less time consuming to construct than are most judgement.
other item types. ● Encourage use of subjective criteria when assessing answers
● Essays provide a means for testing a student's ability to compose an ● If used in class, necessitate quick composition without time for planning
answer and present it in a logical manner. or revision, which can result in poor-quality writing
● Essays can efficiently measure higher order cognitive objectives (e.g., ● The material being measured is too little, so it is difficult to measure
analysis, synthesis, evaluation). students' mastery of the whole curriculum.
● Essays facilitate language development ● It's hard to get questions that have national and international standards.
● Offer students an opportunity to demonstrate knowledge, skills, and ● Essays have less validity because of large size of response and under/over
abilities in a variety of ways sampling of domain
● Can be used to develop student writing skills, particularly the ability to ● Essay questions are often framed in an non- descript phrase giving no
formulate arguments supported with reasoning and evidence idea to the student about the scope of answer expected.
● Learners can organize the answers to their opinion.
● Students cannot guess the answers to the questions. 15. Why are Essays considered as both objective & subjective types?
● This test is suitable for measuring and evaluating the results of a learning
process that is complex or difficult to quantify by using an objective test. Essays incorporate both objective and subjective elements. They aim to present
● The degree of accuracy and reliability of students can be seen from the factual information and analysis (objective), while also allowing for personal
sentences. interpretation and opinion (subjective). While essays often involve some degree
● Answers are disclosed in the words and sentences, so the test can be used of personal perspective, they should also be grounded in evidence and reasoned
to train the preparation of the sentence with good language, right, and arguments to maintain a level of objectivity.
quickly.
● This test is used to train the learners to choose the facts relevant to the Essays often require the presentation of verifiable facts, historical information,
issue, and organizing it is hard to accurately assess so as to reveal the scientific data, or evidence from research. This factual basis forms the
result of thinking that is integrated as a whole. foundation for the essay's analysis and arguments. Essays also involve the
writer's interpretation of the facts, their personal perspectives on the topic, and
❖Demerits their opinions on the arguments presented. This subjective element allows for
the exploration of different viewpoints and the development of a unique ● Communicative competence is a term coined by D.H. Hymes (1972) to
argument. contrast Chomsky’s theory of competence.
● Communicative competence is a learner's competence using language
A well-written essay balances the objective and subjective. It presents facts and appropriately in a certain social context. To Achieve this aim, language
evidence while simultaneously allowing for the writer's individual perspective learners must have integrative knowledge in three components such as
to be expressed. Example - In a research essay, the writer might present linguistic form, meanings, and forms.
objective facts about a historical event while also offering their subjective ● Communicative competence refers to the knowledge possessed by the
interpretation of its significance. In an opinion essay, the writer might present language user, not only of the formal code, but the social implication of
objective data to support their viewpoint while also expressing their personal linguistics choice
opinions on the topic. ● Communicative competence also includes the ability of the speaker to
choose linguistic forms and this choice depends on the participants and
16. Different types of Competences speech event.
● Communicative competence doesn’t only represent the grammatical
a) Linguistic Competence competence but also the sociolinguistic competence
● Knowledge of the grammar, vocabulary and phonology of the language. c) Discourse Competence
● It's not just about memorizing rules; it's about a speaker's ability to
understand and use language creatively and effectively. This includes ● Discourse Competence, which means the ability to construct and maintain
knowledge of phonetics (sounds), phonology (sound patterns), in negotiation, properly coherent talk and text.
morphology (word formation), syntax (sentence structure), and semantics ● Discourses competence concerns mastery of how to combine grammatical
(meaning). forms and meanings to achieve a unified spoken or written text.
● Chomsky focuses solely on linguistic competence that allows native ● This competence involves the ability to interpret a series of sentences or
speakers of a language to create well-formed sentence structures. utterances in order to form a meaningful whole and to achieve unity of
However, linguistic competence cannot be seen as the only goal of text which area relevant to a given situation
language learning since the process of communication goes beyond ● This is concerned with organizational features of spoken and written texts
the mere knowledge of creating well-structured sentences (of any kind). There are two elements in this competence: cohesion and
● Linguistic competence means the system of rules that govern an coherence. Unity of a text is achieved through cohesion in form and
individual’s understanding of what is acceptable and what is not in the coherence in meaning. Cohesion deals with how utterances are linked
language. Operationally, it is the level of competence displayed by structurally and facilitates interpretation of a text.
students and teachers based on the adapted linguistic competence test for ● Discourse competence tends to the ability of the language user in
students and teachers, respectively composing a discourse cohesively and coherently. Cohesively means that
● While grammar is a crucial part of linguistic competence, it's also the idea or courses delivered in written or orally should be structurally
important to consider how language is used in different contexts. using appropriate cohesive devices while coherently means that the idea
or courses delivered should reflected the mind setting so the idea or
b) Communicative Competence courses delivered are easy to be understood
● The type of competence concerns mastery of how to combine
grammatical form and meanings to achieve a unified spoken or written
text in different genres. By genre is the type of text (e.g., oral or written, ● This competence is composed of mastery of verbal and non-verbal
narrative, an argumentative, essay, a scientific report, a business letter, communication strategies that may be called into action to : 1)
and a set of instructions each presenting a different genre). compensate for communication breakdown due to limiting conditions in
actual communication., and 2) enhance the effectiveness of
d) Sociolinguistic Competence communication (e.g., deliberately slow and soft speech for rhetorical
effect.)
● Is involved in decisions about appropriacy of language to context ● Strategic competence is an ability related to the use of verbal or
● This is concerned with rules of use, including the probability of ‘whether non-verbal communication strategy in communicating caused by
(and to what degree) something is in fact done’ language knowledge limitation or other performance disruption such
● It is addresses the extent to which utterances are produced and understood as lack of vocabulary, grammatical errors, incomplete utterances, etc.\
appropriately in different sociolinguistic contexts depending on
contextual factors such as status of participants, purposes of the 17. Merits & Demerits of Translation Questions
interaction, and norms or conventions of interaction
● Sociolinguistic competence is the native speaker’s ability in adapting the ❖Merits
language use with the social environment where the language is used
● Sociolinguistic competence relates to the appropriateness in the social ● Translation exercises highlight differences in sentence structure and word
context that the language rules will useless if the language user usage between languages, enhancing grammatical knowledge.
ignores all the grammatical rules ● Students encounter and learn new words and phrases through the
● Sociolinguistic Competence is an interdisciplinary field of inquiry having translation process.
to do with the social rules of language use ● Focusing on accuracy and clarity in translation strengthens reading
● This competence requires an understanding of the social context in which comprehension and writing abilities.
language is used. The context depends on some factors such as status of ● By translating, students can solidify their understanding of grammatical
participants, information they share, purposes of interaction, and norms or rules and vocabulary.
conventions of interaction. ● These questions can be readily prepared and used in various classroom
● This competence addresses the extent to which utterances are produced settings.
and understood appropriately in different sociolinguistic contexts ● Translation exercises can help students grasp the meaning of unfamiliar
depending on contextual factors such as status of participants (age, sex, words and phrases in the target language by relating them to their native
education, role, familiarity) and norms/conventions of interaction. language.
● Translation can reveal the grammatical structures of the target language
e) Strategic Competence and how they differ from the native language.
● Students can learn by comparing the structure and vocabulary of the
● Strategic Competence, which involves in decisions about how to repair target language with their native language.
breakdowns that occur in communication, or to enhance the message. ● Translation exercises can introduce new words and expressions,
● Strategic competence refers to the mastery of verbal and non-verbal expanding students' vocabulary.
communication strategies that may be used to compensate for breaks ● Translation can be used as a quick and easy way to assess students'
downs in communications because of limiting conditions in actual understanding of new concepts and material.
communication and to enhance the effectiveness of communication.
❖Demerits
● Interviewers may unconsciously exhibit biases, leading to unfair or
● The focus on translation can overshadow the development of spoken inaccurate evaluations of the interviewees.
language skills. ● Interviews require careful planning and preparation from both the
● Translation-based methods may not effectively promote conversational interviewer and the interviewee, including creating questions, setting up
skills. the environment, and organizing the interview.
● Depending on the specific approach, teacher preparation can be ● The pressure of being evaluated in a spoken setting can be stressful for
substantial. learners, potentially affecting their performance and confidence.
● Students might rely on memorizing rules and translations without truly ● While interviews allow for some flexibility in language use, there is still a
understanding them. risk of learners making errors in grammar, vocabulary, or pronunciation.
● Translations may not accurately represent how language is used in ● The effectiveness of the interview depends greatly upon the skill of the
real-life situations. interviewer which everyone do not ordinarily possess. It takes time to
● Over-reliance on translation can hinder the development of fluency and master this skill.
the ability to use the target language naturally in real-life conversations. ● There is a constant danger of subjectivity on the part of the interviewer.
● Translation exercises often focus on reading and writing skills, neglecting ● An interview is very difficult to employ successfully because even in the
oral and aural practice. presence of a skilled interviewer some interviewees do tat respond freely,
● Translation can lead to an overemphasis on memorizing grammatical frankly and accurately.
rules without understanding their contextual application. ● Since memory and retention are highly selective processes, interviewees
● Translation tests can be time-consuming to administer and grade. generally provide accurate and vivid accounts of the most recent or
● Translation tests may not allow students to express themselves creatively intense experiences, or of situations that they encounter most frequently.
or use the language spontaneously. Painful or embarrassing experiences are forgotten or consciously avoided
by the interviewees. In such cases the responses lack accuracy.
18. Merits & Demerits of Interview
❖Merits
❖Demerits