The meanings and consequences of educational assessments

Critical Quarterly, 2000

1972

2004

Testing and particularly standardized tests are increasingly identified as sources of a host of ills that afflict contemporary education. The ills have been widely catalogued and discussed (Kohn, 2000; Sacks, 1999). Testing and standardization are not, however, in themselves, the causes of these ills; to think so would be an error and a distraction, because the real problem is far deeper and more widespread. It lies in the noneducational uses of tests, an almost universal, unhealthy practice.

Assessment in Education: Principles, Policy & Practice,, 2008

education policy analysis archives, 1996

ABSTRACT We question the utility of traditional conceptualizations of validity and reliability, developed in the context of large scale, external testing, and the psychology of individual differences, for the context of the classroom. We compare traditional views of validity and reliability to alternate frameworks that situate these constructs in teachers' work in classrooms. We describe how we used these frameworks to design an assessment course for preservice teachers, and present data that suggest students in the redesigned course not only saw the course as more valuable in their work as teachers, but developed deeper understandings of validity and reliability than did their counterparts in a traditional tests and measurement course. We close by discussing the implications of these data for the teaching of assessment, and for the use and interpretation of classroom assessment data for purposes of local and state accountability.

We are indebted to too many people to list here for enlightening discussions of topics addressed in this paper. We would like to acknowledge Lyle Bachman, Irwin Kirsch, Mary Schedl, and John Norris with regard to issues in language assessment, and, for their comments on an earlier draft, the editor Mark Wilson and two anonymous referees.

1996

The chapters in this collection contribute to the debate about the value and usefulness of radically different kinds of assessments in the U.S. educational system by considering and expanding on the theoretical underpinnings of reports and speculation.

1991

This paper is intended to raise questions and identify some of the problems posed by assessment within an educational setting. The principal aim is to offer a springboard for discussion, rather than to propose a specific plan of action. It is also worth stressing that assessment designates more than just examinations (public or otherwise). As teachers and educators, we are constantly making assessments of our students, passing official, unofficial, conscious and unconscious judgements. These are judgements which inevitably influence our attitudes to our jobs, our performance and our teaching or administrative styles. They also have wide-ranging repercussions on the attitudes, performances and future of our students. They are judgements based on a complex series of assumptions which we habitually make about, for instance, what education involves, the nature of schooling, school structures and their aims, the learning process as it relates to human development. What follows is largely inspired by a desire to identify and scrutinize some of the most recurrent of these assumptions.

How information about student learning and achievement is collected and reported is at the heart of education reform. The move to standards-based reporting has led to questioning the over-reliance on external examinations in high-stakes situations. This paper discusses the opportunities and challenges that arise when school-based assessment plays a greater role.

Measurement: Interdisciplinary Research & Perspective, 2003

2001). The committee issuing this report was charged with synthesizing advances in the cognitive sciences and measurement, and exploring their implications for improving educational assessment. The article opens with a vision for the future of educational assessment that represents a significant departure from the types of assessments typically available today, and from the ways in which such assessments are most commonly used. This vision is driven by an interpretation of what is both necessary and possible for educational assessment to positively impact student achievement. The argument is made that realizing this vision requires a fundamental rethinking of the foundations and principles guiding assessment design and use. These foundations and principles and their implications are then summarized in the remainder of the article. The argument is made that every assessment, regardless of its purpose, rests on three pillars: (1) a model of how students represent knowledge and develop competence in the subject domain, (2) tasks or situations that allow one to observe students' performance, and (3) interpretation methods for drawing inferences from the performance evidence collected. These three elements-cognition, observation, and interpretation-must be explicitly connected and designed as a coordinated whole. Section II summarizes research and theory on thinking and learning which should serve as the source of the cognition element of the assessment triangle. This large body of research suggests aspects of student achievement that one would want to make inferences about, and the types of observations, or tasks, that will provide evidence to support those inferences. Also described are significant advances in methods of educational measurement that make new approaches to assessment feasible. The argument is presented that measurement models, which are statistical exam-ples of the interpretation element of the assessment triangle, are cuuently available to support the kinds of inferences about student achievement that cognitive science suggests are important to pursue. Section III describes how the contemporary understanding of cognition and methods of measurement jointly provide a set of principles and methods for guiding the processes of assessment design and use. This section explores how the scientific foundations presented in Section II play out in the design of real assessment situations ranging from classroom to large-scale testing contexts. It also considers the role of technology in enhancing assessment design and use. Section IV presents a discussion of the research, development, policy, and practice issues that must be addressed for the field of assessment to move forward and achieve the vision described in Section I.