Academia.edu no longer supports Internet Explorer.
To browse Academia.edu and the wider internet faster and more securely, please take a few seconds to upgrade your browser.
2008, Remedial and Special Education
The purpose of this study was to determine whether technically adequate curriculum-based measures of writing could be identified for use with high school students. The participants included 10th-grade general and special education students from two public school districts in Wisconsin. Students ( n = 82) completed two narrative writing samples in response to story starters, and samples were scored for four alternative curriculum-based measures: incorrect word sequences (ICWS), correct punctuation marks (CPM), adverbs (ADV), and adjectives (ADJ). Results revealed moderately strong alternate-form reliability and criterion-related validity coefficients for ICWS. Although CPM was found to be reliable, the criterion-related validity evidence varied according to the type of criterion measure. Other findings indicated that ICWS and CPM cut scores may have utility for specific screening purposes. The curriculum-based measures of ADJ and ADV, however, were not found to have the technical ade...
Reading & Writing Quarterly, 2019
The purpose of this study was to investigate evidence of reliability, criterion validity, and grade-level differences of curriculum-based measures of writing (CBM-W) with 612 students in grades 1-3. Four scoring procedures (words written, words spelled correctly, correct word sequences, and correct minus incorrect word sequences) were used with two CBM-W tasks (picture-word and story prompt) during fall, winter, and spring of one academic year. A subsample of participants (n ¼ 244) were given a criterion measure in spring of the academic year. Pearson's r coefficients were calculated to determine evidence of alternate form reliability and criterion validity, and a MANOVA was used to detect significant growth within and across grade levels. Results indicated that scores on both CBM-W tasks had adequate reliability and validity coefficients in grades 2-3 and mixed results in grade 1. Significant growth was detected within and across all grades at each time point on each task. Implications for research and practice are discussed. Writing is a complex task involving multiple cognitive and linguistic factors and is critical to students' academic and vocational success. Students who struggle with writing during their education typically have fewer postsecondary and employment opportunities (Graham & Perin, 2007). Despite the importance of writing proficiency, U.S. students' writing performance is often unsatisfactory. Nearly 75% of students in fourth, eighth, and twelfth grades were not proficient in writing according to the most recent writing data from the National Assessment of Educational Progress (NAEP; National Center for Education Statistics, 2011). Writing difficulties or disabilities are often not identified until intermediate grades when required writing tasks become more complex (Berninger et al., 2002, 2006); however, converging empirical evidence supports the benefits of early identification and early intervention to students struggling with writing in early elementary grades (McMaster, Kunkel, Shin, Jung, & Lembke, 2018). It is essential to identify students who are struggling with written language early using reliable and valid assessments to prevent or lessen the effect of writing difficulties and disabilities. Conceptual models of writing provide a way to understand what writing entails. The Simple View of Writing is one such framework designed around core lower and higher order skills. Developed by Juel, Griffith, and Gough (1986), the model examined the interaction of two variables, transcription and ideation. Transcription, the lower order skill, was focused on spelling and
Reading & Writing Quarterly, 1999
Curriculum-based measurement (CBM) is gaining popularity as an effective system for evaluating the acquisition of basic academic skills (reading, writing, math, and spelling) within our nation's schools. There is currently a wealth of information available on the psychometric properties of CBM in reading; however, more technical information needs to be gathered on the remaining basic skill areas that CBM purports to assess. This research project reviewed of the relevant literature on the criterionrelated validity of CBM in written expression at the elementary, middle, and high school levels. The results of past research indicate three main findings. First, these measures appropriately differentiate elementary and middle school students according to age, grade, and program placement. Second, the most technically adequate CBM measure of written expression varies considerably across educational levels. Finally, although there is evidence that CBM is technically adequate for elementary and middle school students, greater confidence can be held in CBM measures at the elementary level. Criterion-Related Validity 2
Exceptional …, 2008
The Journal of Special Education, 2011
Curriculum-based measurement (CBM) is an alternative to traditional assessment techniques. Technical work has begun to identify CBM writing indices that are psychometrically sound for monitoring older students' writing proficiency. This study examined the predictive validity of CBM writing indices in a sample of 447 eighth-grade students. Regression analyses revealed that simple fluency measures were not adequate for assessing secondary students' writing. A more complex fluency measure, the number of correct punctuation marks, and an accuracy-based measure, the percentage of correct word sequences, were the best predictors of a written expression test for eighth-grade students. However, overall results of the current study provided only limited support for the use of CBM to assess writing skill at the secondary level.
Journal of writing assessment, 2005
Written Communication, 2019
This study examined multiple measures of written expression as predictors of narrative writing performance for 362 students in grades 4 through 6. Each student wrote a fictional narrative in response to a title prompt that was evaluated using a levels of language framework targeting productivity, accuracy, and complexity at the word, sentence, and discourse levels. Grade-related differences were found for all of the word-level and most of the discourse-level variables examined, but for only one sentence-level variable (punctuation accuracy). The discourse-level variables of text productivity, narrativity, and process use, the sentence-level variables of grammatical correctness and punctuation accuracy, and the word-level variables of spelling/capitalization accuracy, lexical productivity, and handwriting style were significant predictors of narrative quality. Most of the same variables that predicted story quality differentiated good and poor narrative writers, except punctuation accuracy and narrativity, and variables associated with word and sentence complexity also helped distinguish narrative writing ability. The findings imply that a combination of indices from across all levels of language production are most useful for differentiating writers and their writing. The authors suggest researchers and educators consider levels of
Topics in Language Disorders, 2012
Developing writers make qualitative changes in their written products as they progress from scribbling and drawing to conventional, paragraph level writing. As yet, a comprehensive measurement tool does not exist that captures the linguistic and communicative changes (not just emergent spelling) in the early stages of this progression. The Developmental Writing Scale (DWS) for beginning writers was developed as a tool that can capture evidence of refined changes in growth over time. This measure is a 14-point ordinal scale that defines qualitative advances in levels of a learning progression for beginning writing from scribbling to cohesive (linguistically connected) and coherent (on an identifiable topic) paragraph-level writing. The measure can be used with young typically developing children and children with disabilities at all ages who are functioning at beginning levels of writing. Limitations of current writing measures, in contrast to the DWS, are described. The development of the DWS and techniques for using the measure are described with regard to construct and content validity. Preliminary research on reliability of DWS scoring and validity for 5 purposes support usefulness of the DWS for educational and research purposes, including monitoring the progress of beginning writers with significant disabilities.
ELOPE: English Language Overseas Perspectives and Enquiries, 2018
Looking at the issue of validity and test validation, the historical and the theoretical progression has been well described both when it comes to educational assessment in general and language assessment in particular. A clear progression can be seen starting in the 1920s and culminating in the late 1980s/early 1990s (with minor notable developments since), and it is an advancement motivated and driven almost solely by new theoretical and practical considerations. Securing validity and validation with regard to writing assessment in particular, however, took a more winding route and was primarily shaped by a power struggle between externally administered standardized testing (and the supporting administrative bodies) on one side, and the practicing teachers of writing at higher education institutions on the other. The paper at hand outlines this evolution and gives a timeline of the events and major developments that have fueled it and explores the cutting edge of today.
Psychology in the Schools, 2018
Spelling has been identified as a key transcription skill that emerges during the elementary years as students learn how to write and subsequently develop fluency with writing, making the assessment of spelling a critical component of evaluation systems within schools. This includes the use of curriculum-based measures of writing (CBM-W). This study examined the extent to which word dictation CBM-W administered during the Fall, Winter, and Spring of an academic year maintained technical adequacy across 1-min time intervals in grades 1-3. Results revealed moderate predictive and concurrent validity estimates with the Spelling subtest of the Weschler Individual Achievement Test-III. Statistically significant differences existed between and within grade levels across each minute of administration and across Fall, Winter, and Spring time points for all scoring procedures. K E Y W O R D S curriculum-based measurement, spelling, writing 1 | INTRODUCTION Measures of students' writing progress that are technically adequate are a necessary component of evaluation systems within schools to ensure students attain standards of writing proficiency (McMaster & Espin, 2007). These writing measures are equally important to identify students who are at risk or identified with writing disabilities and for informing instruction and intervention. For early elementary writers, measures related to spelling ability have been suggested to be predictive of future writing proficiency (Berninger et al., 2002). Indeed, spelling is a key transcription level skill that emerges during the elementary years as students learn how to write and subsequently
The Journal of Special Education, 2005
Curriculum-based measurement (CBM) is a system of measurement that can be used by teachers to monitor student progress over time and to evaluate the effects of instructional programs (Deno, 1985). Research on CBM at the elementary school level has demonstrated that simple and efficient measures can be used as general indicators of student performance in an academic area (Deno, 1985). For example, in written expression, the number of words written, the number of words spelled correctly, and the number of correct word sequences (i.e., two adjacent correctly spelled words acceptable within the context to a native English speaker) written in 3 minutes all correlate at a moderate to moderately strong level with other measures of students' writing performance. These measures include scores on standardized achievement tests, holistic evaluations of writing, and teacher evaluations of writing ability (see Marston, 1989). Further, when CBM procedures are used by teachers to monitor student progress and evaluate the effects of instructional programs, students achieve more (Fuchs, 1998). Research on CBM has revealed that the measures used at the elementary level are not necessarily reliable and valid and at the secondary level (see Espin & Tindal, 1998). For example, in the area of written expression, simple scoring metrics such as the number of words written and the number of words spelled correctly in a limited time frame (e.g., 3-6 minutes) have not been shown to be valid and reliable indicators of general writing proficiency for secondary students. Instead, somewhat more complex scoring systems involving the use of correct word sequences (CWS) seem to be required (Espin,
BRILL eBooks, 2017
This volume highlights writing development and its relation to other cognitive domains, such as language and reading, for individuals who struggle to acquire writing proficiency, including those with specific learning disorders (sld; e.g., dyslexia, dysgraphia, and specific language impairment) which affect writing skills (e.g., handwriting, composition). Writing and writing development are presented from a trans-national perspective with an integrated focus on conceptualizing writing as a developmental process. This trans-national perspective from across six European nations, Australia and the United States seeks to capture those essentials of instruction and intervention in writing that seem to be cross-cutting rather than language or culture specific, in order to facilitate a cohesive and integrative discussion of issues relevant to the acquisition of writing skills. Focused primarily on struggling writers or individuals with sld, this volume seeks to complement existing resources, such as the Handbook of Writing Research 2nd edition (MacArthur, Graham, & Fitzgerald, 2016) or those focused on improving writing in typically developing students (e.g., Graham & Harris, 2005; Miller, McCardle, & Long, 2014), The authors in this volume primarily target professionals working with developing writers (e.g., educators, speechlanguage pathologists, occupational therapists) and writing researchers, with many of the contributing authors highlighting implementations of specific intervention programs. This volume systematically highlights and links to major writing research domains, with a thematic focus on the development of writing skills in individuals who struggle, complementing the foci of the other recent volumes of the "Studies in Writing" series. As part of the "Studies in Writing" series, this volume extends the focus to be encompassing of struggling writers, who are often overlooked in writing education and research.
International Journal of Academic Research in Business and Social Sciences, 2021
Lower primary students in an international school have always been associated with writing difficulties. This pilot test is intended to assist in following the thread and specifically to assess the effectiveness of the instruments chosen and designed for the actual research, "Writing Skill Challenges Faced by Students in a Lower Primary, International School." Its aim is to assess the instrument's validity and reliability. Through the process of data analysis, two data collection tools, a questionnaire and face-to-face interview questions were statistically and thematically analysed. This pilot study included 15 lower primary students with similar characteristics to the actual samples. The data was then collected and analysed by using the Statistical Package Social Science (SPSS). After the data from the pilot study was entered into SPSS, the data's reliability was calculated and recorded using Cronbach's alpha formula. The findings revealed that all the items were positive, and the content was validated. It showed a very high degree of internal consistency between the given items based on reliability. As a result, no further changes were needed, and these instruments can be used in the actual study without hesitation.
The purpose of the two studies reported in this article was to examine technical features of curriculum-based measures for beginning writers. In Study 1, 50 first graders responded to word copying, sentence copying, and story prompts. In Study 2, 50 additional first graders responded to letter, picture-word, picture-theme, and photo prompts. In both studies, 3-to 5-minute prompts were administered in winter and spring and scored using a variety of quantitative procedures. Students were also administered the Test of Written Language-Third Edition, and teacher ratings and scores on a district rubric for writing were collected. Test-retest (Study 1 only) and alternate-form reliability, criterion validity, and winter-to-spring growth were examined for each measure. Sentence-copying, story, picture-word, and photo prompts emerged as promising beginning-writing measures. Findings have implications for monitoring student progress within a seamless and flexible system across ages and skill levels.
Íkala, Revista de Lenguaje y Cultura
This article discusses the design and validation of a writing assessment system. Two main processes are addressed: validation of the construct and the writing test prompts, and design and validation of scoring instruments. Construct validation included defining and aligning the construct, the standards, and the nature of the assessment tasks. The validation of tasks was determined by analyzing task content against a set of criteria to design appropriate writing tasks and by surveying students' understanding of the prompts. Finally, scoring rubrics were designed based on the standards and the construct. To validate the rubrics, their alignment with the construct and the standards was established, as well as the estimation of their inter-rater reliability (r = > 0,7). Received: 09-03-06 / Accepted: 19-07-06 How to reference this article: Muñoz, A. P.; Mueller, J.; Álvarez, M. E. & Gaviria, S. (2006). Developing a Coherent System for the Assessment of Writing Abilities: Tasks a...
Developed to evaluatesecondary school students' writing fluency skills, this studyis descriptive in nature and uses a mixed method approach. During the research, the researcher attempted to identify students' abilities to write in terms of quantity and complexity, on the one hand, and also attempted to identify findings on accuracy, the organization of ideas, and the obstacles to fluent writing using qualitative data collection tools. The research population consisted of 379 secondary school students in the city center of Hatay, Turkey.Students were given 5 minutes to write, with most texts reaching between 91 and 125 syllabes.
This report presents the findings of a research project funded by and carried out under the auspices of the Graduate Record Examinations Board. ERRATUM First three lines on page 35 should read:
2000
The purpose of this study was to examine technical features of new and existing curriculumbased measures of written expression (CBM-W) in terms of writing task, duration, and scoring procedures. Twenty-five 3 rd -, 43 5 th -, and 55 7 th -graders completed passage copying tasks in 1.5 min and picture, narrative, and expository writing prompts in 3 to 7 min. Samples were scored quantitatively. Measures that yielded sufficient alternate-form reliability were examined to determine which had sufficient criterion validity, and those with sufficient criterion validity were examined to determine which measures detected growth from fall to spring. Different types of measures yielded varying levels of technical adequacy at each grade, with longer durations and more complex scoring procedures generally having stronger technical adequacy for older students. Narrative writing appeared most promising in terms of its technical adequacy across grades. Implications for future research and practice are discussed.
Learning Disabilities Research & Practice, 2012
Early writing interventions can help students develop the writing skills they need to experience positive educational and postsecondary outcomes, but effective intervention requires instructionally relevant assessment data. Shapiro's curriculum-based assessment (CBA) model integrates related yet distinct CBA approaches into a model that informs intervention. Extending this model to early writing poses challenges only recently addressed by research. On the basis of a review of relevant early writing research, this article outlines an instructionally relevant assessment model for early writing. Within the proposed model, the instructional hierarchy is suggested to directly connect early writing assessment with intervention. A discussion of potential limitations as well as future directions for research is included. Students who successfully develop writing skills have a greater likelihood of experiencing positive outcomes throughout school and beyond. Writing is critical to overall literacy development and is associated with contentarea learning (Bangert-Drowns, Hurley, & Wilkinson, 2004). Writing is also crucial for postsecondary success because it is frequently used in making college entrance decisions as well as employment and promotion decisions (National Commission on Writing, 2004, 2005). Unfortunately, many students struggle with writing. In a recent national assessment, up to two-thirds of students did not acquire proficient writing skills (Salahu-Din, Persky, & Miller, 2008), and surveys show writing is the second most referred problem area in schools after reading (Bramlett, Murphy, Johnson, & Wallingsford, 2002). Moreover, students who are already struggling in school, such as those with learning disabilities, may be at greater risk for writing difficulties. Students with learning disabilities often create written products that contain fewer ideas, are more poorly organized, and are of lesser quality than their nondisabled peers (Graham & Harris, 2002). Early intervention can optimize writing development for young and at-risk writers, minimizing the number of students who would subsequently develop more severe writing difficulties (Graham, Harris, & Larsen, 2001; Leinemann, Graham, Leader-Janssen, & Reid, 2006). Early intervention could occur as early as kindergarten and first grade (Graham et al., 2001); however, successful early intervention requires instructionally relevant assessment. Shapiro's (2004) Requests for reprints should be sent to David C. Parker, University of Minnesota. Electronic inquiries should be sent to
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.