Background: Automated writing evaluation (AWE) systems, used as formative assessment tools in writing classrooms, are promising for enhancing instruction and improving student performance. Although meta-analytic evidence supports AWE's effectiveness in various contexts, research on its effectiveness in the U.S. K-12 setting has lagged behind its…

Background/purpose: Writing is an essential skill for EFL learners, and the development of flawless writing proficiency in English is the intended learner outcome of every writing course in an EFL program. Development of flawless writing skills involves perfection in orthography (spelling, punctuation, capitalization), grammaticality and syntax,…

The purpose of this study was to examine the technical features of slopes produced from the curriculum-based measurement in writing (CBM-W) word dictation task. Seventy-nine elementary students in the U.S. Midwest with intensive learning needs responded to weekly word dictation probes across 20 weeks; responses were scored for correct letter…

In 2016, with mounting pressure from parents, educators, and other stakeholders around the state pushing back against the volume of standardized tests students are required to take, the Texas Education Agency introduced the Texas Writing Pilot. This pilot was designed to study the feasibility of creating an alternative writing assessment that…

The purpose of this paper is (1) to report on the design of the early writing observational writing rubric designed to observe and describe change over time in the writing of children emerging into conventional literacy (ages 6-7) within an instructional setting and (2) to investigate the initial reliability and validity of the rubric. We used an…

Written communication is considered one of the most critical competencies for academic and career success, as evident in surveys of stakeholders from higher education and the workforce. Emphasis on writing skills suggests the need for next-generation assessments of writing proficiency to inform curricular and instructional improvement. This…

Many national reports indicate that more attention needs to be placed on writing and the teaching of writing in schools. The purpose of this quantitative study was to, first, examine the structure of the DWA and, second, to use the scores from the DWA to examine the relationship between ELL status and writing proficiency. Five major research…

The authors explored the credibility of using informal reading inventories and writing samples for 138 students (K-4) to evaluate the effectiveness of a summer literacy program. Running Records (a measure of a child's reading level) and teacher experience during daily reading instruction were used to estimate the reliability of the more formal…

Points out the difficulty in judging a student's writing ability on the basis of one piece of writing. Suggests alternative evaluation procedures. (EL)

To compare the relative reliable uses and cost effectiveness of the analytic, the holistic, and the primary trait scoring methods, an inquiry was conducted in which a group of raters scored a large number of secondary school students' essays according to each of the scoring methods. Raters were nine graduate students in English who were trained in…

A pilot study was conducted to evaluate and improve the rating procedure proposed for use in a research effort designed to assess the essay writing ability of college sophomores. Generalizability theory and the Many-Facet Rasch Model were each used to (a) estimate potential sources of error in the rating, (b) to obtain reliability estimates, and…

Based on the premise that composition skills and their evaluation are crucial to the educational process, this paper presents a tentative research program for conducting future English as a second language (ESL) composition evaluation studies. The program developed in the paper covers the following topics as areas which merit further rigorous…

Standardized tests of writing ability have individual and shared limitations and deficiencies that should be acknowledged by test designers and users. Most institutions use the portions of standardized tests that test ability to proofread and edit, but they do not use the optional essay sections that actually require students to write. To assure…