Multidimensional scoring evaluates each constructed-response answer from more than one rating dimension and/or trait such as lexicon, organization, and supporting ideas instead of only one holistic score, to help students distinguish between various dimensions of writing quality. In this work, we present a bilevel learning model for combining two…

Many large-scale performance assessments include score resolution procedures for resolving discrepancies in rater judgments. The goal of score resolution is conceptually similar to person fit analyses: To identify students for whom observed scores may not accurately reflect their achievement. Previously, researchers have observed that…

The purpose of this study is to explore the reliability of a potentially more practical approach to direct writing assessment in the context of ESL writing. Traditional rubric rating (RR) is a common yet resource-intensive evaluation practice when performed reliably. This study compared the traditional rubric model of ESL writing assessment and…

This study compared gender groups on the processes used in writing essays in an online assessment. Middle-school students from four grades responded to essays in two persuasive subgenres, argumentation and policy recommendation. Writing processes were inferred from four indicators extracted from students' keystroke logs. In comparison to males, on…

Mokken scale analysis (MSA) is a probabilistic-nonparametric approach to item response theory (IRT) that can be used to evaluate fundamental measurement properties with less strict assumptions than parametric IRT models. This instructional module provides an introduction to MSA as a probabilistic-nonparametric framework in which to explore…

Historically, research focusing on rater characteristics and rating contexts that enable the assignment of accurate ratings and research focusing on statistical indicators of accurate ratings has been conducted by separate communities of researchers. This study demonstrates how existing latent trait modeling procedures can identify groups of…

Scoring systems for direct writing assessment are described. In holistic scoring, a global quality judgment of the writing sample is made. Primary trait scoring, developed by the National Assessment of Educational Progress, is conducted in accordance with specific goals. Analytic scoring identifies characteristics and quality of writing. These…

The Connecticut Assessment of Educational Progress assesses writing traits using different approaches to diagnose students' skills. These include multiple choice, direct assessment, "revising test," dictation, and note-taking. These measures and scoring guides are used to assess several elements of good writing. (DWH)

The history of direct writing assessment and scoring procedures in South Carolina are discussed. The South Carolina Basic Skills Assessment Program Writing Committee developed writing objectives for students. Holistic and analytic scoring procedures were used. Information on instructional improvement and student deficiencies was distributed to…

A summary of the writing assessment programs reviewed in this journal is presented. The problems inherent in the programs are outlined. A coordinated research program on major problems in writing assessment is proposed as being beneficial and cost-effective. (DWH)

This review, with profiles of 51 available writing/language usage tests from most major test publishing companies, provides technical information on the tests, the evolution of test characteristics, the tests' role as writing samples, and issues in psychometric quality. Published objective writing tests are changing in important and positive ways.…

The writing assessment program in the Cherry Creek, Colorado, schools is described. Writing assessments for students in grades three, six, eight, and 10 have been developed. A holistic approach is used by teachers in scoring these instruments. Improvement of students' essay-writing ability indicates the value of the assessment program. (DWH)

The accuracy issues involved in detecting student writing skill deficiencies, factors to be dealt with or controlled, and procedural and statistical methods for controlling these factors are the focus of this article. The accuracy needed for effective instructional planning requires stability in writing assessment programs. (DWH)

Texas Assessment of Basic Skills tests are criterion-referenced measures administered to students in grades 3, 5, and 9. Written compositions are part of the test battery and are scored holistically. The Texas approach to measuring written composition consists of elements including magnitude, scoring system, and effect on instruction. (DWH)

The Maryland Functional Writing Program is designed to increase student performance in writing through improved instructional and assessment procedures. The Declared Competencies Index lists two writing goals supported by 39 objectives. A combination of direct and indirect writing assessment is used. (DWH)