The ACT National Curriculum Survey is a one-of-a-kind nationwide survey of educational practices and expectations conducted by ACT every 3 to 5 years. ACT surveys thousands of middle school/junior high school, secondary, and postsecondary teachers in English/writing, reading (including English language arts and social studies teachers),…

This paper undertakes a review of the literature on writing cognition, writing instruction, and writing assessment with the goal of developing a framework and competency model for a new approach to writing assessment. The model developed is part of the Cognitively Based Assessments of, for, and as Learning (CBAL) initiative, an ongoing research…

This paper presents the Final Report on the Audio-Digital MCAS Pilot Program. The Department and Recording For the Blind & Dyslexic (RFB&D) have collaborated to provide audio-digital read-aloud editions of the Grade 10 English Language Arts and Mathematics MCAS tests for a small number of students with disabilities such as dyslexia and/or…

Two major obstacles to using problem-based learning methods with writing in elementary school classrooms are the time it takes to design the learning environment and the time required for students to interact at their own pace with ill-structured problems used to spur student writing. This study examined whether game elements could be used along…

Building on the work of an earlier article ["The Word Writing CAFE: Assessing Student Writing for Complexity, Accuracy, and Fluency," Dorothy J. Leal, "Reading Teacher," 59 (4) Dec 2005 (EJ738016)], these authors investigated the use of a simple assessment tool with a different audience to yield similar useful results. (Contains 3 figures and 4…

The use of online rater self-training is growing in popularity and has obvious practical benefits, facilitating access to training materials and rating samples and allowing raters to reorient themselves to the rating scale and self monitor their behaviour at their own convenience. However there has thus far been little research into rater…

This research aimed to investigate the effect of computers on the test and inter-rater reliability of writing test scores of ESL learners. Writing samples of 20 pen-paper and 20 computer group students were scored in analytic scoring method by two scorers, and then the scores were analyzed in Alpha (Cronbach) model. The results showed that the…

States are increasingly turning to standardized testing to hold colleges accountable for student outcomes. Currently, about half of the states require public colleges to conduct some type of assessment or accountability measure. Assessments generally fall into two categories: high-stakes tests, which may affect the progress of individual students,…

Behaviorally Anchored Rating Scales (BARS) were developed to score responses from a previously designed police written communication test that lacked reliability. Rating scales for each of the 9 dimensions of the test consisted of the scale definition and a 5-point continuum, with the scores of 5, 3, and 1 defined by specified behavioral…

The New Jersey High School Proficiency Test for grade 11 (HSPT11) replaced a similar requirement for grade 9 and became a graduation requirement in October 1993. As in the past, the writing test consists of a writing sample, which assesses student abilities to write sustained discourse, and a multiple-choice portion that assesses how well students…

This handbook is one of a series developed by the Texas Education Agency in response to requests to provide schools with additional information concerning the written composition portion of the Texas Assessment of Academic Skills (TAAS). The handbook focuses on exit level grades 9 through 12. Following an introduction, the handbook is in two…

The purpose of this study was to examine rater, domain, and gender influences on the assessed quality of student writing using weighted and unweighted scores. Twenty rates were randomly selected from a group of 87 operational raters contracted to rate essays as part of the 1993 field test of the Georgia High School Writing Test. All of the raters…

The purpose of this study was to describe the Rasch model for measurement and apply the model to examine the relationship between raters, domains of written compositions, and student writing ability. Twenty raters were randomly selected from a group of 87 operational raters contracted to rate essays as part of the 1993 field test of the Georgia…

Setting performance standards on constructed-response assessments involving polytomously scored exercises presents a challenge for measurement practitioners. Some standard setting methods designed for use with multiple-choice, dichotomously scored assessments entail aggregating item performance estimates across a panel of experts. For these items,…

The objectives of this study were to determine whether student writing portfolios could be rated reliably by trained judges; study the effects on student ratings of the differential leniency of the judges; and ascertain the effects of writing-prompt difficulty and its interactions with rater leniency. Writing samples from 127 students in grades 3,…