Picture a group of classroom teachers gathered around a table late one afternoon discussing the results of the statewide writing assessment, the returned scored papers scattered across the table top. This article details research exploring which rhetorical elements are associated with statewide assessment scores and considers the role and…

The emphasis on the power of secure substantive knowledge reflected in recent curriculum reforms has prompted considerable interest in strategies to help students retain and deploy such knowledge effectively. One strategy that has been strongly endorsed by some cognitive psychologists is regular testing; an idea that Nick Dennis set out to test…

Schools are scrambling to prepare students for the writing assessments aligned to the Common Core State Standards. In some states, writing has not been assessed for over a decade. Yet, with the use of computerized grading of the student's writing, many teachers are wondering how to best prepare students for the writing assessments that will…

Boston College saw a 26-percent decrease in applications this year, a drop officials largely attribute to a new essay requirement. Last year the private Jesuit institution received a record 34,051 applications for 2,250 spots in its freshman class. This year approximately 25,000 students applied, and all of them had to do one thing their…

Introductory biology courses are supposed to serve as gateways for many majors, but too often they serve instead as gatekeepers. Reliance on lectures, large classes, and multiple-choice tests results in high drop and failure rates. Critiques of undergraduate science education are clear about the problems with conventional introductory science…

The handyman has a tool for everything, but the admissions dean is not so lucky: He must make do with just a few. Every year, presidents and professors expect freshmen who are curious, determined, and hungry for challenges. The traditional metrics of merit, however, can't reveal such qualities. Standardized-test scores may or may not predict a…

Most automated essay scoring programs use a linear regression model to predict an essay score from several essay features. This article applied a cumulative logit model instead of the linear regression model to automated essay scoring. Comparison of the performances of the linear regression model and the cumulative logit model was performed on a…

Producing analyses that are accurate, timely, and simple is a constant challenge for institutional researchers. The stakes are high: when the analysis is incomplete, arrives too late, does not adequately address the question, or is simply too much to comprehend, decision makers fall back on anecdotal thinking or gut-level reactions that can lead…

A two-semester modified Spanish sequence was designed to address the needs of college students with language-based learning disabilities. This course featured reduced scope, an emphasis on tactile activities, metacognitive strategies, and adaptations to the presentation and practice of material. Performances on fall and spring semester-end essays…

Presents a model-based approach to rater reliability for essays read by multiple raters. The approach is motivated by generalizability theory, and variation of rater severity and rater inconsistency is considered in the presence of between-examinee variations. Illustrates methods with data from standardized educational tests. (Author/SLD)

"Classroom Assessment in Action" clarifies the multi-faceted roles of measurement and assessment and their applications in a classroom setting. Comprehensive in scope, Shermis and Di Vesta explain basic measurement concepts and show students how to interpret the results of standardized tests. From these basic concepts, the authors then…

Three pilot studies--effects of writing prompt modality on writing performance; effect of topic familiarity; and effect of topic, sample and rater group membership on the stability of scoring criteria application--are used to identify the variability in student writing performance. A writing competency test aims to assess writing-specific skills…

An essay test is now an integral part of the computer based Test of English as a Foreign Language (TOEFL-CBT). This paper provides a brief overview of the current TOEFL-CBT essay test, describes the operational procedures for essay scoring, including the Online Scoring Network (OSN) of the Educational Testing Service (ETS), and discusses major…

The North Carolina Writing Assessment, which is part of the state's End-of-Grade testing program, requires students in grades 4 and 7 to write essays in response to a standardized prompt. This report contains results for the Wake County Public School System (WCPSS). Fourth grade writing assessment scores across North Carolina rose in 1999, and in…

This proof-of-concept investigation describes a computer-based approach for deriving the knowledge structure of individuals and of groups from their written essays, and considers the convergent criterion-related validity of the computer-based scores relative to human rater essay scores and multiple-choice test scores. After completing a…