ChatGPT, a sophisticated online chatbot, sent shockwaves through many sectors once reports filtered through that it could pass exams. In higher education, it has raised many questions about the authenticity of assessment and challenges in detecting plagiarism. Amongst the resulting frenetic hubbub, hints of potential opportunities in how ChatGPT…

Many large-scale performance assessments include score resolution procedures for resolving discrepancies in rater judgments. The goal of score resolution is conceptually similar to person fit analyses: To identify students for whom observed scores may not accurately reflect their achievement. Previously, researchers have observed that…

In 2016, with mounting pressure from parents, educators, and other stakeholders around the state pushing back against the volume of standardized tests students are required to take, the Texas Education Agency introduced the Texas Writing Pilot. This pilot was designed to study the feasibility of creating an alternative writing assessment that…

As a language skill, writing has had, still has and will continue to have an important role in shaping the scientific structure of human life in that it is the medium through which scientific content is stored, retained, and transmitted. It has therefore been a major concern for writing teachers and researchers to find a reliable method for…

Background: Many in education argue for the importance of incorporating teacher judgements in the assessment and reporting of student performance. Advocates of such an approach are cognisant, though, that obtaining a satisfactory level of consistency in teacher judgements poses a challenge. Purpose: This study investigates the extent to which the…

This review of current writing assessment practices focuses upon the adult population, an area significantly underrepresented within psychoeducational literature. As compared to other populations, such as K-12 students, there are few options for the practitioner wishing to evaluate adult writers by means of standardized assessment instruments.…

Portfolios have gained great popularity as a method of process-oriented writing assessment in the last 20 years. Despite the apparent advantages, as with other new methods of assessment, they still raise many controversies, particularly those regarding the validity of their contents and assessment. This article describes the first stages in the…

Teachers are smart people, so why does marking reduce them to stressed and soulless messes? Because in their hearts they know that students do not learn from it, and that drives them nuts. Researchers like Lorna Earl and Dylan Wiliam have looked closely at marking systems and have proven what teachers already know deep down: marking student work…

In a FIPSE-funded assessment project, a group of diverse institutions collaborated on developing a common, course-embedded approach to assessing student writing in our first-year writing programs. The results of this assessment project, the processes we developed to assess authentic student writing, and individual institutional perspectives are…

As standardized tests increase in importance but remain fundamentally unchanged, they will guarantee the continued narrowing of instruction (as teachers concentrate on preparing students to pass them). Short-answer questions keep the focus on isolated fragments of learning. Writing samples are treated as formulaic exercises. Today's schools sorely…

Describes a composition teacher's efforts to diagnose her vocational college students' literacy skills by using a more authentic performance assessment that integrates reading and writing. (SR)

This paper presents a model of scored cognition that incorporates two types of mental models: models of performance (i.e., the criteria for judging performance) and models of scoring (i.e., the procedural scripts for scoring an essay). In Study 1, six novice and five experienced scorers wrote definitions of three levels of a 6-point holistic…

The paper examines an assessment method for measuring students' writing performance. Does Primary Trait Scoring reliably and validly accomplish the administrative, instructional, and evaluative purposes of the writing assessment? The Primary Trait Scoring guide has a few underlying principles: identification of qualities of effective writing;…

Describes the addition of a writing performance assessment to the Graduate Management Admission Test (GMAT), and how development of the Analysis of Argument measure and the Persuasive Adaptiveness measure helps explain the holistic writing score given during grading of the GMAT. Correlates holistic and analytic scores, revealing a positive…

In 1990 the Kentucky legislature passed the Kentucky Education Reform Act (KERA). The law mandates the use of performance-based assessments, including portfolios in mathematics and writing. This paper presents findings of a case study of a fourth-grade classroom teacher's experiences in implementing instructional changes to help students produce…