This scope-review presents the milestones of how Hierarchical Rater Models (HRMs) become operable to used in automated essay scoring (AES) to improve instructional evaluation. Although essay evaluations--a useful instrument for evaluating higher-order cognitive abilities--have always depended on human raters, concerns regarding rater bias,…

Process and product are always in tension. In authentic writing, they can be messy and hard to assess. Because writing is recursive and generative, every word written opens new possibilities. Not only that, but writing is influenced by ability, time allowed, task definition, rhetorical situation, relationship to reading, and helpful thinking…

In a meta-analytic review of critical thinking in social work education, findings revealed variability in research designs, methods, and subsequent findings. The 10 studies reviewed assessed different components of critical thinking and highlighted different potential moderator variables. Although there are significant limitations to all the…

This article outlines the current state of and recent developments in the use of corpora for language assessment and considers future directions with a special focus on computational methodology. Because corpora began to make inroads into language assessment in the 1990s, test developers have increasingly used them as a reference resource to…

Different diagnostic tools have been developed and used by researchers to identify students' conceptions. The present study aimed to provide an overview of the common diagnostic instruments in science to assess students' misconceptions. Also the study provides a brief comparison of these common diagnostic instruments with their strengths and…

The current paper on writing assessment surveys the literature on the reliability and validity of essay tests. The paper aims to examine the two concepts in relationship with essay testing as well as to provide a snapshot of the current understandings of the reliability and validity of essay tests as drawn in recent research studies. Bearing in…

The adoption of active learning instructional practices in college science, technology, engineering, and mathematics (STEM) courses has been shown to result in improvements in student learning, contribute to increased retention rates, and reduce the achievement gap among different student populations. Descriptions of active learning strategies…

Essay tests are widely used to assess ESL/EFL learners' writing abilities for instructional, administrative, and research purposes. Relevant literature was searched to identify 70 empirical studies on ESL/EFL essay tests. The majority of these studies examined task, essay, and rater effects on essay rating and scores. Less attention has been given…

Scoring systems for direct writing assessment are described. In holistic scoring, a global quality judgment of the writing sample is made. Primary trait scoring, developed by the National Assessment of Educational Progress, is conducted in accordance with specific goals. Analytic scoring identifies characteristics and quality of writing. These…

Discusses problems in designing and interpreting research on the effects of topics used in essay exams, particularly minimum competency exams. Reviews current research on the effects of topics and their presentation. (HTH)

A summary of the writing assessment programs reviewed in this journal is presented. The problems inherent in the programs are outlined. A coordinated research program on major problems in writing assessment is proposed as being beneficial and cost-effective. (DWH)

Do choice-type tests (multiple-choice, true-false, etc.) measure the same abilities or traits as free response (essay, recall, completion, etc.) tests? A large number of studies conducted with several different methodologies and spanning a long period of time have addressed this question. In this review, attention will be focused almost…

The third of three sequels to the booklet "Student Assessment," this booklet begins by describing and giving examples of three forms that essay-type questions can take: (1) unstructured-essay questions; (2) structured-essay questions; and (3) short-notes questions. Guidelines are then provided for deciding which type of question to use in a given…

Argues that when tests equate proficiency, competency, and literacy with writing academic essays, they maintain a severely understated and mistaken notion of what it means to write well and usefully and vigorously. (FL)

The accuracy issues involved in detecting student writing skill deficiencies, factors to be dealt with or controlled, and procedural and statistical methods for controlling these factors are the focus of this article. The accuracy needed for effective instructional planning requires stability in writing assessment programs. (DWH)