Discusses the possible disjunct between what is good for large-scale assessment and what is good for teaching and learning. Represents one attempt to "marry" large-scale and classroom perspectives. Presents background and rationale for a new narrative rubric that was designed to support classroom instruction. Presents evidence for the…

Studied four forms of score resolution used by testing agencies and investigated the effect that each has on the interrater reliability associated with the resulting operational scores. Results, based on 120 essays from the Georgia High School Writing Test, show some forms of resolution to be associated with higher reliability and some associated…

The process used to identify the provisional locations of points that would inform the National Assessment Governing Board in setting achievement levels for the science National Assessment of Educational Progress (NAEP) is described. This process includes identification of panelists for achievement-level setting and the method for converting…

Compared scores assigned to college placement essays by a computer program with the evaluations of human readers for just under 1,300 essays. Results show high agreement between computer and human scores, and both human and machine readers tended to give higher scores for analytic and practical themes and lower scores for those involving emotions.…

The 13th iteration of the International Conference on Educational Data Mining (EDM 2020) was originally arranged to take place in Ifrane, Morocco. Due to the SARS-CoV-2 (coronavirus) epidemic, EDM 2020, as well as most other academic conferences in 2020, had to be changed to a purely online format. To facilitate efficient transmission of…

THE DEVELOPMENT OF ECONOMICAL FEEDBACK SCORING SYSTEMS FOR REUSABLE KINDERGARTEN WORKBOOKS IS DESCRIBED. THREE PROTOTYPE SYSTEMS WERE DEVELOPED--(1) A METAL FOIL ACTIVATING AN ELECTRICAL PROBE, (2) A METAL FOIL REACTING WITH A MAGNETIC PROBE, AND (3) INVISIBLE FLUORESCENT INK REVEALED BY THE APPLICATION OF LONGWAVE ULTRAVIOLET LIGHT. (MS)

Illustrates that there is a critical distinction between reliability and accuracy, explaining through a hypothetical example of shoe fitting that high test reliability does not guarantee good accuracy without consideration of percentile rank scoring, complex measurement models, and other technical detail. (SLD)

Objective: This study aimed to examine the long-term correlates of childhood trauma in regard to interpersonal functioning in adulthood. Method: One hundred and nineteen (N=119) subjects from the Austen Riggs Follow-along Study were included in the study. The Traumatic Antecedent Interview scoring method was used to assess 10 types of childhood…

This paper considers whether high schools in competitive environments use grade inflation to attract and retain families, perhaps in addition to more constructive responses. Two measures of grade inflation are used: the cutoffs used by each school to assign a letter grade to a percent score; and high school GPA after controlling for test scores, a…

The current research was conducted to investigate the validity of automated essay scoring (AES) by comparing group mean scores assigned by an AES tool, IntelliMetric [TM] and human raters. Data collection included administering the Texas version of the WriterPlacer "Plus" test and obtaining scores assigned by IntelliMetric [TM] and by…

[Slides] presented at the American Educational Research Association (AERA) Conference in New York in March 2008. This presentation explores what cues are used as a deciding factor in essay scoring by the essay grader.

The purpose of this review is to present a comprehensive evaluation of science attitude instruments based on published psychometric evidence. A multitude of instruments have been used through the years and some have been linked to career choice and school performance. Substantiating such associations is of paramount importance if researchers wish…

Discrepancies abound in use of the word "inquiry." In this paper, the authors propose a quantitative rubric designed to characterize the level of inquiry in laboratory activities and laboratory curricula. They do not wish to answer the question, "What is inquiry?" but rather, provide a tool for identifying its varying degrees of student…