Publication Date
In 2025 | 0 |
Since 2024 | 0 |
Since 2021 (last 5 years) | 0 |
Since 2016 (last 10 years) | 3 |
Since 2006 (last 20 years) | 3 |
Descriptor
Test Validity | 4 |
Essay Tests | 3 |
Test Scoring Machines | 3 |
Automation | 2 |
Computer Assisted Testing | 2 |
Interrater Reliability | 2 |
Scoring | 2 |
Statistical Analysis | 2 |
Accuracy | 1 |
Best Practices | 1 |
College Students | 1 |
More ▼ |
Source
Applied Measurement in… | 4 |
Author
Ben-Simon, Anat | 1 |
Cohen, Allan | 1 |
Cohen, Yoav | 1 |
Fowles, Mary E. | 1 |
Levi, Effi | 1 |
Powers, Donald E. | 1 |
Raczynski, Kevin | 1 |
Rupp, André A. | 1 |
Publication Type
Journal Articles | 4 |
Reports - Research | 3 |
Reports - Descriptive | 1 |
Education Level
Grade 7 | 1 |
Audience
Location
Israel | 1 |
Laws, Policies, & Programs
Assessments and Surveys
What Works Clearinghouse Rating
Raczynski, Kevin; Cohen, Allan – Applied Measurement in Education, 2018
The literature on Automated Essay Scoring (AES) systems has provided useful validation frameworks for any assessment that includes AES scoring. Furthermore, evidence for the scoring fidelity of AES systems is accumulating. Yet questions remain when appraising the scoring performance of AES systems. These questions include: (a) which essays are…
Descriptors: Essay Tests, Test Scoring Machines, Test Validity, Evaluators
Cohen, Yoav; Levi, Effi; Ben-Simon, Anat – Applied Measurement in Education, 2018
In the current study, two pools of 250 essays, all written as a response to the same prompt, were rated by two groups of raters (14 or 15 raters per group), thereby providing an approximation to the essay's true score. An automated essay scoring (AES) system was trained on the datasets and then scored the essays using a cross-validation scheme. By…
Descriptors: Test Validity, Automation, Scoring, Computer Assisted Testing
Rupp, André A. – Applied Measurement in Education, 2018
This article discusses critical methodological design decisions for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems. The discussion is inspired by work on operational large-scale systems for automated essay scoring but many of the…
Descriptors: Design, Automation, Scoring, Test Scoring Machines

Powers, Donald E.; Fowles, Mary E. – Applied Measurement in Education, 1998
To determine the effects on test performance and test validity of releasing essay topics before an examination, 300 prospective graduate students wrote essays on a released and an unreleased topic. Analyses did not reveal any statistically significant effect of topic release. (SLD)
Descriptors: College Students, Essay Tests, Higher Education, Performance Factors