Publication Date
| In 2025 | 0 |
| Since 2024 | 0 |
| Since 2021 (last 5 years) | 1 |
| Since 2016 (last 10 years) | 3 |
| Since 2006 (last 20 years) | 3 |
Descriptor
| Evaluators | 3 |
| Models | 3 |
| Accuracy | 2 |
| Essay Tests | 2 |
| Behavior | 1 |
| Comparative Analysis | 1 |
| Educational Assessment | 1 |
| Error of Measurement | 1 |
| Essays | 1 |
| Evaluation Methods | 1 |
| Expertise | 1 |
| More ▼ | |
Source
| Applied Measurement in… | 3 |
Author
| Bejar, Isaac I. | 1 |
| Cohen, Allan | 1 |
| Lee, Won-Chan | 1 |
| Li, Chen | 1 |
| McCaffrey, Daniel | 1 |
| Raczynski, Kevin | 1 |
| Song, Yoon Ah | 1 |
Publication Type
| Journal Articles | 3 |
| Reports - Research | 3 |
Education Level
| Grade 7 | 1 |
Audience
Location
Laws, Policies, & Programs
Assessments and Surveys
What Works Clearinghouse Rating
Peer reviewed
Direct linkSong, Yoon Ah; Lee, Won-Chan – Applied Measurement in Education, 2022
This article presents the performance of item response theory (IRT) models when double ratings are used as item scores over single ratings when rater effects are present. Study 1 examined the influence of the number of ratings on the accuracy of proficiency estimation in the generalized partial credit model (GPCM). Study 2 compared the accuracy of…
Descriptors: Item Response Theory, Item Analysis, Scores, Accuracy
Bejar, Isaac I.; Li, Chen; McCaffrey, Daniel – Applied Measurement in Education, 2020
We evaluate the feasibility of developing predictive models of rater behavior, that is, "rater-specific" models for predicting the scores produced by a rater under operational conditions. In the present study, the dependent variable is the score assigned to essays by a rater, and the predictors are linguistic attributes of the essays…
Descriptors: Scoring, Essays, Behavior, Predictive Measurement
Raczynski, Kevin; Cohen, Allan – Applied Measurement in Education, 2018
The literature on Automated Essay Scoring (AES) systems has provided useful validation frameworks for any assessment that includes AES scoring. Furthermore, evidence for the scoring fidelity of AES systems is accumulating. Yet questions remain when appraising the scoring performance of AES systems. These questions include: (a) which essays are…
Descriptors: Essay Tests, Test Scoring Machines, Test Validity, Evaluators
