Publication Date
| In 2025 | 0 |
| Since 2024 | 0 |
| Since 2021 (last 5 years) | 2 |
| Since 2016 (last 10 years) | 4 |
| Since 2006 (last 20 years) | 5 |
Descriptor
| Computer Assisted Testing | 5 |
| Evaluators | 5 |
| Item Response Theory | 5 |
| Scoring | 4 |
| Reliability | 3 |
| Scores | 3 |
| Writing Evaluation | 3 |
| Accuracy | 2 |
| Comparative Analysis | 2 |
| Correlation | 2 |
| Essay Tests | 2 |
| More ▼ | |
Source
| CALICO Journal | 1 |
| International Journal of… | 1 |
| Journal of Educational… | 1 |
| Journal of Educational… | 1 |
| Language Testing | 1 |
Author
| Bond, Trevor | 1 |
| Casabianca, Jodi M. | 1 |
| Chan, Kinnie Kin Yee | 1 |
| Chao, Szu-Fu | 1 |
| Choi, Ikkyu | 1 |
| Coniam, David | 1 |
| Donoghue, John R. | 1 |
| Engelhard, George, Jr. | 1 |
| Foltz, Peter | 1 |
| Kunnan, Antony John | 1 |
| Liu, Sha | 1 |
| More ▼ | |
Publication Type
| Journal Articles | 5 |
| Reports - Research | 5 |
Education Level
| Secondary Education | 2 |
| Elementary Education | 1 |
| Elementary Secondary Education | 1 |
| Higher Education | 1 |
| Postsecondary Education | 1 |
Audience
Location
| China | 2 |
| Australia | 1 |
| Cyprus | 1 |
| Hong Kong | 1 |
| United Kingdom | 1 |
Laws, Policies, & Programs
Assessments and Surveys
What Works Clearinghouse Rating
Peer reviewed
Direct linkCasabianca, Jodi M.; Donoghue, John R.; Shin, Hyo Jeong; Chao, Szu-Fu; Choi, Ikkyu – Journal of Educational Measurement, 2023
Using item-response theory to model rater effects provides an alternative solution for rater monitoring and diagnosis, compared to using standard performance metrics. In order to fit such models, the ratings data must be sufficiently connected in order to estimate rater effects. Due to popular rating designs used in large-scale testing scenarios,…
Descriptors: Item Response Theory, Alternative Assessment, Evaluators, Research Problems
Chan, Kinnie Kin Yee; Bond, Trevor; Yan, Zi – Language Testing, 2023
We investigated the relationship between the scores assigned by an Automated Essay Scoring (AES) system, the Intelligent Essay Assessor (IEA), and grades allocated by trained, professional human raters to English essay writing by instigating two procedures novel to written-language assessment: the logistic transformation of AES raw scores into…
Descriptors: Computer Assisted Testing, Essays, Scoring, Scores
Wind, Stefanie A.; Wolfe, Edward W.; Engelhard, George, Jr.; Foltz, Peter; Rosenstein, Mark – International Journal of Testing, 2018
Automated essay scoring engines (AESEs) are becoming increasingly popular as an efficient method for performance assessments in writing, including many language assessments that are used worldwide. Before they can be used operationally, AESEs must be "trained" using machine-learning techniques that incorporate human ratings. However, the…
Descriptors: Computer Assisted Testing, Essay Tests, Writing Evaluation, Scoring
Download full textLiu, Sha; Kunnan, Antony John – CALICO Journal, 2016
This study investigated the application of "WriteToLearn" on Chinese undergraduate English majors' essays in terms of its scoring ability and the accuracy of its error feedback. Participants were 163 second-year English majors from a university located in Sichuan province who wrote 326 essays from two writing prompts. Each paper was…
Descriptors: Foreign Countries, Undergraduate Students, English (Second Language), Second Language Learning
Coniam, David – Journal of Educational Technology Systems, 2011
This article details an investigation into the onscreen marking (OSM) of Liberal Studies (LS) in Hong Kong--where paper-based marking (PBM) of public examinations is being phased out and wholly superseded by OSM. The study involved 14 markers who had previously rated Liberal Studies scripts on screen in the 2009 Hong Kong Advanced Level…
Descriptors: Foreign Countries, Computer Assisted Testing, Educational Technology, Comparative Analysis
