NotesFAQContact Us
Collection
Advanced
Search Tips
Publication Date
In 20251
Since 20241
Descriptor
Adults1
College Freshmen1
Essays1
Expertise1
Intelligent Tutoring Systems1
Knowledge Level1
Novices1
Scoring1
Writing Evaluation1
Writing Processes1
Source
Grantee Submission1
Author
Danielle S. McNamara1
Laura K. Allen1
Minkyung Kim1
Quian Wan1
Rurik Tywoniw1
Scott A. Crossley1
Publication Type
Reports - Research1
Education Level
Higher Education1
Postsecondary Education1
Audience
Location
Laws, Policies, & Programs
Assessments and Surveys
What Works Clearinghouse Rating
Showing one result Save | Export
Assessing Writing Quality Using Crowdsourced Non-Expert Comparative Judgement Ratings
Peer reviewed Peer reviewed
Direct linkDirect link
Scott A. Crossley; Minkyung Kim; Quian Wan; Laura K. Allen; Rurik Tywoniw; Danielle S. McNamara – Grantee Submission, 2025
This study examines the potential to use non-expert, crowd-sourced raters to score essays by comparing expert raters' and crowd-sourced raters' assessments of writing quality. Expert raters and crowd-sourced raters scored 400 essays using a standardised holistic rubric and comparative judgement (pairwise ratings) scoring techniques, respectively.…
Descriptors: Writing Evaluation, Essays, Novices, Knowledge Level