NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ686272
Record Type: Journal
Publication Date: 2005-Mar
Pages: 24
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0022-0655
EISSN: N/A
Available Date: N/A
A Model of Rater Behavior in Essay Grading Based on Signal Detection Theory
DeCarlo, Lawrence T.
Journal of Educational Measurement, v42 n1 p53-76 Mar 2005
An approach to essay grading based on signal detection theory (SDT) is presented. SDT offers a basis for understanding rater behavior with respect to the scoring of construct responses, in that it provides a theory of psychological processes underlying the raters' behavior. The approach also provides measures of the precision of the raters and the accuracy of classifications. An application of latent class SDT to essay grading is detailed, and similarities to and differences from item response theory (IRT) are noted. The validity and utility of classifications obtained from the SDT model and scores obtained from IRT models are compared. Validity coefficients were found to be about equal in magnitude across SDT and IRT models. Results from a simulation study of a 5-class SDT model with eight raters are also presented.
Journal Customer Services, Blackwell Publishing, 350 Main Street, Malden, MA 02148. Tel: 800-835-6770 (Toll Free); Fax: 781-388-8232; e-mail: subscrip@bos.blackwellpublishing.com.
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A