NotesFAQContact Us
Collection
Advanced
Search Tips
Showing all 6 results Save | Export
Using Linkage Sets to Improve Connectedness in Rater Response Model Estimation
Peer reviewed Peer reviewed
Direct linkDirect link
Casabianca, Jodi M.; Donoghue, John R.; Shin, Hyo Jeong; Chao, Szu-Fu; Choi, Ikkyu – Journal of Educational Measurement, 2023
Using item-response theory to model rater effects provides an alternative solution for rater monitoring and diagnosis, compared to using standard performance metrics. In order to fit such models, the ratings data must be sufficiently connected in order to estimate rater effects. Due to popular rating designs used in large-scale testing scenarios,…
Descriptors: Item Response Theory, Alternative Assessment, Evaluators, Research Problems
Beyond Semantic Distance: Automated Scoring of Divergent Thinking Greatly Improves with Large Language Models
Peer reviewed Peer reviewed
PDF on ERIC Download full text
Direct linkDirect link
Peter Organisciak; Selcuk Acar; Denis Dumas; Kelly Berthiaume – Grantee Submission, 2023
Automated scoring for divergent thinking (DT) seeks to overcome a key obstacle to creativity measurement: the effort, cost, and reliability of scoring open-ended tests. For a common test of DT, the Alternate Uses Task (AUT), the primary automated approach casts the problem as a semantic distance between a prompt and the resulting idea in a text…
Descriptors: Automation, Computer Assisted Testing, Scoring, Creative Thinking
Digitizing Practical Production Work for High-Stakes Assessments
Peer reviewed Peer reviewed
PDF on ERIC Download full text
Newhouse, C. Paul; Tarricone, Pina – Canadian Journal of Learning and Technology, 2014
High-stakes external assessment for practical courses is fraught with problems impacting on the manageability, validity and reliability of scoring. Alternative approaches to assessment using digital technologies have the potential to address these problems. This paper describes a study that investigated the use of these technologies to create and…
Descriptors: High Stakes Tests, Student Evaluation, Evaluation Methods, Scoring
The Validity and Reliability of Concept Mapping as an Alternative Science Assessment when Item Response Theory Is Used for Scoring.
PDF on ERIC Download full text
Liu, Xiufeng – 1994
Problems of validity and reliability of concept mapping are addressed by using item-response theory (IRT) models for scoring. In this study, the overall structure of students' concept maps are defined by the number of links, the number of hierarchies, the number of cross-links, and the number of examples. The study was conducted with 92 students…
Descriptors: Alternative Assessment, Computer Assisted Testing, Concept Mapping, Correlation
Using Multimedia Technology To Create Innovative Items.
PDF on ERIC Download full text
French, Ann; Godwin, Janet – 1996
The development of innovative test item types that use multimedia technology to improve item authenticity and interaction and allow for objective scoring through partial-credit scoring methodologies was studied. Science test items were developed for community college developmental students using "Authorware 3.0," an instructional compact disc. The…
Descriptors: Alternative Assessment, College Students, Community Colleges, Computer Assisted Testing
Selected Papers from the Spring 1993 Breivogel Conference at the University of Florida on Alternative/Portfolio Assessment.
PDF on ERIC Download full text
Vernetson, Theresa, Ed. – Florida Educational Research Council Research Bulletin, 1993
This edition of the "Research Bulletin" is a compilation of papers presented at the annual William F. Breivogel Conference in 1993. The conference theme was alternative and portfolio assessment. Papers were grouped into assessment in general, portfolio assessment, and alternative assessments and curriculum questions. The selected papers…
Descriptors: Alternative Assessment, Computer Assisted Testing, Curriculum Development, Educational Assessment