NotesFAQContact Us
Collection
Advanced
Search Tips
Showing all 4 results Save | Export
Evaluating Score and Decision Consistency across Claims in a Validation Argument
Peer reviewed Peer reviewed
Direct linkDirect link
Schmidgall, Jonathan – Applied Measurement in Education, 2017
This study utilizes an argument-based approach to validation to examine the implications of reliability in order to further differentiate the concepts of score and decision consistency. In a methodological example, the framework of generalizability theory was used to estimate appropriate indices of score consistency and evaluations of the…
Descriptors: Scores, Reliability, Validity, Generalizability Theory
The Conventional Wisdom about Group Mean Scores.
Peer reviewed Peer reviewed
Brennan, Robert L. – Journal of Educational Measurement, 1995
Generalizability theory is used to show that the assumption that reliability for groups is greater than that for persons (and that error variance for groups is less than that for persons) is not necessarily true. Examples are provided from course evaluation and performance test literature. (SLD)
Descriptors: Course Evaluation, Decision Making, Equations (Mathematics), Generalizability Theory
Generalizability of Performance Assessments.
Peer reviewed Peer reviewed
Brennan, Robert L.; Johnson, Eugene G. – Educational Measurement: Issues and Practice, 1995
The application of generalizability theory to the reliability and error variance estimation for performance assessment scores is discussed. Decision makers concerned with performance assessment need to realize the restrictions that limit generalizability such as limitations that lead to reductions in the number of tasks possible, rater quality,…
Descriptors: Decision Making, Educational Assessment, Error of Measurement, Estimation (Mathematics)
Generalizability of New Standards Project, 1993 Pilot Study Tasks in Mathematics. Technical Issues in Procedures To Link State Results to a Common National Standard. Project 2.4 Quantitative Models To Monitor the Status and Progress of Learning and Performance and Their Antecedents.
PDF on ERIC Download full text
Linn, Robert L. – 1994
The New Standards Project conducted a pilot test of a series of performance-based assessment tasks in mathematics and English language arts at Grades 4 and 8 in the spring of 1993. This paper reports the results of a series of generalizability analyses conducted for a subset of the 1993 pilot study data in mathematics. Generalizability analyses…
Descriptors: Decision Making, Educational Assessment, Elementary Education, Elementary School Students