Descriptor
Source
Journal of Experimental… | 1 |
Author
Reckase, Mark D. | 2 |
Davey, Tim | 1 |
Fabrizio, Louis M. | 1 |
Miller, Eva R. | 1 |
Page, Ellis Batten | 1 |
Sanford, Eleanor E. | 1 |
Webb, Melvin W., II | 1 |
Publication Type
Reports - Evaluative | 6 |
Speeches/Meeting Papers | 4 |
Journal Articles | 1 |
Education Level
Audience
Location
Laws, Policies, & Programs
Assessments and Surveys
National Assessment of… | 6 |
What Works Clearinghouse Rating
Reckase, Mark D. – 1998
Standard setting is a fairly widespread activity in educational and psychological measurement, but there is no formal psychometric theory to guide the development of standard setting methodology. This paper presents a conceptual framework for such a psychometric theory and uses the conceptual framework to analyze a number of methods for setting…
Descriptors: Educational Assessment, Evaluation Methods, Judges, Measurement Techniques

Page, Ellis Batten – Journal of Experimental Education, 1994
National Assessment of Educational Progress writing sample essays from 1988 and 1990 (495 and 599 essays) were subjected to computerized grading and human ratings. Cross-validation suggests that computer scoring is superior to a two-judge panel, a finding encouraging for large programs of essay evaluation. (SLD)
Descriptors: Computer Assisted Testing, Computer Software, Essays, Evaluation Methods
Sanford, Eleanor E.; Fabrizio, Louis M. – 1999
The North Carolina End-of-Grade (NCEOG) Test of Mathematics, Grade 8 was compared to the National Assessment of Educational Progress (NAEP)--Grade 8 along three dimensions: technical, content, and cognitive. An expert panel of six judges (mathematics educators) examined the supporting documents, the content frameworks, the items, and actual test…
Descriptors: Comparative Analysis, Educational Assessment, Grade 8, Judges
Reckase, Mark D. – 1994
Comparative results are presented for procedures recently appearing in literature related to standard setting on the National Assessment of Educational Progress--the paper selection method and the contrasting group method. For this comparison, a probabilistic model with normal distribution of performance and a six-point scale were assumed. The…
Descriptors: Comparative Analysis, Criteria, Educational Assessment, Elementary Secondary Education
Webb, Melvin W., II; Miller, Eva R. – 1995
As constructed-response items become an integral part of educational assessments, setting student performance standards on constructed-response items has become an important issue. Two standard-setting methods, one used for setting standards on the National Assessment of Educational Progress (NAEP) in reading in grade 8 and the other used to set…
Descriptors: Comparative Analysis, Constructed Response, Criteria, Educational Assessment
Davey, Tim; And Others – 1996
Some standard-setting methods require judges to estimate the probability that an examinee who just meets an achievement standard will answer each of a set of items correctly. These probability estimates are then used to infer the values on some latent scale that, in theory, determines an examinee's responses. The paper focuses on the procedures…
Descriptors: Academic Achievement, Achievement Tests, Elementary Secondary Education, Error of Measurement