Descriptor
Source
| Educational Measurement:… | 5 |
Author
| Geisinger, Kurt F. | 1 |
| Jaeger, Richard M. | 1 |
| Matter, M. Kevin | 1 |
| Mills, Craig N. | 1 |
| Plake, Barbara S. | 1 |
| Reid, Jerry B. | 1 |
Publication Type
| Reports - Evaluative | 7 |
| Journal Articles | 5 |
| ERIC Digests in Full Text | 1 |
| ERIC Publications | 1 |
| Opinion Papers | 1 |
Education Level
Audience
| Policymakers | 1 |
| Practitioners | 1 |
Location
Laws, Policies, & Programs
Assessments and Surveys
| National Assessment of… | 1 |
What Works Clearinghouse Rating
Peer reviewedGeisinger, Kurt F. – Educational Measurement: Issues and Practice, 1991
Ways to use standard-setting data to adjust cutoff scores on examinations are reviewed. Ten sources of information to be used in determining standards are listed. The decision to modify passing scores should be based on these types of information and consideration of adverse impact or rating process irregularities. (SLD)
Descriptors: Cutting Scores, Evaluation Utilization, Evaluators, Interrater Reliability
Peer reviewedPlake, Barbara S.; And Others – Educational Measurement: Issues and Practice, 1991
Possible sources of intrajudge inconsistency in standard setting are reviewed, and approaches are presented to improve the accuracy of rating. Procedures for providing judges with feedback through discussion or computerized communication are discussed. Monitoring and maintaining judges' consistency throughout the rating process are essential. (SLD)
Descriptors: Computer Assisted Instruction, Evaluators, Examiners, Feedback
Peer reviewedMills, Craig N.; And Others – Educational Measurement: Issues and Practice, 1991
An approach is presented to the definition of minimal competence for judges to use in standard setting. Panelists in standard setting must receive training to ensure that differences in rating result from differences in perceptions of item difficulty, not in differences of opinion about the definition of minimal competence. (SLD)
Descriptors: Cutting Scores, Decision Making, Definitions, Difficulty Level
Peer reviewedJaeger, Richard M. – Educational Measurement: Issues and Practice, 1991
Issues concerning the selection of judges for standard setting are discussed. Determining the consistency of judges' recommendations, or their congruity with other expert recommendations, would help in selection. Enough judges must be chosen to allow estimation of recommendations by an entire population of judges. (SLD)
Descriptors: Cutting Scores, Evaluation Methods, Evaluators, Examiners
Peer reviewedReid, Jerry B. – Educational Measurement: Issues and Practice, 1991
Training judges to generate item ratings in standard setting once the reference group has been defined is discussed. It is proposed that sensitivity to the factors that determine difficulty can be improved through training. Three criteria for determining when training is sufficient are offered. (SLD)
Descriptors: Computer Assisted Instruction, Difficulty Level, Evaluators, Interrater Reliability
Download full textGeneral Accounting Office, Washington, DC. Program Evaluation and Methodology Div. – 1993
In September 1991, the National Assessment Governing Board (NAGB) announced standards for basic, proficient, and advanced achievement in mathematics and reported that few American students had reached these standards. Expert reviewers noted technical problems with the NAGB approach and questioned its results. In this report, the NAGB…
Descriptors: Academic Achievement, Academic Standards, Educational Policy, Elementary Secondary Education
Matter, M. Kevin – 1989
Research and evaluation staff members in schools and school districts are frequently called on to answer questions about the quality of schools. Responding merely with test scores is not sufficient, because it is important to communicate information about the total educational program in the district. Additional measures are available.…
Descriptors: Academic Achievement, Communication Skills, Educational Quality, Elementary Secondary Education
