Descriptor
Source
| Educational Measurement:… | 7 |
Author
| Geisinger, Kurt F. | 1 |
| Jaeger, Richard M. | 1 |
| Kolen, Michael J. | 1 |
| Linn, Robert L. | 1 |
| Mills, Craig N. | 1 |
| Parshall, Cynthia | 1 |
| Patelis, Thanos | 1 |
| Plake, Barbara S. | 1 |
| Reid, Jerry B. | 1 |
Publication Type
| Journal Articles | 7 |
| Reports - Evaluative | 7 |
| Opinion Papers | 1 |
Education Level
Audience
Location
Laws, Policies, & Programs
Assessments and Surveys
What Works Clearinghouse Rating
Peer reviewedPatelis, Thanos; Kolen, Michael J.; Parshall, Cynthia – Educational Measurement: Issues and Practice, 1997
Results of a survey completed by 60 representatives of institutions and a questionnaire answered by 55 employers suggest that there will continue to be a shortfall in the number of measurement professionals graduating from educational programs in measurement relative to the number of available employment opportunities, and that this is especially…
Descriptors: College Faculty, Education Work Relationship, Educational Assessment, Employers
Peer reviewedGeisinger, Kurt F. – Educational Measurement: Issues and Practice, 1991
Ways to use standard-setting data to adjust cutoff scores on examinations are reviewed. Ten sources of information to be used in determining standards are listed. The decision to modify passing scores should be based on these types of information and consideration of adverse impact or rating process irregularities. (SLD)
Descriptors: Cutting Scores, Evaluation Utilization, Evaluators, Interrater Reliability
Peer reviewedPlake, Barbara S.; And Others – Educational Measurement: Issues and Practice, 1991
Possible sources of intrajudge inconsistency in standard setting are reviewed, and approaches are presented to improve the accuracy of rating. Procedures for providing judges with feedback through discussion or computerized communication are discussed. Monitoring and maintaining judges' consistency throughout the rating process are essential. (SLD)
Descriptors: Computer Assisted Instruction, Evaluators, Examiners, Feedback
Peer reviewedMills, Craig N.; And Others – Educational Measurement: Issues and Practice, 1991
An approach is presented to the definition of minimal competence for judges to use in standard setting. Panelists in standard setting must receive training to ensure that differences in rating result from differences in perceptions of item difficulty, not in differences of opinion about the definition of minimal competence. (SLD)
Descriptors: Cutting Scores, Decision Making, Definitions, Difficulty Level
Peer reviewedJaeger, Richard M. – Educational Measurement: Issues and Practice, 1991
Issues concerning the selection of judges for standard setting are discussed. Determining the consistency of judges' recommendations, or their congruity with other expert recommendations, would help in selection. Enough judges must be chosen to allow estimation of recommendations by an entire population of judges. (SLD)
Descriptors: Cutting Scores, Evaluation Methods, Evaluators, Examiners
Peer reviewedReid, Jerry B. – Educational Measurement: Issues and Practice, 1991
Training judges to generate item ratings in standard setting once the reference group has been defined is discussed. It is proposed that sensitivity to the factors that determine difficulty can be improved through training. Three criteria for determining when training is sufficient are offered. (SLD)
Descriptors: Computer Assisted Instruction, Difficulty Level, Evaluators, Interrater Reliability
Peer reviewedLinn, Robert L. – Educational Measurement: Issues and Practice, 1998
The focus is on partitioning the evaluation of the consequences of assessment programs among the sponsors, developers, users, and reviewers of tests. Five parties that share responsibility are discussed: (1) the state legislature, (2) the state board of education, (3) the school district, (4) the test publisher, and (5) the measurement profession.…
Descriptors: Boards of Education, Educational Assessment, Elementary Secondary Education, Evaluation Methods
