A test score can be used for individual instructional diagnosis after determining whether: (1) difficulty of the test items was consistent with the complexity of the content measured; (2) items measuring the same underlying process were about equally difficult; and (3) partial credit scoring would increase the reliability of the diagnosis. (LMO)

Two new indices of stability of content-referenced standard-setting results are presented, relating variability of judges' decisions to the variability of candidate scores and to the reliability of the test. These indices are used to indicate whether scores resulting from a standard-setting study are of sufficient precision. (Author/LMO)

A study of the reliability of a computer-assisted test of optometric clinical diagnostic skills that uses actual patient cases revealed that the test is most useful when used in conjunction with subjective clinical grading for evaluating problem-solving skills. (MSE)

The reported data provide a basis for evaluating the formula-scoring versus rights-scoring issue and for assessing the effects of directions on the reliability and parallelism of scores for sophisticated examinees taking professionally developed tests. Results support the invariance hypothesis rather than the differential effects hypothesis.…

In every instance in the process of constructing and using a test, the microcomputer can aid the classroom teacher. However, the teacher will not apply the microcomputer to classroom testing without added training both in classroom testing and in using the microcomputer. (BW)

A procedure for obtaining maximum likelihood trait estimates from number-correct (NC) scores for the three-parameter logistic model is presented. It produces an NC score to trait estimate conversion table. Analyses in the estimated true score metric confirm the conclusions made in the trait metric. (Author/DWH)

The reliabilities of two types of measurement plans were compared across six hypothetical distributions of true scores or abilities. The measurement plans were: (1) fixed-length, where the number of trials for all examinees is set in advance; and (2) trials-to-criterion, where examinees must keep trying until they complete a given number of trials…

Job training has become an important aspect of an employee's overall job experience. However, it is not often called out specifically on instruments measuring job satisfaction. This technical manual details the processes used in the development and validation of a survey instrument to measure job training satisfaction and overall job…

Arizona's Instrument to Measure Standards High School (AIMS HS) is an assessment program that measures high school students' achievement of the Arizona Academic Standards adopted by the state Board of Education in three subject areas: reading, writing, and mathematics. All students in high school are required to participate in AIMS HS testing.…

This book presents ideas to help middle and high school physical education (PE) teachers develop performance based assessments. The book: identifies problems in traditional PE and explains how using performance based assessment can improve student learning; notes that it is unnecessary to totally rewrite the PE program, offering guidelines for…

This report explains how students with significant disabilities who submit portfolios for the Massachusetts Comprehensive Assessment System (MCAS) Alternate Assessments are evaluated to meet state requirements for a "competency determination" needed to receive a regular high school diploma. The reasoning behind the Massachusetts approach and the…

This English-Spanish language report includes the rationale for creating an assessment model for Spanish writing, offering an overview of the components of high quality assessment for any subject area, particularly Spanish writing. It presents the characteristics of effective Spanish writing, rubrics for scoring student performance based on the…

As more and more states and districts develop their alternate assessments for those students unable to participate in the regular assessment, they are faced with the challenge of setting standards for their alternate assessments. Despite the variability in alternate assessments currently developed, including checklists, structured and unstructured…

State assessment systems must address both technical and policy issues as assessments and accountability practices are developed and implemented. These technical and policy issues have been expanded from traditional large-scale assessment to new alternative assessment approaches required by law and developed in every state. The primary purpose of…

Students' perspectives, levels of epistemological understanding, and critical thinking dispositions related to the use of case studies in an educational psychology course. This is the second part of a research project investigating students' perspectives and critical thinking dispositions related to case study pedagogy in an educational psychology…