When comparing data derived from tests or questionnaires in cross-national studies, researchers commonly assume measurement invariance in their underlying scaling models. However, different cultural contexts, languages, and curricula can have powerful effects on how students respond in different countries. This article illustrates how the…

In this paper, a new item analysis index, e, is derived as a function of difficulty and discrimination to represent item efficiency. Item discrimination in this paper is not independent of item difficulty, and it is demonstrated algebraically that the maximum discriminating power of an item may be determined from its difficulty. Item efficiency is…

In early intervention, researchers often are interested in interpretation aids that can help determine the relative importance of variables when multiple regression models are used, and that facilitate deeper insight into prediction dynamics. Commonality analysis is one approach for helping researchers understand the contributions independent or…

This handbook was designed to assist counselors, teachers, and administrators in using the Career Skills Assessment Program (CSAT) materials and services properly. Part 1 of the handbook, Guide to Use of the CSAP, is primarily concerned with understanding, interpreting, and applying the results of the program. Specific topics discussed in this…

The preparation and use of an objective strength analysis report (OSAR) from the Iowa Test of Basic Skills (ITBS) are described. The OSAR was designed to answer two needs: (1) a format which allows the school to easily answer the question "which reading objectives need more emphasis and/or better materials or techniques in order to raise its…

Instructional programs organized according to modern educational technology are discussed within the purposes of criterion-referenced measurements used. The problems of criterion-referenced measurements include scoring and score interpretation, item and test analysis, and mastery testing. An overview of solutions and approaches to the problems and…

Although item bias statistics are widely recommended for use in test development and test analysis work, problems arise in their interpretation. The purpose of the present research was to evaluate the validity of logistic test models and computer simulation methods for providing a frame of reference for item bias statistic interpretations.…

A multi-purpose, multi-user evaluation system was designed to improve the quality of the reporting of information gathered in testing and evaluation practices. One part of the system, the reporting system for information resulting from a district standardized testing program, was described. The Student-Problem Package software was modified to…

A replicable process for improving instruction through the consistent use of student data collected before, during, and after instruction is proposed. A rational analysis of different types of error rates (theoretical, base, posttest, instructional) and discrimination indices (base, posttest) leads to a set of rules for identifying test items and…

The ninth report of the Michigan Educational Assessment Program contains the technical information needed to evaluate the instruments and techniques used to measure and report the status of student achievement and attitude. This report is intended for people with expertise in psychometrics. The Program is described in the first section of the…

This material provides a discussion of the construction and analysis of tests prepared for classroom use by teachers. The initial discussion is concerned with the purposes of evaluation and the specification of objectives. This is followed by an examination of theoretical and practical considerations in planning a test. The material on test item…

In July 2001, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) agreed to the development of assessment instruments and key performance measures for reporting on student skills, knowledge and understandings in primary science. It directed the newly established Performance Measurement and Reporting Taskforce…

Evaluation instruments and current practices used in measuring achievement in Ontario, Canada elementary schools were examined. An analytical review of currently available achievement measures was made in relation to the objectives of "The Formative Years", a circular issued on the Ontario Minestry on Education. Results of item analyses…