Statistical Analysis Software (SAS) is a widely used tool for data management analysis across a variety of fields. The procedure for item response theory (PROC IRT) is one to perform unidimensional and multidimensional item response theory (IRT) analysis for dichotomous and polytomous data. This review provides a summary of the features of PROC…

The main points of Sijtsma and Green and Yang in Educational Measurement: Issues and Practice (34, 4) are that reliability, internal consistency, and unidimensionality are distinct and that Cronbach's alpha may be problematic. Neither of these assertions are at odds with Davenport, Davison, Liou, and Love in the same issue. However, many authors…

This is a descriptive study which intends to determine whether the difficulty and discrimination indices of the multiple-choice questions show differences according to cognitive levels of the Bloom's Taxonomy, which are used in the exams of the courses in a business administration bachelor's degree program offered through open and distance…

A directly applicable latent variable modeling procedure for classical item analysis is outlined. The method allows one to point and interval estimate item difficulty, item correlations, and item-total correlations for composites consisting of categorical items. The approach is readily employed in empirical research and as a by-product permits…

There are relatively few examples of quantitative approaches to quality control in educational assessment and accountability contexts. Among the several techniques that are used in other fields, Shewart charts have been found in a few instances to be applicable in educational settings. This paper describes Shewart charts and gives examples of how…

This article describes SIMREL, a software program designed for the simulation of alpha coefficients and the estimation of its confidence intervals. SIMREL runs on two alternatives. In the first one, if SIMREL is run for a single data file, it performs descriptive statistics, principal components analysis, and variance analysis of the item scores…

The Inviting School Survey-Revised (ISS-R) was adapted and translated into Traditional Chinese (ISS-RC), using a five-step process, based on international test administration guidelines, involving judgmental, logical, and empirical methods. Both versions were administered to a convenience sample of Chinese-English fluent Hong Kong school community…

While measurement precision is relatively easy to establish for single tests and assessments, it is much more difficult to determine for decision making with multiple tests on different subjects. This latter is the situation in the system of final examinations for secondary education in the Netherlands and is used as an example in this paper. This…

This "Research Commentary" addresses the quality of statistical research in mathematics education. To do so, 10 years of Journal for Research in Mathematics Education (JRME) articles were analyzed on the basis of criteria suggested by the American Educational Research Association, American Psychological Association, and National Council for…

In the course of screening a form of a medical licensing exam for items that function differentially (DIF) between men and women, the authors used the traditional Mantel-Haenszel (MH) statistic for initial screening and a Bayesian method for deeper analysis. For very easy items, the MH statistic unexpectedly often found DIF where there was none.…

Combining diverse methods in a single study raises a problem: What should be done when the findings of one method of investigation conflict with those of another? The authors illustrate this problem using an example in which three study phases--quantitative, qualitative, and intervention--are applied. The findings from the quantitative phase did…

The purpose of this study was to develop general outcome measures (GOM) in mathematics so that teachers could focus their instruction on needed prerequisite skills. We describe in detail, the manner in which content-related evidence was established and then present a number of statistical analyses conducted to evaluate the technical adequacy of…

Describes a practical approach that teachers can use to check for test-item validity in test construction. The Kuder-Richardson Reliability Formula is used. Detailed instructions describe the procedure for evaluating items for difficulty and using statistical methods to determine test validity. (AM)

The computer program WEIGAN makes the weighted G analysis available for computer users. The input and output of the program are described. (Author/JKS)

A method for examining invariance in validity of multiple-component instruments in repeated measure designs is outlined. The approach is developed within the framework of covariance structure modeling and is applicable for purposes of ascertaining temporal stability in scale validity. In addition, the procedure provides a range of plausible values…