A general process for testing the feasibility of applying alternative mathematical or statistical models to the solution of a practical problem is presented and flowcharted. The system is used to develop a plan to compare models for test equating. The five alternative models to be considered for equating are: (1) anchor test equating using…

The extent of error likely to occur with each of several approximations for the standard deviation, internal consistency reliability, and the standard error of measurement is analyzed. Approximations were compared with exact statistics obtained on 85 different classroom tests constructed and administered by professors in a variety of fields. Means…

The potential of the Rasch model to develop scores, on a ratio scale, suitable for interindividual comparisons, from intact groups with disparate distribution characteristics was investigated. The specific problems studied were: (1) the effects of skewed test score distributions on the ability parameter of the Rasch measurement model; (2) the…

Six models for evaluating change are examined via a Monte Carlo study. All six models show a lack of power. A modified analysis of variance procedure is suggested as an alternative. (JKS)

This study examined the influence of processing strategies, and the metacomponents that determine when to apply them, on the construct validity of a verbal reasoning test. A rule-oriented strategy, an association strategy, and a partial rule strategy were examined. All three strategies contributed to individual differences in verbal reasoning.…

A newly introduced approach, rule space, can represent large numbers of erroneous rules of arithmetic operations quantitatively and can predict the likelihood of each erroneous rule. The new model challenges the credibility of the traditional right-or-wrong scoring procedure. (Author/PN)

This Monte Carlo study examined the validity of the chi-square test for model evaluation in different instances of misspecification and sample size. The usefulness of the chi-square difference statistic to compare competing structures and improvement in fit is also addressed. (Author/BS)

Describes a computerized method to test error analysis that helps motivate introductory physics students to learn the topic. The computer generates a test consisting of four topics from a list of 10 that students should know. Numerical data within realistic ranges are also generated. (JN)

Because NAEP estimates of state-level achievement play an important role in the evaluation of strategies for improving the nation's educational system, it is important that these estimates have as small a standard error as possible. NAEP estimates for state-level achievement are based on measurement of the performance of a random sample of…

This report is a review and analysis of the psychometric literature on the topic of out-of-level testing. Out-of-level testing refers to the practice of using a level of the test other than the test taken by most of the students in a student's current grade level. Much of the research on out-of-level testing was conducted in the 1970s and 1980s,…

A statewide evaluation in Idaho addressed whether teachers changed in teaching philosophy and technology skills following summer in-service workshops and whether these changes sustained themselves in the face of school year and classroom realities. The timing of data collection is an important factor to consider when interpreting program outcomes.…

Compared differences in the Bender-Gestalt mean error scores of 1,938 Black, Hispanic, and White children. Performed a two-way between groups' unweighted means ANOVA on the error scores for the seven age groups and for the three ethnic groups. Significant differences were found for both main effects. (Author)

For six tests, coefficient delta as an index for internal optimality is computed. Internal optimality is defined as the magnitude of risk of the decision procedure with respect to the true score. Results are compared with an alternative index (coefficient kappa) for assessing the consistency of decisions. (Author/JKS)

Five standardized tests of reading achievement were administered to community college freshmen. Students took two different tests on consecutive days. Grade-equivalent scores on tests were compared. Differences were found between tests based on the number of students who reached the criterion score of grade-equivalent 11 or 12. (Author/CTM)