While score comparability across test forms typically relies on common (or randomly equivalent) examinees or items, innovations in item formats, test delivery, and efforts to extend the range of score interpretation may require a special data collection before examinees or items can be used in this way--or may be incompatible with common examinee…

Consideration of the influence of English language skills during testing is an understandable requirement for fair and valid cognitive test interpretation. Several professional standards and expert recommendations exist to guide psychologists as they attempt to engage in best practices when assessing English learners (ELs). Nonetheless, relatively…

Advances in maze selection curriculum-based measurement have led to several published tools with technical information for interpretation (e.g., norms, benchmarks, cut-scores, classification accuracy) that have increased their usefulness for universal screening. A range of scoring practices have emerged for evaluating student performance on maze…

This article provides examples of how serious misconceptions can result when only "all student" scores from the National Assessment of Educational Progress (NAEP) are used for simplistic state-to-state comparisons. Suggestions for better treatment are presented. The article also compares Kentucky's eighth grade EXPLORE testing to NAEP…

Comparison of the Goodenough-Harris and McCarthy scoring procedures for 60 kindergarten children's drawings yielded substantial agreement between the two scoring systems. The streamlined McCarthy scoring system should be utilized when large numbers of children are being evaluated with short periods of time. (Author)

This paper compares various methods of smoothed equipercentile equating and linear equating in the random groups equating design. Three presmoothing methods (based on the beta binomial model, four-parameter beta binomial model and a log-linear model) are compared to postsmoothing using cubic splines, linear equating and unsmoothed equipercentile…

This paper addresses the problem of whether two-dimensional solutions with different apparent meanings and different implied interpretations of the number-correct scale could be produced from the same test data set by simply shifting the orientation of the two-dimensional projection plane. An artificial data set of 3,000 response vectors and a…

Test data from a large licensure examination were used to investigate the impact of the number of score groups and score group size on the Mantel-Haenszel (MH) alpha statistic. Two kinds of quasi-experimental studies were conducted: (1) baseline MH analyses in which the number of score groups and the ethnicity of each randomly equivalent…

Several English and Spanish language tests currently used in bilingual education and some less known tests are reviewed, looking at both historic and psychometric factors. It is suggested that practitioners have commonly assumed that all language tests are basically valid, which contributed to the commercial success of some tests of questionable…

Six methods of scoring multiple true-false items were compared in terms of reliabilities, difficulties, and discrimination. Results suggest that, for norm-referenced score interpretations, there is insufficient evidence to support any one of the methods as superior. For criterion-referenced score interpretations, effects of scoring method must be…

Ability estimates obtained from applying finite state score theory, item response models, and classical test theory to score multiple-choice items were compared using responses of 1,230 examinees. Scoring models provided essentially the same ranking of examinees, but ease of use and interpretation support the use of the classical test model. (SLD)

This book of scoring guides and national percentages is part of a kit consisting of four documents which bring together different types of items that measure a number of career and occupational development (COD) objectives developed by the National Assessment of Educational Progress (NAEP). (NAEP--which completed a national survey measuring the…

The National Assessment of Educational Progress (NAEP), often called the "Nation's Report Card," is the only nationally representative, continuing assessment of what U.S. students know and can do in various subject areas. NAEP provides a comprehensive measure of students' learning at critical junctures in their school experience. The…

Grade-equivalent scores are widely used in the school system in reporting students' performance on standardized achievement tests. This paper explores how grade equivalent scores are calculated and interpreted. In addition, the paper examines the limitations of grade-equivalent scores through the use of small heuristic data sets. A…