Independent schools are, for the most part, exempt from mandatory participation in standardized tests designed for state and federal comparisons, nor are they required to take part in comparative international assessments. The anxiety in the broader culture, however, is driving a growing interest among independent school parents (and prospective…

Item bias, when present in a multiple-choice test, can be detected by appropriate analyses of the persons x items scoring matrix. Five related schemes for the statistical analysis of bias were applied to a widely used, primary skills multiple-choice test which was administered in either its English- or Spanish-language version at each of the two…

Single administration (beta-binomial) estimates for the raw agreement index p and the corrected-for-chance kappa index in mastery testing are compared with those based on two test administrations in terms of estimation bias and sampling variability. Bias is about 2.5 percent for p and 10 percent for kappa. (Author/RL)

A pilot study was conducted on test item ambiguity in standardized tests. A group of second and third grade children were selected and given a random sample of items from four standardized test series. Items were drawn from the reading, science and social studies subtests and put together in a composite reading comprehension, science, and social…

In this study 6,942 items from two standardized achievement test batteries--the Stanford (Early School Achievement Battery, Achievement Battery, and Test of Academic Skills) and the Comprehensive Test of Basic Skills--were analyzed. Focus was on determining: (1) the extent to which these test batteries included general cognitive operations (GCOs)…

The sampling of test items found within the Science portion of selected standardized achievement test batteries is examined. The lack of sensitivity of such items to the curriculum changes often attempted in Earth Science is demonstrated. The following five standardized achievement test batteries commonly administered to pupils in grades 7-9 were…

This study added extraneous information and increased syntactical complexity to determine the relative importance of computational and reading abilities in solving arithmetic word problems. Analyzing tests of 200 sixth graders indicated the combined abilities accounted for 54 percent of the variance in solution accuracy. (BS)

Matches between questions in the Kentucky Instructional Results Information System for 1995-96 (KIRIS96), the Comprehensive Tests of Basic Skills, Fourth Edition (CTBS4), and the California Achievement Tests, Fifth Edition (CAT5) and the Kentucky Academic Expectations as they are defined in the Kentucky curriculum framework were studied. Each…

In most reliability studies, the precision of a reliability estimate varies inversely with the number of examinees (sample size). Thus, to achieve a given level of accuracy, some minimum sample size is required. An approximation for this minimum size may be made if some reasonable assumptions regarding the mean and standard deviation of the test…

Extended caution indices (ECI) specify the degree of confidence that can be placed in an individual's test score by analyzing patterns of item response. Among the most promising of such indices are the standardized ECIs. Contrary to the literature, several instances were found, in a previous study, of nonnormal distributions of ECIs with samples…

The three-parameter logistic model discussed was used by CTB/McGraw-Hill in the development of the Comprehensive Tests of Basic Skills, Form U (CTBS/U) and the Test of Cognitive Skills (TCS), published in the fall of 1981. The development, standardization, and scoring of the tests are described, particularly as these procedures were influenced by…

A panel of expert referees from the Philadelphia school district categorized items from secondary-level standardized mathematics tests according to National Assessment of Educational Progress (NAEP) subobjectives for mathematics. The following tests were covered by the study: (1) California Achievement Tests (Levels 19 and 20); (2) Comprehensive…

Standardized achievement tests and instructional accomplishment inventories involve different methodologies and cannot be equated by using conventional psychometric methods. Instructional accomplishment inventories are descriptive, and are designed to reflect the scope, sequence, and skills and emphasis in a particular instructional program.…

Three test-analysis models were used to analyze three types of simulated test score data plus the results of eight achievement tests. Chi-square goodness-of-fit statistics were used to evaluate the appropriateness of the models to the four kinds of data. Data were generated to simulate the responses of 1,000 students to 36 pseudo-items by…

This paper seeks to extend the application of Markov chain Monte Carlo (MCMC) methods in item response theory (IRT) to include the estimation of equating relationships along with the estimation of test item parameters. A method is proposed that incorporates estimation of the equating relationship in the item calibration phase. Item parameters from…