The Florida Statewide Assessment Program tests students' achievement of basic skills in reading, writing, and mathematics at grades 3, 5, 8, and 10 on the State Student Assessment Test-Part I (SSAT-I). In addition, high school students are tested on practical math and reading tasks on the State Student Assessment Test-Part II (SSAT-II). This…

Several investigators, using the Bem Sex Role Inventory (BSRI), have concluded that masculine is the desired sex role of males and females. Other investigators have suggested that some of the feminine BSRI items are undesirable. In order to determine if this masculine ideal might be due to the nature of the BSRI feminine items (more undesirable…

Factor analysis is the traditional method for studying the dimensionality of test data. However, under common conditions, the factor analysis of tetrachoric correlations does not recover the underlying structure of dichotomous data. The purpose of this paper is to demonstrate that the factor analyses of tetrachoric correlations is unlikely to…

Information on statistical detection of two different kinds of unethical activity associated with standardized testing is presented. The first is advance presentation of specific test items or excessive coaching using items very similar to those on a test. Cluster analysis is recommended for detection of aberrant vectors of percentages correct on…

The most appropriate statistical model for the small-scale (n<100) studies common in language testing research is the Rasch one-parameter logistic model. The Rasch model provides a wide range of options for conducting research, refining existing examinations, and developing tailored (computerized adaptive) language tests. Three investigations…

The present monte carlo simulation study was designed to examine the effects of multidimensionality during the administration of computerized adaptive testing (CAT). It was assumed that multidimensionality existed in the individuals to whom test items were being administered, i.e., that the correct or incorrect responses given by an individual…

How accurately deltas (statistics measuring the difficulty of items) established by pre-test populations reflect deltas obtained from final form populations, and the consequent utility of pre-test deltas for constructing final (operational test) forms to meet developed statistical specifications were studied. Data were examined from five subject…

The agreement between item response theory-based and Mantel Haenszel (MH) methods in identifying biased items on tests was studied. Data came from item responses of four spaced samples of 1,000 examinees each--two samples of 1,000 Anglo-American and two samples of 1,000 Native American students taking the New Mexico High School Proficiency…

Diagnostic testing can provide specific information about student skills as a decision-making aid to teachers in prescribing instruction, identifying needs for remediation, determining effective instructional materials and methods, and ultimately, improving student learning. Diagnostic testing, as viewed here, includes individual and group…

The successful Wisconsin Title 1 project item bank offers a valid, flexible, and efficient means of providing migrant student tests in reading and mathematics tailored to instructor curricula. The item bank system consists of nine PASCAL computer programs which maintain, search, and select from approximately 1,000 test items stored on floppy disks…

Teacher questions have been the subject of a substantial amount of research and analysis in recent years. Debate has centered around the appropriate use of this instructional and evaluative tool. A study examined the impact on student achievement of manipulating abstractness-concreteness, independent of cognitive level, in achievement test items.…

The third section of this two-volume report examines the utility of the model developed in section I for application in a classroom testing situation. The model was applied in arithmetic classes through a weekly testing program. The teacher specified the generic task being taught, tests were constructed using a table of random numbers to select…

The competencies, item specifications, and sample items for the reading measures devised for the Wisconsin Competency-Based Testing Program are provided in this booklet. Following lists of reading competencies to be tested for grades three, seven, and ten, the booklet presents guidelines used in preparing the tests and test items; general item…

The purposes of the present study were to ascertain whether or not two particular formatting characteristics influenced seventh grade student performance on math tests. One research question focused on the effects of decimal positioning in multiple choice options for computational items. In a second question, labeling format was compared with…

Many researchers have suggested that the cause of differential item functioning (DIF) can in part be due to the misspecification of the supporting trait distribution (STD). This paper demonstrates how a unidimensional item response theory (IRT) calibration of response data, generated from a two-dimensional IRT model, results in DIF when the…