This chapter addresses the psychometric challenges in assessing English language learners (ELLs) and students with disabilities (SWDs). The first section addresses some general considerations in the assessment of ELLs and SWDs, including the prevalence of ELLs and SWDs in the student population, federal and state legislation that requires the…

This study conducted a meta-analysis of computer-based and paper-and-pencil administration mode effects on K-12 student mathematics tests. Both initial and final results based on fixed- and random-effects models are presented. The results based on the final selected studies with homogeneous effect sizes show that the administration mode had no…

Considers how the movement toward inclusive classrooms has enhanced significantly disabled students' opportunities for increased social interaction with their peers and it coincidentally has brought with it learning and achievement challenges for students as well as for their teachers and parents. Finds that the concept of treatment acceptability…

Describes a system in which questions tailored to the examinee's capabilities are administered by computer. Enumerates possible benefits of the system, reviews the "state of the art," and predicts potential applications of computerized adaptive testing. (MCG)

Requirements for adaptive testing are reviewed, and the reasons implementation has taken so long are explored. The adaptive test is illustrated through the Stanford-Binet Intelligence Scale of L. M. Terman and M. A. Merrill (1960). Current adaptive testing is tied to the development of item response theory. (SLD)

This article summarizes results from tests that have allowed examinee choice of test items. It paints a bleak psychometric picture for the use of examinee choice within fair tests. Choice is anathema to standardized testing unless the aspects that characterize the test are irrelevant to what is being tested. (SLD)

Application of computer-assisted testing (CAT) to measurement in the Portland (Oregon) Public Schools is described. Focus is on MicroCAT's developmental subsystem, which allows creation of items and test design specifications. Changes in CAT procedures allowing MicroCAT to function in existing testing systems and uses/limitations of MicroCAT…

The utility of item response theory (IRT) models in computerized adaptive tests is considered. Measurement questions that have been answered using IRT, and those that might be overlooked because of IRT, are reviewed. Areas in which fuller use of IRT could improve adaptive testing practices are identified. (SLD)

Reviews the development and use of mass testing procedures for evaluating large groups of relatively homogeneous individuals and suggests computer adaptive testing as an alternative to conventional testing. Highlights include the evaluation of public education and higher education; needs assessment; summative evaluation; adaptive testing; and…

Computerized adaptive tests (CATs) make it possible to estimate the ability of each student during the testing process. The computer presents items to students at the appropriate level, and students take different versions of the same test. Computerized testing increases the flexibility of test management in that: (1) tests are given on demand and…

Issues that must be addressed in the large-scale application of computerized adaptive testing are explored, including considerations of test design, scoring, test administration, item and item bank development, and other aspects of test construction. Possible solutions and areas in which additional work is needed are identified. (SLD)

Two modification formulas are presented for the test information function in order to provide better measures of local accuracies of the estimation of "theta" when maximum likelihood estimation is used to provide the estimate of ability "theta." A minimum bound of any estimator, biased or unbiased, is considered; and Formula 1…

This paper reviews the salient characteristics of the current inventory of large-scale achievement tests, analyzes two recent proposals for creating a national testing program, and describes a new approach to statewide and nationwide testing that RAND is examining. Section 2 discusses the criteria typically used for evaluating large-scale testing…

This paper reviews 18 microcomputer software item banks on an individual basis. Software Programs reviewed are AIMS (Academic Instructional Measurement System); CREATE-A-TEST; Exam Builder; Exams and Examiner; MicroCAT; Multiple Choice Files; P.D.Q. Builder; Quiz Rite; Teacher Create Series (5 programs); TAP (Testing Authoring Program); TestBank…

The development of a hypothetical testing program designed to provide optimum information about student achievement is chronicled. Computer adaptive testing and performance testing are postulated as part of the program. What optimum information really means is discussed. Optimum is only optimal when theory and application are balanced. (SLD)