The microcomputer has increased interest in performance testing, which samples what a person can do rather than what he or she knows. Conventional psychometric theory is based on knowledge tests, but in performance testing the unit of analysis is a trial, and it is unreasonable to assume that mean performance and interim correlations are…

Current issues in the literature on the testing of linguistic and communicative proficiency are reviewed and discussed in relation to reading comprehension testing. Several theoretical issues in language testing are discussed, including testing purposes and test validity. Areas of concern regarding methods of testing reading comprehension are then…

This report summarizes the results of research designed to study the psychometric and technological feasibility of adaptive testing to assess spatial ability. Data was collected from high school students on two types of spatial items: three-dimensional cubes and hidden figure items. The analysis of the three-dimensional cubes focused on the fit of…

For many years personalization of achievement testing has been impossible in all but the simplest forms. Recently, item response theory (IRT), or latent trait theory, has emerged as a valuable tool which brings far greater flexibility to the process than had previously been possible. The single parameter Rasch Model, a mathematical model developed…

This report discussed the following questions in regard to testing, measurement and evaluation in the Indiana public schools: (1) Where are we? (2) Is "where we are" different from where we perceive we should be? (3) Do teachers feel competent in testing? (4) How are teachers' skills viewed by their "superiors," the central…

Monte Carlo simulation was used to investigate score bias and information characteristics of Owen's Bayesian adaptive testing strategy, and to examine possible causes of score bias. Factors investigated in three related studies included effects of item discrimination, effects of fixed vs. variable test length, and effects of an accurate prior…

A computerized adaptive testing version of the Armed Services Vocational Aptitude Battery (CAT-ASVAB) is being developed to test ten areas of vocational aptitude. Development of the CAT-ASVAB is based upon the use of item banks, testing and scoring procedures, assessment of test reliability and test validity, a technical manual, and the…

Although most interactive systems seem to facilitate user work, the system described--an interactive examination system--increased the time required by as much as 100 percent. Students taking an exam interactively and on paper were videotaped. Analysis showed the extra time went to system overhead, think time, and trouble understanding what to do.…

Discusses changes in testing as a result of the availability of extensive inexpensive computing and some recent developments in statistical test theory. Describes the role of the Computerized Adaptive Test (CAT) and modern Item Response Theory (IRT) in ability testing tailored to each student's knowledge and ability. (JAC)

Discusses the potential role of technology in evaluating learning outcomes in large-scale, widespread science assessments. Describes current state-of-the-art techniques in this area and looks at the past and future uses of technology in large-scale science assessments. (LZ)

Discusses the research and steps needed to develop performance-based and computer-adaptive assessments that are culturally responsive. Supports the development of a new conceptual framework and more explicit guidelines for designing culturally responsive assessments. (SLD)

Describes the use of the Northwest Evaluation Association's Achievement Level Test for Reading as an assessment tool in an elementary school to measure student progress in reading. Discusses interpreting scores across grade levels; computerized versions; linking test items to new curriculum; reducing reading class size; and the role of technology.…

The author, an executive director of Assessment and Accountability for the Poway Unified School District, relates how their school district implemented an assessment program with practical applications to teaching and learning. Rather than being yet another burden on teachers or a local report card on schools, the district's goal was to define…

In this paper we report on research related to the provision of automated feedback based on a computer adaptive test (CAT), used in formative assessment. A cohort of 76 second year university undergraduates took part in a formative assessment with a CAT and were provided with automated feedback on their performance. A sample of students responded…

Automatic test generating system in distributed computing context is one of the most important links in on-line evaluation system. Although the issue has been argued long since, there is not a perfect solution to it so far. This paper proposed an innovative approach to successfully addressing such issue by the seamless integration of genetic…