One of the main limitations of the current generation of computer-based tests is its dependency on the multiple-choice item. This research was aimed at extending computer-based testing by bringing limited forms of performance assessment to it in the domain of mathematics. This endeavor involves not only building task types that better reflect…

The use of constructed response items in large scale standardized testing has been hampered by the costs and difficulties associated with obtaining reliable scores. The advent of expert systems may signal the eventual removal of this impediment. This study investigated the accuracy with which expert systems could score a new, non-multiple choice…

The use of scientific calculators on standardized mathematics tests is becoming more common, and how their use affects the standardized testing process continues to be a topic of study. This study extends previous work by examining test item characteristics and equity issues, asking whether items designed to be "calculator neutral"…

A study was conducted to develop a test that is able to capture knowledge of an intuitive nature, such as that acquired through discovery learning. The proposed test format is called the "what-if test." Test items in this format consist of the presentation of a situation. A change in the situation is introduced, and learners have to…

The booklet is part of a grade 10-12 social studies series produced for bilingual education. The series consists of six major thematic modules, with four to five booklets in each. The interdisciplinary modules are based on major ideas and designed to help students understand some major human problems and make sound, responsive decisions to improve…

An approach is described that reveals the hierarchical test structure (HTS) based on the cognitive demands of the test items, and conducts a linear trait modeling by using the HST elements as item difficulty components. This approach, referred to as the Hierarchical Latent Trait Approach (HLTA), employs an algorithm that allows all test items to…

A previous simulation study of methods for assessing item functioning (DIF) in computer-adaptive tests (CATs) showed that modified versions of the Mantel-Haenszel and standardization methods work well with CAT data. In that study, data were generated using the three-parameter logistic (3PL) model, and this same model was assumed in obtaining item…

It has previously been shown by M. Beller (1990) that an additive tree (Addtree, a hierarchical tree representation of similarity data developed by S. Sattath and A. Tversky in 1977), may be useful for representing the structure between tests and items through the similarity among them as measured by their intercorrelations. In this study, the…

"Pickleball" is a new racquet sport which is one of the fastest growing educational activities in the Northwest. This paper describes the development of a test battery designed to measure students' pickleball skills for purposes of classification; to determine improvement of playing skills; and to aid in grading of individual…

An alternative to multiple-choice testing is suggested for educational assessment. The use of what is called "multiple-rating items" is proposed. A multiple-rating item calls for the examinee to rate all of a set of things instead of picking one as with a multiple-choice item. The respondent has to provide a specific rating of each…

Constructed-response formats are desired for measuring complex and dynamic response processes that require the examinee to understand the structures of problems and micro-level cognitive tasks. These micro-level tasks and their organized structures are usually unobservable. This study shows that elementary graph theory is useful for organizing…

The performance of the following four methodologies for assessing unidimensionality was examined: (1) DIMTEST; (2) the approach of P. W. Holland and P. R. Rosenbaum; (3) linear factor analysis; and (4) non-linear factor analysis. Each method is examined and compared with other methods using simulated data sets and real data sets. Seven data sets,…

In this paper a quadratic curve equating method for different test forms under a random-group data-collection design is proposed. Procedures for implementing this method and related issues are described and discussed. The quadratic-curve method was evaluated with real test data (from two 30-item subtests for a professional licensure examination…

Results obtained using three methods for gathering attitude data were compared. The methods are ranking, paired comparisons, and the Likert-type scale. Three attitude objects, each consisting of five items, were selected or developed for this study. One set had been used with graduate students previously. Participants were 392 students in…

This paper reports the results of using a three-layer backpropagation artificial neural network to predict item difficulty in a reading comprehension test. Two network structures were developed, one with and one without a sigmoid function in the output processing unit. The data set, which consisted of a table of coded test items and corresponding…