By tailoring test forms to the test-taker's proficiency, Computerized Adaptive Testing (CAT) enables substantial increases in testing efficiency over fixed forms testing. When used for formative assessment, the alignment of task difficulty with proficiency increases the chance that teachers can derive useful feedback from assessment data. The…

Two-phase testing assesses individual performance (phase 1) and then allows collaborative learning within small groups (phase 2). While groups typically outperform individuals, less is known about the social decision schemes that influence member collaboration. In a classroom setting, we compared individual and group performance on a standard test…

In the attempt to identify or prevent unfair tests, both quantitative analyses and logical evaluation are often used. For the most part, fairness evaluation is a pragmatic attempt at determining whether procedural or substantive due process has been accorded to either a group of test takers or an individual. In both the individual and comparative…

In this study we examined variations of the nonequivalent groups equating design for tests containing both multiple-choice (MC) and constructed-response (CR) items to determine which design was most effective in producing equivalent scores across the two tests to be equated. Using data from a large-scale exam, this study investigated the use of…

We used collaborative testing in a veterinary physiology course (65 students) to answer the following questions: 1) do students with individual correct responses or students with individual incorrect responses change their answers during group testing? and 2) do high-performing students make the decisions, that is, are low-performing students…

National tests, an influential assessment practice in many countries in East Asia, are often blamed as obstacles to good instructional practices. In this paper, the positive impact of assessment, national tests in particular, is discussed using the case of Singapore. The first part of the paper includes an analysis of items from the primary grade…

This study explored the impact of individual versus two-person group testing on graduate students' achievement and motivation to learn while enrolled in a 16-lesson educational research methods course. Students in two sections of the course were exposed to the same content and instructional methods, with one exception: students in one section took…

The LOGTRUE program can be used to obtain a scale of equated raw scores for two tests with parameter estimates on a common item response theory scale. The program derives its name from the method of logistic true score equating described by Lord (1980). The method can be applied to two tests with overlapping items administered to different groups…

Techniques for maximizing discrimination between groups in norm referenced measurement to reflect sensitivity to group differences inherent in the evaluation of multilevel educational systems are discussed. Data from the Beginning Teacher Evaluation Study (BTES) were used to examine relationships between reading and mathematics achievement and…

A method for measuring recognition memory (free of distractors) and false recognition was based on the assumption that the subject was "honest." A distractor-free test of word recognition (a single-item test trial in which the 36 targets were presented prior to the 36 distractors) was compared with a traditional target-distractor…

In the specific methods of standard setting in testing, judgments about individuals being tested, contrasting groups being tested, and judgments about the test items are discussed. In judgments about individual test-takers, assumptions are presented based on the knowledge and skills the test is intended to measure, the test-takers' skills at the…

Selective Testing provides students with equivalent test options that control the sequence and quantification of individual items. Essay and objective test construction is modified to allow the student to combine units and create an individualized test. An example of a test on the American Revolution is presented. (FG)

Technical considerations associated with item selection and reliability assessment are considered in relation to criterion-referenced tests constructed to provide group information. The purpose is to emphasize test building and the evaluation of test scores in program evaluation studies. It is stressed that an evaluator employ a performance or…

Procedures devised for computing factor matching statistics in questionnaire construction are described. In a study of the impact of vocational education on social, affective and nontechnical development of students, an attitude questionnaire to measure outcomes was developed. Each item in the final section had a six-point Likert type response…

This technical note describes part of the work done to develop student achievement tests in reading and mathematics for use in a later phase of the Beginning Teacher Evaluation Study. While the achievement battery consists primarily of group-administered multiple-choice test items, several individual-testing studies were conducted to examine the…