The effectiveness of an optimal item selection method in designing parallel test forms was studied during the development of two forms that were parallel to an existing form for each of three language arts tests for fourth graders used in the Connecticut Mastery Test. Two listening comprehension forms, two reading comprehension forms, and two…

This report deals with the question of obtaining insights into states of prior knowledge and exploring knowledge state tests and knowledge state profiles. The first part introduces a few basic terms important in the context of prior knowledge state. Evaluation and the validity, reliability, and usefulness of tests are considered in a prior…

This study provides information about the total and component scores of the Test of English as a Foreign Language (TOEFL). First, the study provides comparative global and component estimates of test-retest, alternate-form, and internal-consistency reliability, controlling for sources of measurement error inherent in the examinees and the testing…

In 1991 the Measurement and Evaluation Center of the University of Texas at Austin was asked to develop a test for credit by examination in four lower division courses in Japanese. The test (in Japanese) was constructed from locally developed items provided by instructors of Japanese. The developed test consisted of 80 items distributed among…

The development of an inventory to measure self-regulated learning is reported. The first step involved the generation of an item pool based on a literature review. A pool of items was developed based on the five identified factors of metacognition, learning strategies, motivation, contextual sensitivity, and environmental utilization and control.…

The Second International Mathematics Study was conducted in 20 countries under the sponsorship of the International Association for Evaluation of Educational Achievement (IEA). Among the instruments used in this study was a questionnaire investigating student attitudes about school, instruction, and mathematics. The fit of an a priori model that…

Although few question the positive impacts alternative forms of assessment can have on instruction, concerns about the psychometric quality of data obtained from such assessments are taking their toll. Scoring issues are at the heart of many of these concerns. This paper addresses the causes of these concerns: misinformation about psychometric…

Available test score evidence does not support the common claim that student achievement has declined. On the other hand, the existing evidence cannot be used to prove that student achievement has risen. This paper offers reasons why student achievement in the past cannot be compared accurately with student achievement today: (1) tests, curricula,…

This book examines approaches to the evaluation of students' critical thinking on programmatic, school-based, and classroom levels. The first chapter examines the nature of critical thinking and offers a definition as well as an appraisal of the definition. The second chapter looks at methods of gathering quality information on students' critical…

This packet contains the user's manual and profile sheets for the Vocational Assessment Protocol (VAP), a functional skills profile of vocational-related factors intended for use in the vocational rehabilitation of persons who have acquired a traumatic brain injury. The VAP consists of nine structured rating instruments and a structural summary…

Three of the most challenging problems in the custody evaluation field follow from: (1) the difficulties involved in adapting data derived from group studies or traditional tests into a form for individual cases; (2) the absence of clear and compelling guidelines to aggregate the information collected in a comprehensive evaluation; and (3) the…

The evolution of the West African Examinations Council (WAEC) Senior School Certificate Examination (SSCE) and certification process is traced. The challenges posed by combining, for certification purposes, the scores from internal and external assessments of school candidates are discussed in the face of the low reliability of teachers'…

The Individualized Quality of Life Scale (IQOLS) is a two-component scale designed to measure the quality of life (QOL) of cancer patients. The two components are the patient's satisfaction with 14 different life areas and the importance of the life areas to the individual. By combining the two components, an overall QOL score can be obtained that…

A study examined the underlying factor structure of the aptitude tests and work samples being completed by students with educational disadvantages (limited reading and mathematics skills) who were assessed with the current assessment model in the Akron (Ohio) Public Schools. The amount of variance accounted for by the factors was also…

A study at Brigham Young University (Utah) investigated the feasibility of computer-assisted language placement testing in higher education. Benefits and problems of this approach for test administration, individualization of item selection, and recordkeeping were examined. Four steps were followed in production of a test for Spanish placement:…