This study is an evaluation of the psychometric issues associated with estimating objective level scores, often referred to as "subscores." The article begins by introducing the concepts of reliability and validity for subscores from statewide achievement tests. These issues are discussed with reference to popular scaling techniques, classical…

Demands for accountability have seen the implementation of large scale testing programs in Australia and internationally. There is, however, a growing body of evidence to show that externally imposed testing programs do not have a sustained impact on student achievement. It has been argued that teacher assessment is more effective in raising…

This study examines the practical implications of using state tests to measure student achievement in impact evaluations that span multiple states and grades. In particular, the study examines the sensitivity of impact findings to (1) the type of assessment used to measured achievement (state tests or an external assessment administered by the…

In the United States, tests are held to high standards of quality. In developing countries such as Malawi, psychometricians must deal with these same high standards as well as several additional pressures such as widespread cheating, test administration difficulties due to challenging landscapes and poor resources, difficulties in reliably scoring…

Having implemented a testing procedure using the Gates-MacGinitie Reading Tests to identify recruits with reading deficiencies, the United States Navy conducted a study comparing the performance of recruits on three different reading tests. A total of 716 recruits completed the comprehension portion of the Gates-MacGinitie Reading Tests, the Tests…

In the fall of 1988, a stratified sample of courses at City, Mesa, and Miramar colleges in the San Diego Community College District (California) were surveyed as part of a skills assessment research project. For classes into which students were placed on the basis of assessment test scores (in English writing and reading, and mathematics), student…

A study evaluated the effectiveness of pretesting infantry soldiers scheduled to take written Skill Qualification Tests (SQT) in order to determine their training needs prior to official testing. During the study, researchers developed and field-tested a pretest for the SQT that was based on the 11B1 Infantryman Soldier's Manual and the 1980 SQT…

This paper summarizes an investigation of applications and issues in free response (FR) testing during 1989. It draws on ideas from the results of the National Educational Longitudinal Study 1988 (NELS:88) field test, a seminar series at the Educational Testing Service (ETS), working papers prepared for several FR testing applications, and…

Committees on Content Analysis and Correlation Studies were appointed by the Alabama State Superintendent of Education to provide information regarding the similarities and differences between the Californa Achievement Tests (CAT), Levels 13-C and 16-C, and the Alabama Basic Competency Tests (BCT), grade 3 and 6. The major purpose of these…

Testing and assessment that are "more authentic" (performance-based or alternative) represent the most pressing issue in education today. Some of the major criticisms leveled at standardized testing are examined, and the advantages and disadvantages of more authentic assessment are reviewed. A general direction for integrating traditional and…

Interest scales designed to provide educational and vocational guidance to midshipmen at the U.S. Naval Academy were developed from the Strong Vocational Interest Blank. Three of the scales provided an index of similarity between a person's interests and the interests of previous graduates from each of the Academy's three academic areas:…

Comparative data and results of validation and standard-setting studies are presented for five subject-matter tests for teacher certification in two states. The five tests evaluated were available from the Educational Testing Service (ETS): one National Teacher Examination specialty area test (special education); and four tests from a consortium…

In 1991, a study was conducted to determine the differential effects of placement testing on cultural, linguistic, and ethnic groupings in the San Diego Community College District (SDCCD). The study was conducted in two parts. The first part examined the characteristics of the students used to norm the Comparative Guidance Program (CGP) tests used…

The National Academy of Education Panel is providing the intellectual leadership and coordination for an independent evaluation of the 1990 and 1992 Trial State Assessments (TSA) of the National Assessment of Educational Progress (NAEP). These instruments provide state-by-state comparisons of educational achievement, which is the first such use of…

The Statewide Testing Program assessed the achievement of South Carolina students in grades 3, 6, and 11. The Comprehensive Tests of Basic Skills, Form S (CTBS/S) were used to measure achievement in reading, language, mathematics, reference skills, science, and social studies. Over 126,000 students, representing 91 of South Carolina's 92 school…