This study is an evaluation of the psychometric issues associated with estimating objective level scores, often referred to as "subscores." The article begins by introducing the concepts of reliability and validity for subscores from statewide achievement tests. These issues are discussed with reference to popular scaling techniques, classical…

Demands for accountability have seen the implementation of large scale testing programs in Australia and internationally. There is, however, a growing body of evidence to show that externally imposed testing programs do not have a sustained impact on student achievement. It has been argued that teacher assessment is more effective in raising…

This study examines the practical implications of using state tests to measure student achievement in impact evaluations that span multiple states and grades. In particular, the study examines the sensitivity of impact findings to (1) the type of assessment used to measured achievement (state tests or an external assessment administered by the…

Multiple uses of the same assessment may present challenges for both the design and use of an assessment. Little advice, however, has been given to assessment developers as to how to understand the phenomena of multiple assessment use and meet the challenges these present. Particularly problematic is the case in which an assessment is used for…

The U.S. Department of Education has not yet published an official guidance document for using NAEP achievement level scores to confirm state testing results. A review of the literature, however, identified four principles that inform the valid use of NAEP scores in a confirming analysis. The principles address the appropriate NAEP statistics to…

Interest scales designed to provide educational and vocational guidance to midshipmen at the U.S. Naval Academy were developed from the Strong Vocational Interest Blank. Three of the scales provided an index of similarity between a person's interests and the interests of previous graduates from each of the Academy's three academic areas:…

Because districts in Nebraska are not measured on common instruments, comparisons are difficult. This study examined a district evaluation strategy that classifies districts into school performance ratings (SPR) based on a combination of three factors. Student performance and non-cognitive indicator data for three grade levels and two content…

In the United States, tests are held to high standards of quality. In developing countries such as Malawi, psychometricians must deal with these same high standards as well as several additional pressures such as widespread cheating, test administration difficulties due to challenging landscapes and poor resources, difficulties in reliably scoring…

Having implemented a testing procedure using the Gates-MacGinitie Reading Tests to identify recruits with reading deficiencies, the United States Navy conducted a study comparing the performance of recruits on three different reading tests. A total of 716 recruits completed the comprehension portion of the Gates-MacGinitie Reading Tests, the Tests…

Explores issues involved in using assessments to define standards and encourage efforts to meet them and compares the European examination system with the American testing system. Also considered are issues of the definition of learning domains in ways that do not encourage narrowly focused training on specific assessment items. (SLD)

In the fall of 1988, a stratified sample of courses at City, Mesa, and Miramar colleges in the San Diego Community College District (California) were surveyed as part of a skills assessment research project. For classes into which students were placed on the basis of assessment test scores (in English writing and reading, and mathematics), student…

A study evaluated the effectiveness of pretesting infantry soldiers scheduled to take written Skill Qualification Tests (SQT) in order to determine their training needs prior to official testing. During the study, researchers developed and field-tested a pretest for the SQT that was based on the 11B1 Infantryman Soldier's Manual and the 1980 SQT…

For assessments that present problems that require extended responses and substantial amounts of time, there is often a desire to allow students to choose which problem they will respond to among two or more options. Student choice of problem may allow students a better opportunity to demonstrate what they know and are able to do. On the other…

The York Region Board of Education in Ontario, Canada, screens students for giftedness in grade 3. This report analyzes data produced in the 1986-87 screening procedure, involving approximately 3,400 students. The report begins with a review of procedural changes that were designed to make the screening more effective and efficient than earlier…

This paper summarizes an investigation of applications and issues in free response (FR) testing during 1989. It draws on ideas from the results of the National Educational Longitudinal Study 1988 (NELS:88) field test, a seminar series at the Educational Testing Service (ETS), working papers prepared for several FR testing applications, and…