This qualitative case study examined the process Northcentral Technical College (NTC), a two-year institution, navigated to design and implement a standardized prior learning assessment (PLA) program. With the projected labor market shortage, PLA is one strategy colleges have been recommended to use to provide the opportunity for students to apply…

This report describes the foundation and rationale for a framework designed to measure reading literacy. The aim of the effort is to build an assessment system that reflects current theoretical conceptions of reading and is developmentally sensitive across a prekindergarten to 12th grade student range. The assessment framework is intended to…

In many testing programs it is assumed that the context or position in which an item is administered does not have a differential effect on examinee responses to the item. Violations of this assumption may bias item response theory estimates of item and person parameters. This study examines the potentially biasing effects of item position. A…

The need for increased exam security, improved test formats, more flexible scheduling, better measurement, and more efficient administrative processes has caused testing agencies to consider converting the administration of their exams from paper-and-pencil to computer-based testing (CBT). Many decisions must be made in order to provide an optimal…

This paper provides a history of ETS's role in developing assessment instruments and psychometric procedures for measuring change in large-scale national assessments funded by the Longitudinal Studies branch of the National Center for Education Statistics. It documents the innovations developed during more than 30 years of working with…

An integer programming approach to item pool design is presented that can be used to calculate an optimal blueprint for an item pool to support an existing testing program. The results are optimal in the sense that they minimize the efforts involved in actually producing the items as revealed by current item writing patterns. Also, an adaptation…

The report presents a screening and identification model for use with primary children to identify giftedness. The procedure is designed to be objective and employs multiple selection criteria. The Bayesian approach is used as it applies a probability methodology. The steps in instrument development include, among others, a review of the relevant…

This brief makes the case for thoughtful district- or school-driven assessment systems that complement and go beyond what statewide testing systems are able to accomplish. It describes important attributes of model local assessment programs and presents the necessary steps for building a local assessment program that will elicit information that…

Note that judgments about the relationship of test items to actual job duties have generally been made as a single comparison, proposes a model for analyzing the accuracy of translations for each step of the process of test development for use in personnel administration, and suggests scaling procedures appropriate for the various judgments. (JM)

Psychometricians continue to develop and evaluate methods for linking test scores, both horizontally and vertically. This article describes a social moderation process for articulating (i.e., linking) performance standards across grade levels for an operational state assessment program. The researchers used generated data to evaluate the likely…

The Dallas Independent School District (DISD) is rapidly progressing from the position of having an assessment program that does not work to the position of having an assessment program that does work. The perception that assessment is separate from instruction has changed to a view of assessment as part of a four-stage model including planning,…

This paper presents an evaluation of Army job training development and testing practices, with a focus on Advanced Individual Testing. Information comes from intensive interviews with school instructors and from observations in the schools. Results indicate that some aspects of the Instructional Systems Development (ISD) model have been…

A defense of the System of Multicultural Pluralistic Assessment (SOMPA) in response to previous articles in this issue of this journal is presented by the test developer. The defense is detailed and addresses each previous article. (JKS)

Establishing and refining a framework for performance assessment is especially difficult in large-scale settings that can involve hundreds of judges and thousands of students. This presentation advocates the interactive use of two complementary analytic perspectives and illustrates the approach in the context of the College Entrance Examination…

Educational refinement is defined as attempts to improve education through incremental improvements in the existing structure, while educational reform refers to change in the structure itself. A strong move is underway to reform education in the United States. It is argued that the development of assessments in support of educational reform…