Knowledge is an important predictor and outcome of learning and development. Its measurement is challenged by the fact that knowledge can be integrated and homogeneous, or fragmented and heterogeneous, which can change through learning. These characteristics of knowledge are at odds with current standards for test development, demanding a high…

Intelligence tests and adaptive behavior scales measure vital aspects of human functioning. Assessment of each is a required component in the diagnosis or identification of intellectual disability. The present study investigated the population correlation between intelligence and adaptive behavior using psychometric meta-analysis. The main…

This study determines a clinical cutting score for the 29-item Abuse Behavior Inventory (ABI) developed by Shepard and Campbell (1992) to measure both physical and psychological abuse experiences. The authors report on a sample of 392 White and African American women from primary care waiting rooms, who completed the ABI and the revised Conflict…

Seventeen statistics for measuring the reliability of criterion-referenced tests were critically reviewed. The review was organized into two sections: (1) a discussion of preliminary considerations to provide a foundation for choosing the appropriate category of "reliability" (threshold loss function, squared-error loss-function, or…

Explores the consequence of failing to incorporate measurement error in the development of cut scores in criterion-referenced measures, using the example of Texas and the Texas Assessment of Academic Skills to illustrate the impact of measurement error on false negative decisions. Findings support those of W. Haney (2000). (SLD)

The history and institutional use of cutoff scores is reviewed, emphasizing the changes in these scores used over the years and the rationale used in selecting cutoff scores. A brief description of the College Level Examination Program (CLEP) is provided, as is background about how it works. Cutoff score recommendations of the American Council on…

Issues involved in standard setting along with methods for standard setting are reviewed, with specific reference to their relevance for criterion referenced testing. Definitions are given of continuum and state models, and traditional and normative standard setting procedures. Since continuum models are considered more appropriate for criterion…

A dozen different approaches that yield 13 reliability indices for criterion-referenced tests were identified and grouped into three categories: threshold loss function, squared-error loss function, and domain score estimation. Indices were evaluated within each category. (Author/RL)

Exams which are periodically updated and revised also require a revision of the cut score to ensure that examinees who take the original form of the test, and those taking the revised form, are scored on an equivalent basis. This paper discusses available standard setting procedures as applied to establishing minimum passing scores for licensing…

Discrepancies among the standards produced by different criterion-referenced standard-setting techniques may be the result of a failure to adequately define the minimally competent candidate. Current research in this area is reviewed in terms of three categories: studies in which no formal assistance in conceptualization is given to judges,…

The author examines previous efforts to establish certifying examinations for high school students and their effects on curriculum and students, particularly minorities. Also, to introduce readers to the rest of this theme issue on testing, he briefly discusses test validity, cutoff scores, and effects on teachers. (SJL)

Suggestions are provided for future research in item bias detection, reduction of essay-reader variation in setting cut-score levels, and limitations of equating theory. (TJH)

In light of the widespread use of competency testing, the authors consider that it is important to determine ways of developing and using competency testing to insure that it achieves its full potential. The paper, in three parts, introduces a model for the development and validation of competency tests, reviews several methods for setting…

Three basic areas of definition, measurement, and research, voiced as concerns by members of the National Council of Measurement in Education (NCME) to its Task Force on Measurement Problems in Competency-Based Programs, are used as an organizer for a sponsored symposia and the papers in this monograph. The problem of the definition of competency…

This paper provides a historical review of the changes and improvements made in estimating numerical cutpoints for the National Assessment of Educational Progress (NAEP). While reviewing the various methodologies used for collecting judgment data, the paper discusses: (1) the incorporation of Item Response Theory for setting standards; (2)…