We provide evidence of validity for a newly developed diagnostic competence model of operation sense, by both (a) describing the theoretically substantiated development of the competence model in close association with its use within a large-scale formative assessment and (b) providing empirical evidence for the theoretically described cognitive…

In this commentary, the author addresses what is referred to as the deterministic input, noisy "and" gate (DINA) model. The author mentions concerns with how this model has been formulated and presented. In particular, the author points out that there is a lack of recognition of the confounding of profiles that generally arises and then discusses…

On a general level, the objective of diagnostic classifications models (DCMs) lies in a classification of individuals regarding multiple latent skills. In this article, the authors show that this objective can be achieved by multidimensional adaptive testing (MAT) as well. The authors discuss whether or not the restricted applicability of DCMs can…

Two techniques for writing achievement test items to accompany instructional materials are contrasted: writing items from statements of instructional objectives, and writing items from semi-automated rules for transforming instructional statements. Both systems resulted in about the same number of faulty items. (Author/JKS)

Technical considerations associated with item selection and reliability assessment are considered in relation to criterion-referenced tests constructed to provide group information. The purpose is to emphasize test building and the evaluation of test scores in program evaluation studies. It is stressed that an evaluator employ a performance or…

This resource paper is a guide for planning and developing instructionally relevant tests of student learning at the classroom, building, or district level. It is based on a model of instruction and testing which systematically uses assessment information to support and facilitate instructional improvement. Course goals and objectives are first…

An empirical review of test items is described as an essential step in criterion-referenced test development. The concept of test items' instructional sensitivity is introduced, and research is briefly reviewed which describes four theoretical contexts in which instructional sensitivity indexes have been observed: criterion-referenced; classical…

This report was written to provide guidance in the development and evaluation of alternative instructional approaches that hold promise of improving instructional effectiveness. The main focus of the report is on how to identify and test interactive relationships between individual differences among learners and instructional conditions or…

Describes design of an item bank for use with lower ability mathematics students in Scottish secondary schools. Aspects of bank usage discussed include raw score translation to measures on validated scales, test design for various purposes, and ways of recording and analyzing results. Test examples with corresponding outputs are given. (Author/MBR)

In the assessment of second/foreign language proficiency, we are entering the era of criterion-referenced assessment as language learning is being recognized as an integrative, multifaceted construct. Norm-referenced measurement (NRM) is compared with criterion-referenced measurement (CRM). CRM is characterized by attention to skill, whereas NRM…

The historical background of mastery learning is discussed and related to the use of the traditional normal curve and to the nature of curves which express more adequately the mastery learning concept. It is suggested that the mastery model calls for strategies that: inform students about course expectations; set standards of mastery in advance;…

The American College Testing Program is developing a new program, Work Keys, a system to develop and assess employability skills. It consists of four components: (1) a systematic process for profiling job skill requirements; (2) assessments that measure learners' job skill levels; (3) procedures and formats for conveying assessment results so they…

This instructional training package introduces practitioners to methods for developing, validating, using, and reporting criterion-referenced tests. It provides a comprehensive presentation of criterion-referenced testing technology. The package emphasizes the most recent substantive and technological advances in the field that are both important…

The content characteristics of the Test of English as a Foreign Language (TOEFL) are examined from a communicative viewpoint, based on current theory in applied linguistics and language proficiency assessment. The study employed a four-part operational framework. The first component analyzed the communicative characteristics of a language…

This volume contains the initial draft of a model for assessing students in vocational education programs in Georgia. Addressed in the first section of the draft are some of the components that are believed to be critical in the development of a model for assessing vocational student achievement, including selecting a program for use in developing…