Focusing on the use of "paper and pencil" criterion-referenced tests in educational measurement, and to correct misconceptions, the definitions of basic terms and historical antecedents are discussed. Classifications of the tests are compared with other achievement tests. The phases in developing criterion-referenced tests are presented with the…

Item analysis procedures appropriate for domain-referenced classroom testing are described. A conceptual framework within which item statistics can be considered and promising statistics in light of this framework are presented. The sampling fluctuations of the more promising item statistics for sample sizes comparable to the typical classroom…

Although effective and efficient assessment procedures are crucial to the success of organizational training programs, the tests used for both student and program evaluation are often developed by instructional designers (IDS) and subject matter experts (SMEs) with little formal training in test development. This paper summarizes the major…

Beginning discussions and exploratory work on criterion-referenced measurement are reviewed in this commentary on the author's 1963 address to the American Educational Research Association on issues of measurement and the development of educational technology. Many problems foreseen at that time remain current. (SLD)

The term "criterion-referenced measurement" has been so frequently used that accumulated surplus meaning has sometimes swamped the fundamental concept. Stripping away extraneous interpretations affirms the contemporary relevance of the concept. Substituting the term "construct-referenced" underscores the need for better…

Three kinds of instructionally sensitive achievement tests are described which provide useful information on formal schooling proficiencies: placement, progress, and attainment tests. Procedures to design, develop, and empirically verify attainment and placement tests are presented. The methodology is designed to ensure that the test instruments…

The rise of criterion-referenced measurement from 1970 to 1984 was an important period in test development. Since 1984 there has been less research published on criterion-referenced measurement, but there is ample evidence that the concept remains important, especially in the authentic measurement and performance assessment movements. (SLD)

A basic understanding of criterion-referenced test (CRT) use and development is presented with definitions and characteristics of CRTs. The steps necessary to construct and validate a CRT, the appropriate use of CRTs, the historical development of CRTs, and terms used in conjunction with CRTs are discussed. The most common definition of a CRT is a…

The Maryland State Department of Education issued a request for proposals to develop a score reporting system for the Maryland Functional Testing Program. RMC Research Corporation conducted a literature review of extant literature and developed a national survey of non-norm-referenced test score reporting practices. This comprehensive analysis of…

This paper proposes that instructional validity (i.e., the extent to which teachers actually teach the skills that are tested) should be part of the test development process. The development of a district-wide ninth-grade math exam for General Mathematics I (GMI) in the Charleston County School District, South Carolina, is used to illustrate how a…

This paper discusses and describes an industry-based process for the design and development of criterion-referenced tests in vocational-technical subject areas to support vocational program evaluations. The following topics are covered in the paper: (1) use of criterion-referenced tests; (2) test design; (3) preparation of test materials; and (4)…

As part of a major effort to raise student achievement, Colorado schools have been putting into place rigorous academic content standards that spell out the skills and knowledge students should acquire in core subject areas. This guide contains information about part of this effort, the new Colorado Student Assessment Program (CSAP), to help…

The new Colorado Student Assessment Program (CSAP) was developed to provide a measurement of how well students and schools are meeting Colorado's academic content standards. The CSAP tests are not norm-referenced showing how much a student has learned in comparison with other students. Instead, they are based on the state's content standards.…

This book is designed to help K-12 teachers and administrators understand the nature of standardized tests and, in particular, the scores that result from them. This useful manual helps teachers develop the skills necessary to incorporate these test scores into various types of instructional decision making--a process known as "data-driven…

This study examines two kinds of French language tests originating from the Threshold-Level (T-Level) or Niveau-Seuil theory of language learning in the context of several linguistic and testing concepts: discrete-point testing with regard to notions and functions from T-Level theory, communicative context, and assessment of listening…