The American College Testing Program (ACT) routinely evaluates the fit of its tests to the curriculum of high schools nationwide to ensure that what is being assessed reflects what is being taught as necessary for college success. This report describes the steps ACT has taken to ensure that the content foundations of the ACT Assessment Mathematics…

This paper describes an approach that states and local districts might use to develop a coordinated assessment system so that information collected at state and local levels about programs under Title I of the Improving America's Schools Act (IASA) would be complementary and not redundant. The reauthorization of Title I provides a unique…

This manual explains how to construct a questionnaire. It is intended for the novice researcher who has little experience in questionnaire construction. The first seven chapters discuss the following seven stages in questionnaire development: (1) establishing the guiding questions; (2) operationalizing and clarifying the guiding questions; (3)…

This study examines the linguistic features of the National Assessment of Educational Progress (NAEP) mathematics test items and investigates the significance of language-related variables for NAEP's assessment in the content area of mathematics. The continuing increase in the number of language minority students in classrooms nationwide has…

This study aims to evaluate the degree to which the achievement level descriptions adopted by the National Assessment Governing Board (NAGB) for the 1992 assessment in mathematics accurately represent what students at a given achievement level can do. NAGB descriptions of the levels were used to form lists of statements about what students at a…

In an effort to improve instruction related to psychometrics and psychological testing for beginning psychology majors, an approach was developed at Pennsylvania's Ursinus College that incorporates active, participatory learning and problem solving. The approach is used in a course on research methods and makes use of a networked computer system…

A composite behavioral indicator of high school effectiveness was developed that measures the degree to which schools strike a balance between the press for academic excellence and the need to keep all students actively engaged in schooling. This proposed "participation" indicator is based on behavioral outcomes with demonstrated…

Teachers must have accurate, up-to-date knowledge about biodiversity in order to help prepare world citizens to cope with the problems of decreasing variability on our planet. The objectives of this study were to: (1) develop a reliable, valid test of teacher knowledge about biodiversity; (2) administer this test to K-12 teachers to determine…

To help increase the understanding of sources of difficulty in test items, a study was undertaken to evaluate the effects of various aspects of prose complexity on the difficulty of achievement test items. The items of interest were those that presented a verbal stimulus followed by a question about the stimulus and a standard set of…

Computerized adaptive testing (CAT), while well-grounded in psychometric theory, has had few large-scale applications for high-stakes, secure tests in the past. This is now changing as the cost of computing has declined rapidly. As is always true where theory is translated into practice, many practical issues arise. This paper discusses a number…

The Board on Testing and Assessment of the National Research Council convened a workshop in 1994 to help policymakers and others better understand the complex issues emerging from the standards-based educational reform movement. This bulletin synthesizes the workshop discussions. It is organized around four major themes that emerged from the…

Three methods for the estimation of the reliability of single dichotomous items are discussed. All methods are based on the assumptions of nondecreasing and nonintersecting item response functions and the Mokken model of double monotonicity. Based on analytical and Monte Carlo studies, it is concluded that one method is superior to the other two…

In this digest a rationale is given for using open-ended questions in the assessment of student achievement, the use of open-ended questions in reading is discussed, and some implications for the classroom are outlined. Research has helped shift the focus from learning as content knowledge per se to learning as the ability to use and interpret…

The quality of fit between the data and the measurement model is fundamental to any discussion of results. Fit has been the subject of inquiry since as early as the 1920s. Most early explorations concentrated on assessing global fit or subset fits on fixed length, traditional paper and pencil tests given as a single unit. The detection of aberrant…

This collection contains four papers that were presented as part of a short course delivered at the 1991 annual meeting of the Speech Communication Association. The papers discuss various aspects of the development and use of "The Competent Speaker," a public speaking assessment instrument designed for the college sophomore level. The papers and…