It is so easy to criticize the SAT that most observers overlook the weaknesses of its architect, the College Board. This author contents that, until the latter is replaced, however, the former will never be fixed. The College Board has every incentive to create a complex, stressful, expensive college admissions system. Because it is accountable to…

This study examines the practical implications of using state tests to measure student achievement in impact evaluations that span multiple states and grades. In particular, the study examines the sensitivity of impact findings to (1) the type of assessment used to measured achievement (state tests or an external assessment administered by the…

Issues in designing valid tests for the National Assessment of Educational Progress (NAEP) are discussed. Test scores are often provided without any information on the nature of the tasks represented. Because test domains are defined by individual item writers, the generalizability between tests and items is suspect. While typical content…

The U.S. Department of Education has not yet published an official guidance document for using NAEP achievement level scores to confirm state testing results. A review of the literature, however, identified four principles that inform the valid use of NAEP scores in a confirming analysis. The principles address the appropriate NAEP statistics to…

This study addressed statistical techniques that might ameliorate some of the sampling problems currently facing states with small populations participating in State National Assessment of Educational Progress (NAEP) assessments. The study explored how the application of finite population correction factors to the between-school component of…

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

This content assessment project is designed to determine what social studies content should be tested on national standardized tests and how that content should be defined. Sixteen historians, political scientists, and social studies educators were interviewed to identify key concepts. In a second phase, the cultural literacy rationale for content…

This letter is an interim response to the October 7, 1991 request from the Committee on Education and Labor and the Subcommittee on Elementary, Secondary, and Vocational Education of the House of Representatives asking for a review of the National Assessment Governing Board (NAGB) achievement levels for the National Assessment of Educational…

This paper discusses the rationale for enhancing the current National Assessment of Educational Progress (NAEP) design by adding a capacity for adaptive testing. Items are tailored to the achievement level of the student in adaptive testing. The report describes a 1993 Ohio field trail of two-stage assessment carried out by the National Opinion…

The validity of criterion-referenced interpretations of the proficiency scales of the National Assessment of Educational Progress (NAEP) is discussed. A major goal of the NAEP scales is to describe student achievement in specific content areas from grade 3 (age 9 years) through grade 11 (age 17 years). The numerical values for NAEP scales are…

The scales of the National Assessment of Educational Progress (NAEP), as constructed, do not yield meaningful criterion-referenced interpretations. Poorly defined NAEP goals and the present knowledge base do not allow the measurement of what examinees can and cannot do. Inappropriate interpretations of NAEP data are discussed, with specific…

A needs assessment of the National Assessment of Educational Progress (NAEP) is presented. It deals with cost, design and technical issues, and utility. Suggestions include cost reduction via assessment schedule cutbacks and re-use of released NAEP exercises; and a shift from federal to private funding by selling NAEP exercises with interpretative…

Three key terms--social studies, values, and attitudes--are discussed in relation to a national assessment in social studies. Definitions of these terms will affect decisions about what and how to assess. Two major approaches define social studies as: (1) social sciences simplified and adapted for pedagogical purposes; or (2) that portion of the…

This paper presents arguments in favor of adding reading achievement at age seven to the National Assessment of Educational Progress (NAEP). Progress in reading is developmental. At age seven, most children are in the midst of the crucial stage of beginning reading; by age nine, those making normal progress have moved beyond this stage. Much of…

The National Assessment of Educational Progress (NAEP) is working to increase the numbers of students with disabilities (SD) or limited English proficient (LEP) students who are included in the assessment. Information is presented on the changes made to the inclusion criteria, the types of accommodations being offered, new procedures implemented…