The effects of a school district's testing and evaluation activities cannot be effectively assessed without an understanding of the explicit and implicit goals embedded in the policies and practices of the district. A structured workshop process to elicit a district's intentions related to the effects--uses and impacts--of testing and evaluation…

Yearly administrations of a standardized achievement test are a part of the educational process in many school districts in the United States. The Systemwide Testing Program in the Austin Independent School District Office of Research and Evaluation has gradually developed a process and support materials whereby the test administrations are a tool…

The strengths and weaknesses of the National Assessment of Educational Progress (NAEP) are discussed. The NAEP estimates the number of students who are more likely to do certain problems correctly than other students. NAEP reports the numbers, briefly describes the problems, and says that more students need to do these problems correctly. The…

Schools that are concerned with evaluating their programs need more than just the average scaled assessment scores from standardized tests. To help schools, the Massachusetts Educational Assessment Program produces school and district reports that contain the stories behind the averages. These reports describe the kind of students who took the…

Considerable evidence suggests that policy-makers, educators, the media, and the public do not understand national and state test results. The problems appear to be two-fold: the scales on which scores are reported seem confusing, and the report forms themselves are often too complex for the intended audiences. This paper addresses two topics. The…

Identifies important criteria for assessing the quality of educational research and applies these 20 identified criteria to 2 recent international comparative studies in education, the Second International Science Study and the first International Assessment of Educational Progress. The major types of criteria are utility, propriety, and accuracy.…

In light of the National Education Goals of 1990, several arguments against any federally funded large-scale census approach to the assessment of college student learning in the United States are presented to clarify challenges to an objective of Goal 5, which specifies that "the proportion of college graduates who demonstrate advanced…

An outline is provided for a national educational assessment and improvement plan as suggested by the National Education Goals of 1990. The following implicit assumptions underlie National Education Objective 5.5: (1) abilities to think critically, communicate effectively, and solve problems can be defined and the definitions can be agreed upon as…

The role and influence of mandated testing in educational reform are reviewed. Mandated testing refers to large-scale (districtwide or statewide) multiple-choice testing programs used for policy purposes of evaluation and accountability, which includes nationally normed standardized achievement tests and tests custom-developed to reflect state and…

What can be learned from the experience of analyzing jobs and testing employees in industry that can help advance the goal of assessing and improving college performance is summarized. It is apparent that grades, the traditional way of measuring college performance, do not explain much about one's performance in employment. There are two areas…

This paper extends a series of studies examining school district report cards, which began with investigations of Tennessee's report card data. Since 1988, the Texas State Board of Education has produced a report card on each school district to report district-level data. Texas district report card items were organized into student outcome…

This paper presents the latest in a series of studies examining school district report cards for their usefulness planning and implementing school improvement. The 1992-93 Arkansas report cards were studied. These were similar to the report cards from Tennessee that were the subject of the initial study in that they used and reported a…