Policymakers have grown increasingly interested in how experimental results may generalize to a larger population. However, recently developed propensity score-based methods are limited by small sample sizes, where the experimental study is generalized to a population that is at least 20 times larger. This is particularly problematic for methods…

Trends in International Mathematics and Science Study (TIMSS) is an international comparative study designed to measure trends in mathematics and science achievement at grades 4 and 8, as well as to collect information about educational contexts (such as students' schools, teachers, and homes) that may be related to student achievement. TIMSS has…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

The scoring scheme of the National Assessment of Educational Progress (NAEP) is studied, as well as techniques for estimating its reliability. NAEP data are collected on students of age 13 in the fall, age 9 in the winter, and age 17 in the spring. The scoring task, involving hand scoring of open-ended items, may vary between 25,000 responses to…

This handbook describes the procedures used to administer and analyze the results of the 1978-79 national music assessment of the National Assessment of Educational Progress (NAEP). It also describes changes in procedures between the first NAEP music assessment conducted in 1971-72 and the 1978-79 assessment. Each assessment surveyed the music…

The third (1978-79) of three writing assessments conducted by the National Assessment of Educational Progress (NAEP) is reported. The writing achievement of American 9-, 13-, and 17-year-olds was surveyed using a deeply stratified, multistage probability sample design. The specific procedures used in the assessment to develop objectives and…

This paper examined the status of assessment of writing as it is currently performed in the United States. All fifty states and the District of Columbia responded to a survey requesting information on their testing programs. Twenty-six states and the District of Columbia were found to assess writing on the statewide level, and eight states were in…

The National Assessment of Educational Progress (NAEP), often called the "Nation's Report Card," is the only nationally representative, continuing assessment of what U.S. students know and can do in various subject areas. NAEP provides a comprehensive measure of students' learning at critical junctures in their school experience. The…

This is a final report of support received through the National Institute of Education (NIE) to assist in research on the writing ability of United States children. The study began under the auspices of the International Association for the Evaluation of Educational Achievement (IEA) in order to contribute to a cross national assessment of…

As mandated by Congress, the National Assessment of Educational Progress (NAEP) surveys the educational accomplishments of U.S. students and monitors changes in those accomplishments. NAEP tracks the educational achievement of 4th, 8th, and 12th graders over time in selected content areas, and has been tracking achievement for 30 years. The goals…

Issues related to achieving adequate national norms are reviewed, and a new methodology is proposed that would work to provide a true measure of national achievement levels on an annual basis and would enable reporting results in current-year norms. Statistical methodology and technology could combine to create a national norming process that…

This handbook describes the procedures used to develop, administer, and analyze the results of the 1978-79 art assessment of 9-year-olds, and 17-year-olds by the National Assessment of Educational Progress (NAEP). The primary purpose of the handbook is to provide detailed procedural information for people interested in replicating the assessment…

The Third International Mathematics and Science Study (TIMSS) is the most ambitious study conducted by the International Association for the Evaluation of Educational Achievement to date. TIMSS developed and administered tests and questionnaires in three student populations to study achievement in participating countries and the factors associated…

The Third International Mathematics and Science Study (TIMSS) developed and administered tests and questionnaires in three student populations to document the quality of mathematics and science education in 45 participating countries. Study design, instrument development, and research procedures were achieved through a complex collaborative…

Details of the design and data analysis associated with the 1988 National Assessment of Educational Progress (NAEP) are presented. The 1988 NAEP surveyed American students' knowledge of reading, writing, civics, U.S. history, and geography. Small-scale studies were conducted for mathematics and science. Populations included public school students…