In this paper, performance assessments are cast within a sampling framework. A performance assessment score is viewed as a sample of student performance drawn from a complex universe defined by a combination of all possible tasks, occasions, raters, and measurement methods. Using generalizability theory, the authors present evidence bearing on the…

Details of the design and data analysis associated with the 1988 National Assessment of Educational Progress (NAEP) are presented. The 1988 NAEP surveyed American students' knowledge of reading, writing, civics, U.S. history, and geography. Small-scale studies were conducted for mathematics and science. Populations included public school students…

Longitudinal studies conducted with children typically experience non-response problems that can make substantial inroads on sample size and introduce bias into the analysis. Three methods for limiting non-response in school-based research programs were assessed: (1) asking parents to return consent forms only if they do not want their children to…

A review of the literature on a variety of issues related to testing vocabulary knowledge in a second language addresses these topics: problems in estimating vocabulary size, including the related questions of what constitutes a word, how a sample should be selected, and what are the criteria for knowing a word; sampling the basic and specialized…

Alaskan students' scores on the Scholastic Aptitude Test (SAT) increased nine points between 1984 and 1985, matching the national gain. These scores marked the fourth year of increases following 17 years of consistently declining scores. Thirty-three percent of Alaska's high school seniors took the SAT in 1985. The combined score of 923 was 17…

The stability of Rasch test item difficulty parameters was investigated under varying conditions. Data were taken from a mathematics achievement test administered to over 2,000 Australian students. The experiments included: (1) relative stability of the Rasch, traditional, and z-item difficulty parameters using different sample sizes and designs;…

Information collected by the Bureau of the Census in the March 1986 and 1987 supplements to the Current Population Survey (CPS) shows changes in selected demographic, social, and economic characteristics of the Hispanic population of the United States since 1982. The Hispanic civilian noninstitutional population increased by 4.3 million (or 30%)…

This guide begins with a series of questions and answers that introduce Pennsylvania's Educational Quality Assessment (EQA) Inventory as a 188- to 190-item multiple-choice test for grades 5, 8, and 11. Items are selected from a 400-item bank using matrix sampling procedures. Test results are analyzed at the school level; no individual student…

The introduction of the trial state assessment program into the design of the 1990 National Assessment of Educational Progress (NAEP) raises questions about differences across states in sampling and administration practices. In addition, questions about the general approach to comparing state data to national data need discussion. Subject areas…

This interim report of a pilot year impact study on evaluation methodology is part of a series of documents on the evaluation of Project Developmental Continuity, a Head Start demonstration program aimed at promoting educational and developmental continuity between children's Head Start and primary school experiences. This report deals with…

A broad spectrum of methodologies pertinent to studies of schooling effects are reviewed. Methodological issues and problems are addressed according to a three-dimensional conceptual framework: (1) indicators of schooling effects; (2) study approaches; and (3) units of analysis. Problems and uses of status attainment and difference scores as…

This phase of the downstate Illinois bilingual education program included: locating all past data still in existence in 1976; determining what data were actually retrievable and usable; reporting on these data retrospectively; and finally, collecting new data for a continuing longitudinal study. There were 44 school districts with 4,579 students…

Activities involved in the collection and assembling of data for computer processing from the first followup survey of the National Longitudinal Study of the High School Class of 1972 (NLS) are briefly described. Included are an overview of the NLS; the sample design and survey participation; the development of the first followup survey…

Project TALENT, the Equality of Educational Opportunity Survey, and the Base-Year Survey of the National Longitudinal Study tested national probability samples of American high school seniors in 1960, 1965, and 1972. This study is concerned with the feasibility of using these data for studying trends in educational attainment. Three separate…

To meet several pre-evaluation goals of the national Emergency School Aid Act (ESAA) Evaluation study, the following activities that were undertaken are described: selection of an achievement measure; a pretest of this measure to assess student needs in schools eligible to receive funds under the Act (schools with a minority enrollment of 50…