This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

This article discusses the practical application of mixed quantitative and qualitative designs. Mixed methods designs can be especially powerful in illuminating policy solutions and directions for social action, thus supporting the social justice goals of social work and other helping professions. However, the decision to combine methods must be…

In 2009, the National Center for Postsecondary Research (NCPR) launched an evaluation of eight developmental summer bridge programs in Texas to assess whether these programs reduce the need for developmental coursework and improve student outcomes in college. The evaluation uses an experimental design to measure the effects of these programs on…

This article presents lessons learned from an innovative employment and training program for dislocated workers. It provides specific information about program design and serves as a prototype for how social experimentation can be used by state and local governments. (Author/LMO)

An evaluation system which would describe and assess statewide services for preschool children is described. Component theory conceptualizes the unit of analysis for evaluation as the component. This approach increases the generalizability and utilization of evaluations and enhances the ability to evaluate several programs at the state level.…

This monograph reviews issues in research on the effects of using accommodations for students with disabilities who are included in educational assessments, particularly state and district assessments. Following an introductory overview, a section provides background on the need for good research on accommodations. The paper then defines commonly…

This report describes the technical assistance rendered to the NIE-sponsored R&D Utilization Program (R&DU) by the contractor working with the NIE staff, the Center for the Study of Evaluation, and the seven R&DU projects, to develop cross-project instrumentation, develop mutually acceptable plans for data collection and analysis, and…

This document presents the research proposal and supporting documents for a study to evaluate the process of developing a comprehensive dissemination capacity in State Education Agencies (SEAs) and to assess the impact of the capacity building activities in the states, addressing two questions: Is dissemination capacity being built and, if so,…

Plans are presented for the overall design of the longitudinal evaluation of the National Institute of Education's State Capacity Building Program. Both the process of developing comprehensive dissemination capacity in state education agencies, and the impact of the capacity building activities will be studied. This report describes the…

This report describes the comprehensive evaluation study of the California State Preschool Program which involved elementary school children in educationally disadvantaged areas throughout California. Various test scores of approximately 6000 children in kindergarten, first, and second grade who had previously participated for at least a year in…

Chapter 2 of the Education Consolidation and Improvement Act places responsibility for the design and implementation of programs using Chapter 2 funds in the hands of local education agencies, and it assigns responsibility for administering the regulations to state education agencies. No formal mechanism exists, however, for coordinating the…

The Primary Reading Program was initiated in 117 classrooms in 40 North Carolina schools, to improve the reading achievement of the primary school students. The same number of control classrooms were also selected for comparison. Features of the program included increased funding for instructional materials; use of volunteers and teacher aides for…

In 1983 a number of reports were issued calling for the reform of elementary and secondary education in the United States. This paper describes a methodology for a study that will compare and contrast reliable information across the southeastern states about the implementation of actual reform initiatives, using a framework of 41 major categories…

A historical antagonism between the advocates of quantitative evaluation methods and the proponents of qualitative evaluation methods has stymied the recognition of the value to be gained by utilizing both methodologies in the same study. The integration of quantitative and qualitative methods within a single evaluation has synergistic effects in…

The paper describes the instruments and procedures for collecting process information (information describing components of the planned educational process) for the Management Information System for Occupational Education (MISOE). The selection of variables and the decision to assess interactive rather than isolated process variables are…