Preschool education is increasingly being recognized as an integral part of efforts to ensure that all children enter school ready to learn and as a way to help close the achievement gaps that exist at the time children enter kindergarten. Such efforts are growing across the country. According to the most recent data, 54 different preschool…

A large body of literature documents the central importance of fidelity of program implementation in creating an internally valid research design and considering such fidelity in judgments of research quality. The What Works Clearinghouse (WWC) provides web-based summary ratings of educational innovations and is the only rating group that is…

In large-scale assessments, such as state-wide testing programs, national sample-based assessments, and international comparative studies, there are many steps involved in the measurement and reporting of student achievement. There are always sources of inaccuracies in each of the steps. It is of interest to identify the source and magnitude of…

"Voice" is widely considered to be a feature of effective writing. It's no surprise, then, that voice criteria frequently appear on rubrics used to score student essays in large-scale writing assessments. However, composition theorists hold vastly different views regarding voice and how it should be applied in the evaluation of student writing, if…

Although the Angoff procedure is among the most widely used standard setting procedures for tests comprising multiple-choice items, research has shown that subject matter experts have considerable difficulty accurately making the required judgments in the absence of examinee performance data. Some authors have viewed the need to provide…

Over the past several decades, a wider range of assessment strategies has gained prominence in classrooms, including complex assessment items such as individual or group projects, student journals and other creative writing tasks, graphic/artistic representations of knowledge, clinical interviews, student presentations and performances, peer- and…

In "Holding Accountability to Account: How Scholarship and Experience in Other Fields Inform Exploration of Performance Incentives in Education"--a paper presented at the National Center on Performance Incentives research to policy conference in February--Richard Rothstein, a research associate at the Economic Policy Institute, argues educational…

Examines principles to consider when evaluating the impact of outdoor-based experiences, including developing a rationale for the evaluation, determining the emphasis of the evaluation, and applying appropriate criteria to the evaluation process. Discusses difficulties associated with control groups, sampling bias, time period of evaluation, and…

The thesis of this paper is that, in evaluating most innovative educational projects that are conducted in schools, tenets of formal experimental design and associated inferential data analysis methods should be given limited emphasis. The basis of this thesis lies in the problems and difficulties that undermine the design and implementation of…

The use of online discussion boards has grown extensively in the past 5 years, yet some researchers argue that our understanding of how to use this tool in an effective and meaningful way is minimal at best. Part of the problem in acquiring more cohesive and useful information rests in the absence of a comprehensive, theory-driven metric to assess…

This document is comprised of the 1997 issues of a quarterly newsletter of the Harvard Family Research Project, designed to share new ideas and experiences in evaluating systems reform and comprehensive child and family services. The first issue focuses on evaluation methodology and includes articles on the following topics: (1) mixing evaluation…

This report highlights the input of leaders at a national meeting in October 2001 to discuss an evaluation framework for the family support field. The meeting marked the beginning of the Evidence Along the Way National Family Support Evaluation Project, an initiative to develop a comprehensive framework for evaluating how well the family support…

Describes the goals of assessment in early childhood education programs, suggesting that assessment plans should focus on knowledge, skills, dispositions, and feelings. Argues that the younger children are, the more errors are made in assessment, and that efforts should therefore balance global and specific assessments. Suggests assessment…

Discussions were held with administrative staff and evaluators from the New York City Public Schools in order to identify sources of data for evaluating special education programs. Data which are generally available include: (1) citywide reading test scores; (2) number of diplomas issued; (3) number of students decertified; (4) number of students…

This report discusses an oversight investigation of the Department of Education's Publication and Audio Visual Council (PAVAC) and its successor, the Publications Review Board (PRB). Background information is provided about the review process for publications and products; the Women's Educational Equity Act (WEEA) program; educational laboratories…