The effective evaluation of correctional programs is critically important. However, research in corrections rarely allows for the randomization of offenders to conditions of the study. This limitation compromises internal validity, and thus, causal conclusions can rarely be drawn. Increasingly, researchers are employing propensity score matching…

This policy brief summarizes the positive results of a rigorous evaluation of Reading Partners, a widely used program that offers one-on-one tutoring provided by community volunteers to struggling readers in low-income elementary schools. A total of 1,265 students in 19 schools in three states were randomly assigned to receive Reading…

The Tennessee General Assembly passed legislation in 2007 requiring that the State Board of Education produce an assessment on the effectiveness of teacher training programs. The law requires that the report include data on the performance of each program's graduates in the following areas: placement and retention rates, Praxis II results, and…

This article presents a creative and practical process for dealing with the problem of selection bias. Taking an algorithmic approach and capitalizing on the known treatment-associated variance in the X matrix, we propose a data transformation that allows estimating unbiased treatment effects. The approach does not call for modelling the data,…

KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term…

KIPP (Knowledge is Power Program) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. Prior studies (see Tuttle et al. 2013) have consistently found that attending a KIPP middle school positively affects student achievement, but few have addressed longer-term…

Describes how to measure whether students are making significant gains in reading. (JM)

Misuses of null hypothesis significance testing are reviewed and alternative approaches are suggested for carrying out and reporting statistical tests that might be useful to program evaluators. Several themes, including the importance of respecting the magnitude of Type II errors and describing effect sizes in units stakeholders can understand,…

Many program evaluations involve some type of statistical testing to verify that the program has succeeded in accomplishing initially established goals. In many cases, this takes the form of null hypothesis significance testing (NHST) with t-tests, analysis of variance, or some form of the general linear model. This paper contends that, at least…

This manual is a first effort to begin to identify, describe, and develop procedures for assessing various aspects of digital reference service. Its overall purpose is to improve the quality of digital reference services and assist librarians to design and implement better digital reference services. More specifically, its aim is to: assist…

The Workshop on Integrating Federal Statistics on Children provided a forum for assessing strengths and shortcomings of existing and proposed federal statistical data sources for children and families. In particular, these data sources were assessed with respect to their capacity to fill the most pressing information needs of those who formulate,…

Constructs a model that explains a large fraction of the variance in political science departmental rankings. Divides the objective predictors into two sets: one reflecting faculty quality ratings of department members, the other the effects of circumstances beyond a department's control. This model works well with most social science disciplines.…

Asserts that variance between a university's reputation as an institution and its commitment to research have a greater impact on political science department rankings than any internal factors within the department. Includes several tables showing statistical variables of department and university rankings. (MJP)

Analyzes the National Research Council's rating of political science departments and discovers the ratings reflect two general sets of characteristics, the size and productivity of the faculty. Reveals that the quality and impact of faculty research is more important than the overall output. Includes tables of statistical data. (MJP)