Community-based education programs must demonstrate effectiveness to various funding sources. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810) had the goal of determining if state level programs with varied curriculum could use a common evaluation tool to demonstrate efficacy. Results in parenting and youth…

This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

Systematic evaluation is an essential tool for understanding program effectiveness. This article describes the pilot test of a statewide evaluation tool for the Supplemental Nutrition Assistance Program-Education (SNAP-Ed). A computer algorithm helped Community Nutrition Educators (CNEs) build surveys specific to their varied educational settings…

Community coalitions (CCs) have labored with some difficulty to demonstrate empirical evidence of effectiveness in preventing a wide range of adolescent problem behaviors. Training and technical assistance (TA) have been identified as important elements in promoting improved functioning of CCs. A reliable, valid, and inexpensive method to assess…

A set of procedures were developed for evaluating the State Capacity Building Programs; (SCBP), state projects for increasing facilities for the dissemination of information related to education. Six scales were developed, based on questionnaire items, to evaluate the following six facets of state information-dissemination systems: comprehensive…

The Pennsylvania Plan for Educational Quality Assessment is discussed as to its beginnings, its goals, its implementation, and its future. The plan aids schoolmen of the State in assessing the quality of education their schools are providing in relation to 10 goals, which propose to encourage the students to develop self-understanding,…

This paper examines the content of The California Critical Thinking Skills Test (1990). This report is not a statistical review. Instead it brings under scrutiny the content of the exam. This content will be of interest to the general reader, because the issues range from logic to ethics to pedagogy, and to questions of evidential and…

The 1992-93 school year saw the second statewide implementation of the Vermont portfolio-assessment program, and RAND continued its ongoing evaluation of the program's implementation, effects, and data quality. While the first year's study found evidence of the impact of the assessment program and low reliability of portfolio scoring, this year's…

The 1992-93 school year was the second year of the implementation of the Vermont assessment program. Evaluation of the 1991-92 year yielded mixed results, with some evidence that the assessment program was having a strong impact on instruction, but other indications that the reliability of the portfolio scoring in both writing and mathematics was…

Technical questions regarding the reliability and validity of large-scale portfolio assessment were studied which focused on: (1) whether raters can score collections of writing reliably with rubrics designed for single samples; (2) whether ratings derived from different frameworks differ in their capacities to support technically sound…

School effectiveness indices (SEIs), based on regressing test performance onto earlier test performance and a socioeconomic status measure, were obtained for eight subject-grade combinations from 485 South Carolina elementary schools. The analysis involved school means based on longitudinally matched student data. Reading and mathematics…

State and federal mandates for education reform call for increased accountability and the inclusion of students with disabilities in all accountability efforts. In the rush to implement high-stakes education reforms, particularly those involving tests or assessments, the particular needs of students with severe cognitive disabilities are only now…

In response to a prevailing demand for better quality education in public schools in Pennsylvania, procedures were developed to measure the adequacy and the efficiency of the educational programs in public schools. The objectives currently assessed are in the following areas: communication skills (reading and writing), mathematics, self-esteem,…