Community-based education programs must demonstrate effectiveness to various funding sources. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810) had the goal of determining if state level programs with varied curriculum could use a common evaluation tool to demonstrate efficacy. Results in parenting and youth…

This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

Systematic evaluation is an essential tool for understanding program effectiveness. This article describes the pilot test of a statewide evaluation tool for the Supplemental Nutrition Assistance Program-Education (SNAP-Ed). A computer algorithm helped Community Nutrition Educators (CNEs) build surveys specific to their varied educational settings…

The Pennsylvania Plan for Educational Quality Assessment is discussed as to its beginnings, its goals, its implementation, and its future. The plan aids schoolmen of the State in assessing the quality of education their schools are providing in relation to 10 goals, which propose to encourage the students to develop self-understanding,…

Focusing on the problems of assessing the speaking skills of secondary school students, this paper provides one example of how those problems were addressed in the Massachusetts speaking assessment. The paper identifies four requirements for measures of speaking skills: (1) feasibility, (2) reliability, (3) validity, and (4) freedom from bias. The…

State Departments of Education are turning to the use of criterion referenced, as opposed to norm referenced, models for statewide assessment. The underlying assumption in this turn of events is that results generated by criterion referenced tests within the statewide assessment context permit the drawing of value inferences about the…

This paper examines the content of The California Critical Thinking Skills Test (1990). This report is not a statistical review. Instead it brings under scrutiny the content of the exam. This content will be of interest to the general reader, because the issues range from logic to ethics to pedagogy, and to questions of evidential and…

The meaning of standardized achievement testing to 50 third-grade teachers was investigated through a construct validation procedure using questionnaires and structured open-ended interviews. Subjects were from 18 schools performing distinctly above or below prediction on the Delaware Educational Assessment Program Longitudinal Study.…

Results of a 1987 report indicating that elementary students of all states were above the national average are assessed. Issues addressed include teaching for standardized tests, the effect of teaching on national norms, and alternatives available to protect the integrity of instruction and the validity of normed test scores. (TJH)

The 1992-93 school year saw the second statewide implementation of the Vermont portfolio-assessment program, and RAND continued its ongoing evaluation of the program's implementation, effects, and data quality. While the first year's study found evidence of the impact of the assessment program and low reliability of portfolio scoring, this year's…

The process used by the Texas Education Agency to update public school teacher certification tests in a statewide program in Texas is described. The testing program implemented is called the Examination for the Certification of Educators in Texas. After a policy review, advisory committees for 63 test areas prepared content frameworks, created…

In 1987, a survey report by J. Cannell was published criticizing state reports based on national standardized testing of elementary school students that indicated that all 50 states were above the national average. This phenomenon--known as the "Lake Wobegon Effect"--is analyzed. Technical problems with the study are considered. (TJH)

This survey of educators examined validity issues in Arizona's program of authentic assessment of written communication. The paper concludes that authentic measures lack meaningful standards. Major flaws were reported in the areas of "fairness,""transfer and generalizability,""content quality," and…

California has provided other states with an example of how not to assess student writing and has initiated a new direction in the statewide assessment of student writing achievement, a direction designed to influence writing instruction positively. Before 1987, the California Assessment Program (CAP) limited English skills assessment to multiple…

Officials with the National Center for Education Statistics asked the National Research Center's Board on Testing and Assessment to convene a workshop to assist them with their decisions about reporting results for accommodating test takers. The day-long workshop brought together four panels of representatives from state assessment offices,…