Introduction: The What Works Clearinghouse (WWC) reviews rigorous research on educational interventions with a goal of identifying "what works" and making that information accessible to educators and policymakers. The WWC has historically prioritized internal validity over external validity in rating the quality of research. One critique…

Recent methods to improve generalizations from nonrandom samples typically invoke assumptions such as the strong ignorability of sample selection, which is challenging to meet in practice. Although researchers acknowledge the difficulty in meeting this assumption, point estimates are still provided and used without considering alternative…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

In this article, the authors review International Large-Scale Assessment (ILSA)-based research over the last several decades, with specific attention on cross-national analysis of mean differences between and variation within countries in mathematics education. They discuss the role of sampling design and "opportunity to learn" (OTL)…

Educational assessment and, more broadly, educational research in the United States have entered into an era characterized by a dramatic increase in the prevalence and importance of test score use in accountability systems. This volume covers a selection of contemporary issues about testing science and practice that impact the nation's public…

It is argued in this paper that generalizability theory provides a uniquely useful framework for defining and quantifying the dependability of data for decision making. It does so by requiring careful specification of the conditions of measurement and the anticipated sources of variation in the results of the measurement procedure. A distinction…

The Early Childhood Longitudinal Study (ECLS) is a new study that will focus on children's early school experiences beginning in kindergarten. Approximately 23,000 children will be selected as they enter kindergarten and followed through fifth grade. Base-year data will be collected in the fall of 1998, but there will a field test in the 1996-97…

A review of the National Assessment of Educational Progress (NAEP), which originated 20 years ago, is presented; and the original political, ideological and social science assumptions for the design of NAEP are examined. The report criticizes the founding principle as hampering NAEP's maximum utility and exploratory power. In examining the form of…

Quantitative educational research with ethnic minorities has a long history, characterized by assumptions that are still operative, such as the assumption that the white male is the standard against which other groups should be compared. It has also been assumed that assessment instruments are applicable across all groups, and that sources of…

The National Assessment is a plan for a systematic survey of knowledges, skills, understandings, and attitudes. The development of citizenship assessment described in this paper typifies the processes undergone for each subject--art, career and occupational development, citizenship, literature, mathematics, music, reading, science, social studies,…

Previous research studies revealed that teachers' background characteristics (mainly educational trade experience, and teaching experience levels) had different effects on teaching experience. Since an examination of teaching effectiveness should be considered in the teacher certification process, the study focused on determining the effects of…

Assessment generally refers to large-scale, system-wide measurement programs for pupil diagnosis; pupil certification; program evaluation; research; accountability; resource allocations; or teacher evaluation. The purpose of assessment should determine the test content, construction, administration, and examinees sampled. Assessment methods for…

In April 1991, members of the Kentucky Educational Research Association (KERA), held a conference to discuss performance assessment and its use in Kentucky schools. The following papers from the conference are included: (1) "Our Conference and the Performance Assessment Committee" (S. Kifer); (2) "Performance Assessment: A National…

This paper provides an overview of common sampling methods (both the good and the bad) likely to be used in community college self-evaluations and presents the results from several simulated trials. The report begins by reviewing various survey techniques, discussing the negative and positive aspects of each method. The increased accuracy and…