When attempting to determine if an intervention has a causal impact, the "gold standard" of program evaluation is the randomized controlled trial (RCT). In education studies random assignment is rarely feasible at the student level, making RCTs harder to conduct. School-level assignment is more common but this often requires considerable resources…

Virtual Comparison Groups (VCG) were developed by the Northwest Evaluation Association as an alternative to conventional controlled experiments for social science researchers working in the field of education. The VCG is generally a group of up to 51 students who are matched, based on key characteristics of the student and school, to a single…

Nonrandom assignment of students to teachers can bias value-added estimates of teachers' causal effects. Rothstein (2008, 2010) shows that typical value-added models indicate large counterfactual effects of fifth-grade teachers on students' fourth-grade learning, indicating that classroom assignments are far from random. This article quantifies…

This methodology report provides technical information about the development, design, and conduct of the fifth-grade data collection of the Early Childhood Longitudinal Study, Kindergarten Class of 1998-99 (ECLS-K). It begins with an overview of the ECLS-K study. Subsequent chapters provide information on the development of the instruments, sample…

In this article, we elaborate methodologies to study construction of knowledge in argumentative activities. For this purpose, we report on a quasi-empirical study on construction of knowledge through successive argumentative activities on a controversial issue. A group of 120 fifth grade students participated in successive argumentative…

Some empirical data are presented concerning the use of cloze tests to measure children's proficiency in a bilingual educational program. The subjects were grade five students in their sixth year of a primary French immersion program. (Author/CFM)

Interpersonal Process Recall (IPR) is a technique in which audiotapes are used to evoke students' memories concerning their own thinking. Reports a study using IPR to probe elementary students' (n=17) thinking during a problem-solving situation. Concluded that IPR has potential in classroom research. (MDH)

A detailed description is provided of the variable allocated learning time (ALT), which is part of the analysis in phase I of the Evaluation of Practices in Individualized Schooling. The variable is defined; the questionnaires on which the variable is based are listed, the procedures used to scale the variable are explained; the distribution of…

This paper highlights measurement issues faced when attempting to assess and interpret results of a school improvement project. Based on the assumption that to measure effectiveness, one must measure a wide variety of school factors, the paper presents a broad perspective on measurement problems and dilemmas in analyzing norm-referenced test data…

Four studies are reported that used a metacognitive evaluation procedure that can be group-administered and objectively scored. The procedure assesses the knowledge monitoring component of metacognition by evaluating the discrepancy between students' estimates of how well they are likely to perform on a task and their actual performance. The first…