Instrumental variables is a popular approach for causal inference in education when randomization of treatment is not feasible. Using a first-year college program as a running example, this article reviews the five assumptions that must be met to successfully use instrumental variables to estimate a causal effect with observational data: SUTVA,…

The author is pleased to have the opportunity to respond to "Measuring Students' Writing Ability on a Computer-Analytic Developmental Scale: An Exploratory Validity Study." The authors of that article have undertaken a challenging project and seem to be on track to developing a technically adequate, practically useful writing…

Divergent thinking (DT) tests are very often used in creativity studies. Certainly DT does not guarantee actual creative achievement, but tests of DT are reliable and reasonably valid predictors of certain performance criteria. The validity of DT is described as reasonable because validity is not an all-or-nothing attribute, but is, instead, a…

In 2010, HCM Strategists received support from the Bill & Melinda Gates Foundation to engage academic researchers in identifying and discussing the best currently available ways to account for differences in college "inputs"--students, resources, and fixed characteristics--when evaluating postsecondary outcomes. The project, Context…

Common Core Reading Standard 10 not only prescribes the difficulty of texts students should become able to read, but also the difficulty diet of texts schools should ask their students to read across the school year. The use of quantitative text-assessment tools in the implementation of this standard warrants an examination into the validity of…

Objectives: This study investigated treatment fidelity in social work research. Method: The authors systematically reviewed all articles published in five prominent social work journals over a 5- year period. Sixty-three outcome studies were identified and reviewed for how well treatment fidelity was monitored using eight review criteria. Results:…

Despite questions about validity and reliability, the use of value-added estimation methods has moved beyond academic research into state accountability systems for teachers, schools, and teacher preparation programs (TPPs). Prior studies of value-added measurement for TPPs test the validity of researcher-designed models and find that measuring…

A new report titled "The Long-Term Impacts of Teachers" concludes that teachers whose students tend to show high gains on their test scores (called "high value-added teachers") also contribute to later student success in young adulthood, as indicated by outcomes such as college attendance and future earnings. To support this claim, it is not…

Background: Grouping students into classes by ability on a subject-by-subject basis, also known as setting, is a common practice in many educational systems. An important issue is therefore the way in which setting decisions are made. While educators and policy-makers favouring setting claim that ability or achievement is the sole criterion used,…

The purpose of this synthesis was to examine the relationship between Curriculum-Based Measurement (CBM) and statewide achievement tests in reading. A multilevel meta-analysis was used to calculate the correlation coefficient of the population for 27 studies that met the inclusion criteria. Results showed an overall large correlation coefficient…

Combining salary data for permanent non-emeritus faculty at seven departments of political science within the University of California system with lifetime citation counts and other individual-level data from the Masuoka, Grofman, and Feld (2007a) study of faculty at Ph.D.-granting political science departments in the United States, I analyze…

This study investigated the effectiveness of assessing young children's meta-cognition in different contexts (i.e., individual learning (IL), peer assisted learning (PAL) and self-reports). Additionally, the contributions of declarative and procedural meta-cognition in IL and PAL, TOM and language ability on children's cognitive performance…

As graphically driven, animated, interactive applications offer educators new opportunities for shaping course content, new avenues for research arise as well. Along with these developments comes a need to study the effectiveness of the individual tools at our disposal as well as various methods for integrating those tools in a classroom setting.…

Outlines five perspectives contributing to an overall assessment of early childhood program quality: the top-down, bottom-up, outside-inside, inside, and ultimate (community and societal) perspectives. Use of multiple evaluation perspectives requires high inference levels for assessors and raises accountability issues. Unfortunately, appallingly…

A broad conceptual framework is presented as a tool to guide researchers toward identification and development of variables in policy implementation studies. Concepts for developing variables to measure the "amount" of implementation and variables to identify the aspects of policy that need to be incorporated in a study are discussed.…