Young and Holsteen (YH) introduce a number of tools for evaluating model uncertainty. In so doing, they are careful to differentiate their method from existing forms of model averaging. The fundamental difference lies in the way in which the underlying estimates are weighted. Whereas standard approaches to model averaging assign higher weight to…

The commenter's proposal may be a reasonable method for addressing uncertainty in predictive modeling, where the goal is to predict "y." In a treatment effects framework, where the goal is causal inference by conditioning-on-observables, the commenter's proposal is deeply flawed. The proposal (1) ignores the definition of…

In this commentary, the 3 review papers by Reynolds et al. (this issue), Muijs et al. (this issue), and Hopkins, Stringfield, Harris, Stoll, and Mackay (this issue) on "educational effectiveness", "teaching effectiveness", and "school and system improvement" are discussed. In the text, the 3 papers are occasionally…

As of September 2012, only Alaska, Minnesota, Nebraska, Texas, and Virginia had not adopted the Common Core State Standards (CCSS). Yet empirical evidence that demonstrates the efficacy of the initiative remains elusive. The Emperor has no clothes (Tienken 2011a). This latest installment of standardization and centralization of curriculum and…

This article presents the authors' rejoinder to the comments of Howard Bloom, Derek Neal, and Mike Seltzer on their article. Their commentary focused foremost on the advantages and disadvantages of using Options A, B, or C in using instrumental variables in multisite trials. Of interest are the quantities one can estimate and test in each case,…

Over the last decade, and in the context of the fiscal crisis in the nation in general and in higher education in particular, a debate has raged over the value of humanities research. Various commentators have argued that unlike nonhumanities disciplines, fields such as English studies and other humanistic disciplines bring very little into their…

The focus article by Coburn and Turner (this issue) seeks to provide a comprehensive framework for understanding data use in the context of data-use interventions. This commentary focuses on what the authors see as a glaring omission in what is otherwise a valuable framework: the issue of "useful data." It is their contention that the usefulness…

Lynn (2010) suggests that differences in average intelligence explain many of the differences observed across the Italian regions. This paper puts forward a methodological critique to his study, coupling it with an empirical test showing that Lynn's analysis is not sufficiently robust to support its conclusions. (Contains 2 tables.)

Working with data from the PISA study (OECD, 2007), Lynn (2010) has argued that individuals from South Italy average an IQ approximately 10 points lower than individuals from North Italy, and has gone on to put forward a series of conclusions on the relationship between average IQ, latitude, average stature, income, etc. The present paper…

When governments and pressure groups attend only to research that suits their political purposes, it makes a mockery of the idea of evidence-informed policy and practice. In this article, the author cites examples of research that picked up weak and misleading evidence for political purposes. The author argues that researchers are tied in to the…

Throughout classrooms in the United States there appears to have been a general watering down of academic standards. The percentages of "A" and "B" grades have risen, and at some schools, the percentage of grades of "C" or lower has plummeted. Numerous scholarly articles about grade inflation discuss the extent,…

Unsupervised summative assessment has become a feature of the educational landscape in various educational jurisdictions around the world, including the state of Queensland in Australia. However, I suggest it is an invalid and unnecessary practice that can impact negatively on the affect of students, call for a reconsideration of its use, and…

This paper recommends use of analysis of covariance in early intervention research to account for pretreatment group differences and increase statistical power. Diagrams show how analysis of covariance manipulates data under various conditions. Simulated data analysis demonstrates the process of selecting covariates and shows the results with and…

To assist in the redesign of accountability systems, the Consortium for Policy Research in Education (CPRE) and the Center for Research on Evaluation, Student Standards, and Testing (CRESST) sought to assemble knowledge from new research on emerging accountability systems. A book, "Redesigning Accountability Systems for Education," edited by Susan…

This paper offers reasons for using traditional quantitative research methods and illustrates some of the considerations demanding rigor in a study on gender discrimination in school-administrator salaries. Traditional quantitative methods provide a meaningful language based on numbers and objectivity, and they are less time-consuming and complex…