Becker (1967) poses the question "Whose side are we on?," a question which has become an enduring part of discussions within social scientific methodology. This paper explores the key issues in Becker's argument and considers its relevance to researchers today, locating this within a consideration of evaluation-based research and policy.…

In the current article, we consider the influential position of the Programme for International Student Assessment (PISA) and discuss several methodological areas that demonstrate the need for caution when using and interpreting PISA results. We motivate our argument by briefly describing the program's increased influence in educational policy…

This "Instructor's Corner" describes a step forward on the journey to write, review, and publish high-quality qualitative research manuscripts. This article examines two existing perspectives on generating high-quality qualitative manuscripts and then compares and contrasts the different elements of each. First, an overview of Rocco's (2010) eight…

Schools and school systems throughout the nation are increasingly experimenting with using various instructional technologies to improve productivity and decrease costs, but evidence on both the effectiveness and the costs of education technology is limited. A recent report published by the Thomas B. Fordham Institute sets out to describe "the…

Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific…

This report critically examines studies of how scientific research drives innovation which is then translated into socio-economic benefits. It focuses on research evaluation insights that are relevant not only to the academic community, but also to policymakers and evaluation practitioners--and particularly to biomedical and health research…

The new "Weighted Student Formula Yearbook 2009" from the Reason Foundation provides a simple framework for touting the successes of states and urban school districts that grant greater fiscal autonomy to schools. The report defines the Weighted Student Formula (WSF) reform extremely broadly, presenting a variety of reforms under the WSF umbrella.…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

Recommends that when repeated-measures Latin-square designs are used to counterbalance treatments across a procedural variable or to reduce the number of treatment combinations given to each participant, effects be analyzed statistically, and that in all uses, researchers consider alternative interpretations of the variance associated with the…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Over the last 50 years the process of producing transcripts of all kinds of interactions has become an important practice for researchers in a wide range of disciplines. Only rarely, however, has transcription been analyzed as a cultural practice. It is here argued that it is precisely the lack of understanding of what is involved in transcribing…

The Center for Research on Education Outcomes (CREDO) at Stanford University conducted a large-scale analysis of the impact of charter schools on student performance. The center's data covered 65-70% of the nation's charter schools. Although results varied by state, 17% of the charter school students have significantly higher math results than …

Purpose: The use of e-learning is largely predicated upon the assumption that it can facilitate improvements in student learning and therefore can be more effective than conventional techniques. This assumption has been supported by some in the literature but has been questioned by a continuing body of contrary or indifferent evidence. The purpose…

Conducted studies using two perspectives for obtaining evidence relevant to validity of autobiographical data. In Study 1, construct validity of standard psychological constructs (assertiveness, trustworthiness) obtained from autobiographies was equal to that of standard instruments designed to assess these constructs. Evidence for validity of…

The current prevailing professional opinion is that the prevalence rates of alcohol abuse among the elderly are low compared to the general population. The prevalence of alcohol abuse among the elderly was examined through a review of the empirical research. This review revealed a number of serious methodological problems. The most important of…