The use of Mixed Methods (MM) in evaluation has increasingly become a valuable asset in evaluators' methodological toolbox. Despite prolific research on various aspects of mixed methods, from typologies to ontological debates, there remains a dearth of empirically derived evidence on effectively communicating MM findings. This lack of empirical…

I define a treatment effect in terms of a comparison of outcomes and provide a typology of all possible comparisons that can be used to estimate treatment effects, including comparisons that are relatively unknown in both the literature and practice. I then assess the relative merit, worth, and value of all possible comparisons based on the…

Language, literacy and numeracy are necessary for greater workforce participation, productivity and social inclusion. Being able to measure the level of proficiency in these skills, and any changes in the level of skills, is important for getting a sense of how well language, literacy and numeracy programs are working. Two measurement tools used…

Feedback on assessment tasks has an important part to play in underpinning student learning. Online assessment enables instantaneous feedback to be given so that the student can act on it immediately. However, concern has been expressed that e-assessment tasks (especially multiple-choice questions) can encourage surface-learning. Several projects…

Educators have long debated the usefulness (or otherwise) of final examinations; a debate that has typically revolved around the relative merits of closed-book exams, open-book exams, take-home exams or their substitution by some other assessment format (e.g., project work). This paper adds a new dimension to the debate by considering how the…

This technical report and user's guide is designed to provide researchers with an overview of the design and implementation of the 2009 Program for International Student Assessment (PISA), as well as with information on how to access the PISA 2009 data. This information is meant to supplement that presented in Organization for Economic Cooperation…

There has been much research concerning functional assessment over the past 20 years, but several important research considerations have yet to be explained. One is the comparison of different types of functional assessment (e.g., experimental functional analysis and non-experimental functional assessment). The current study aims to compare the…

The Comparing Options in Secondary Mathematics: Investigating Curriculum (COSMIC) project is a longitudinal study of student learning from two types of mathematics curricula: integrated and subject-specific. Previous large-scale research studies such as the National Assessment of Educational Progress (NAEP) indicate that numerous variables are…

The Anamnestic Comparative Self Assessment (ACSA) measure of subjective well-being (SWB) aims to reduce the problems of cultural bias and relativity to external standards by allowing people to define the endpoints or "anchors" of the measurement scale. In medical terminology anamnestic denotes "based on memory". The ACSA uses…

Increasing demands for evidence-based early childhood services and the need by policymakers to know whether a program is effective or whether it warrants a significant investment of public and/or private funds--coupled with the often-politicized debate around these topics--make it imperative for policymakers and civic leaders to have independent…

The Randomized Control Trials (RCT) design and its quasi-experimental kissing cousin, the Comparison Group Trials (CGT), are golden to some and not even silver to others. At the center of the affection, at the vortex of the discomfort, are beliefs about what it takes to establish causality. These designs are considered primarily when the purpose…

The Office of Management and Budget has recommended the termination of numerous federal programs, citing a lack of program results as the primary reason for this decision. In response to this recommendation, several federal agencies have turned to logic modeling to demonstrate that programs are on the path to results accountability. However,…

Education researchers, practitioners, and policymakers alike are committed to identifying interventions that teach students more effectively. Increased emphasis on evaluation and accountability has increased desire for sound evaluations of these interventions; and at the same time, school-level data have become increasingly available. This article…

This article is a response to "Mapping educational research and its impact on Australian schools," Chapter 2 of The Impact of Educational Research, in which researchers Allyson Holbrook, John Ainley, Sid Bourke, John Owen, Philip McKenzie, Sebastian Mission and Trevor Johnson report on their Commonwealth Education Department commissioned…

Chaos career counseling, based on the Chaos Theory of Careers (R. G. L. Pryor & J. E. H. Bright, 2003a, 2003b), was compared with trait matching career counseling and a wait list control. Sixty university students who attended the Careers Research and Assessment Service seeking career advice were randomly assigned to the chaos intervention, the…