Canada does not have a national system wide assessment of the socioeconomic impacts of academic research. We do not have a Research Excellence Framework such as in the United Kingdom. Yet Canadian researchers, funders and institutions are interested in research impact, particularly the methods and processes for generating impacts to complement…

A critical revisiting of research methods with multilingual learners raises issues of validity that are often unaddressed in current discussions of research quality. Though validity is conceptualized and assessed differently across research traditions, validity broadly describes the production of findings that are credible and trustworthy. The…

The European University Association (EUA) has continuously supported European universities in the transition towards Open Science and, in particular, to Open Access. Upon recommendation of its Expert Group on Science 2.0/Open Science, EUA has developed a variety of initiatives in this area, as outlined in the "EUA Roadmap on Open Access to…

This issue of the "ZERO TO THREE" journal provides a snapshot of the current state of measurement of reflective supervision within the infant-family field. In this article, the authors introduce the issue by providing a brief history of the development of reflective supervision in the field of infant mental health, with a specific focus…

Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal inferences about the effects of an intervention but others have designs that do not permit these types of conclusions. To help policymakers, practitioners, and others make sense of study results, the…

Our understanding of programs is enhanced when trained, skilled, and observant evaluators go "into the field"--the real world where programs are conducted--paying attention to what's going on, systematically documenting what they see, and reporting what they learn. The article opens by presenting and illustrating twelve reasons for…

This chapter presents an introduction to design-based implementation research (DBIR). We describe the need for DBIR as a research approach that challenges educational researchers and practitioners to transcend traditional research/practice barriers to facilitate the design of educational interventions that are effective, sustainable, and scalable.…

The examination of cross-classified category data is common in evaluation and research, with Karl Pearson's family of chi-square tests representing one of the most utilized statistical analyses for answering questions about the association or difference between categorical variables. Unfortunately, these tests are also among the more commonly…

The purpose of the "Evidence to Practice" commentary is to highlight an issue or research finding in selected articles, emphasizing the relevance to practice. This article introduces a new tool designed to summarize the most up-to-date evidence in an easily readable format, in order to provide clinically useful answers within minutes for assisting…

Qualitative interviewing is a flexible and powerful tool to capture the voices and the ways people make meaning of their experience Learning to conduct semi-structure interviews requires the following six stages: (a) selecting the type of interview; (b) establishing ethical guidelines, (c) crafting the interview protocol; (d) conducting and…

This paper provides practical guidance for researchers who are designing and analyzing studies that randomize schools--which comprise three levels of clustering (students in classrooms in schools)--to measure intervention effects on student academic outcomes when information on the middle level (classrooms) is missing. This situation arises…

The purpose of this article was to extend the use of standard errors for equated score differences (SEEDs) to traditional equating functions. The SEEDs are described in terms of their original proposal for kernel equating functions and extended so that SEEDs for traditional linear and traditional equipercentile equating functions can be computed.…

The aim of this chapter is to characterize educational reforms in Latin America over the last 25 years, and the way they reflect the role, method, and use of evaluation processes. The main theoretical and methodological tensions that are created by the development of evaluations will be reviewed, concluding with the identification of some of the…

This paper describes the application of finite-mixture general linear models based on the beta distribution to modeling response styles, polarization, anchoring, and priming effects in probability judgments. These models, in turn, enhance our capacity for explicitly testing models and theories regarding the aforementioned phenomena. The mixture…

Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…