Given decision-makers often prioritize causal research that identifies the impact of treatments on the people they serve, a key question in education research is, "Does it work?". Today, however, researchers are paying increasing attention to successive questions that are equally important from a practical standpoint--not only does it…

Evaluators are often called upon to assess the effects of programs. To assess a program effect, evaluators need a clear understanding of how a program effect is defined. Arguably, the most widely used definition of a program effect is the counterfactual one. According to the counterfactual definition, a program effect is the difference between…

Recently, a new program model for describing and predicting the impact of 4-H on youths was proposed. The model's structure was confirmed statistically in preliminary testing. However, youth voice had not been included in the development of the model. This article describes a study intended to assess the alignment of the six thriving indicators…

Augmented reality (AR) technologies could enhance learning in several ways. The quality of an AR-based educational platform is a combination of key features that manifests in usability, usefulness, and enjoyment for the learner. In this paper, we present a multidimensional model to measure the quality of an AR-based application as perceived by…

The quality assurance of online Higher Education online programmes is one of the great challenges faced by Spanish universities. Regular assessment of these programmes is essential in order to take actions to improve their quality. The said assessment should be complex and include all of the components of the programme, as well as its planning and…

Surveys of teacher preparation program (TPP) completers have become one widely used measure for program accountability and improvement, yet there is little evidence as to whether perceptions of preparation experiences predict the workforce outcomes of teachers. In the present study, we use statewide completer survey data from North Carolina to…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

The purpose of this statement is to inform those using or considering the use of value-added models (VAM) about their scientific and technical limitations in the evaluation of educators and programs that prepare teachers. The statement briefly reviews the background and current context of using VAM for evaluations, enumerates specific psychometric…

Evaluations of teacher preparation programs (TPPs) based in part on the performance of program completers have emerged as an education reform strategy in several states and have become central features of the Race to the Top (RTTT) grant competition. The objective of this policy review is to examine how the state of Tennessee measured and reported…

In response to pedagogical challenges in higher education, blended learning has become a prevalent practice in colleges and universities. Flipped learning (FL) represents a newly emerging form of blended learning, where students individually watch online lectures prior to class and then engage in classroom learning activities interacting with…

Despite embracing a bio-psycho-social perspective, the World Health Organization's International Classification of Functioning, Disability and Health (ICF) assessment framework has had limited application to date with children who have special educational needs (SEN). This study examines its utility for educational psychologists' work with…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

Educational partnerships with area-based approaches comprise an increasingly well-grounded and internationally extended strategy for equitable improvement. However, literature shows a lack of focused inquiry on the assessment of these educational collaborative programmes. This article aims to develop and validate an instrument to assess these…

Psychometrically sound evaluation measures are vital for examining the contribution of professional training to organizational success in a reliable manner. As training evaluations tend to be both time-consuming and labor-intensive, there is an increasing demand for economic evaluation inventories. Simultaneously, evaluation measures have to meet…

In this paper, I describe the design and evaluation of automated essay scoring (AES) models for an institution's writing placement program. Information was gathered on admitted student writing performance at a science and technology research university in the northeastern United States. Under timed conditions, first-year students (N = 879) were…