Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes--overlap measures (percentage non-overlapping data, improvement rate…

The organisers of the 2012 London Olympics have endeavoured explicitly to use the Games to inspire a generation. This is nothing short of putting the main claim of Olympism to the test, but surprisingly the Inspire project has received virtually no scholarly scrutiny. Using an educationally-informed view of inspiration, this paper interrogates the…

Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

Purpose: Participatory extension programmes are widely used to promote change in the agricultural sector, and an important question is how best to measure the effectiveness of such programmes after implementation. This study seeks to understand the current state of practice through a review of ex post evaluations of participatory extension…

Multisite trials, which are being used with increasing frequency in education and evaluation research, provide an exciting opportunity for learning about how the effects of interventions or programs are distributed across sites. In particular, these studies can produce rigorous estimates of a cross-site mean effect of program assignment…

Purpose: This study aims to examine the features of training evaluation process in Russian manufacturing companies. On the basis of three assumptions regarding the differences in group of employees involved in training, duration and costs of a training program, the authors tried to find out the peculiarities of training evaluation tools and levels…

In education research and in many other fields, researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple…

Learning and performance professionals are increasingly pressed to measure the results of their learning program design efforts, and ultimately prove their worth. However, evaluation efforts are often limited to measuring participant reaction. This study sought to quantify evaluation practices in organizations and investigate how the use of…

The purpose of this study was to examine effective design elements for online courses in the science, technology, engineering, and mathematics (STEM) fields at a large four-year public university in southeastern United States. Our research questions addressed the influence of online design elements on students' perception of learning and learning…

Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

This research work consisted in the implementation of a plan in which, by way of treatment, it was possible to improve the levels of assessment competences of the foreign language, of the non-qualified teachers of English of the middle level, Districts 11-01 and 11-02 of the Regional of Education of Puerto Plata, Dominican Republic The purpose of…

This paper reports on the design and evaluation of a rubric for assessing discussions in online graduate level education courses. The aims of the research were twofold. The first goal was to develop a discussion rubric that provides guidance to graduate students participating in online courses that are heavily discussion based. The second goal was…

This quantitative study extends previous research on the impact of one to one (1:1) laptop environments on student outcomes in English Language Arts (ELA) by focusing on students from various socio-economic backgrounds, while using a new technology-enhanced, state-administered assessment to measure performance. This study is significant because…

Piecewise growth models (PGMs) were used to estimate and model changes in the preliteracy skill development of kindergartners in a moderately sized school district in the Pacific Northwest. PGMs were applied to interrupted time-series (ITS) data that arose within the context of a response-to-intervention (RtI) instructional framework. During the…