To date, evaluation research and policy analysis have focused mainly on average program impacts and paid little systematic attention to their variation. Recently, the growing number of multi-site randomized trials that are being planned and conducted make it increasingly feasible to study "cross-site" variation in impacts. Important…

Teacher professional development (PD) is seen as critical to improving the quality of US schools (National Commission on Teaching and America's Future, 1997). PD is increasingly viewed as one of the primary levers for improving teaching quality and ultimately student achievement (Correnti, 2007). One factor that is driving interest in PD is…

A key issue in quasi-experimental studies and also with many evaluations which required a treatment effects (i.e. a control or experimental group) design is selection bias (Shadish el at 2002). Selection bias refers to the selection of individuals, groups or data for analysis such that proper randomization is not achieved, thereby ensuring that…

This is a description of the creation of a research methods tool, the "Transformative, Mixed Methods Checklist for Psychological Research With Mexican Americans." For conducting literature reviews of and planning mixed methods studies with Mexican Americans, it contains evaluative criteria calling for transformative mixed methods, perspectives…

Social skills are important treatment targets for individuals with autism spectrum disorders (ASD) across the lifespan. However, few treatments are available for adolescents and adults with ASD who also have severe to profound intellectual disability (S/PID). Several social skill interventions have been described that may improve social skills in…

The main objective of this study was to examine the mediational and moderational effect of exercise, diet, and stress management on the relationship between functional disability and health-related quality of life. Quantitative descriptive research design using multiple regression and correlation techniques was used. Participants were 215…

Purpose: The purpose of this study is to chart the development in computer-assisted language learning (CALL), by building a map of existing research work in the field. Based on a corpus of 163 manuscripts, published between January 2009 and September 2010 in four major journals devoted to CALL, it sets out to describe the range of topics covered…

Data from single case designs (SCDs) have traditionally been analyzed by visual inspection rather than statistical models. As a consequence, effect sizes have been of little interest. Lately, some effect-size estimators have been proposed, but most are either (i) nonparametric, and/or (ii) based on an analogy incompatible with effect sizes from…

Researchers may be interested in examining the impact of programs that prepare youth and adults for successful careers but unable to implement experimental designs with true randomization of participants. As a result, these studies can be compromised by underlying factors that impact group selection and thus lead to potentially biased results.…

Neurophysiological studies of creativity thus far have not allowed for clear conclusions to be made regarding the specific neural underpinnings of such complex cognition due to overgeneralizations concerning the creativity construct, heterogeneity in the type of creativity tasks used, and the questionable efficacy of the employed comparison tasks.…

The process of designing an experiment is a difficult one. Students often struggle to perform such tasks as the design process places a large cognitive load on students. Scaffolding is the process of providing support for a student to allow them to complete tasks they would otherwise not have been able to complete. This study sought to investigate…

In this article, we outline a course wherein the instructors teach students how to conduct rigorous qualitative research. We discuss the four major distinct, but overlapping, phases of the course: conceptual/theoretical, technical, applied, and emergent scholar. Students write several qualitative reports, called qualitative notebooks, which…

Often, research projects are presented as final products with the methodologies cleanly outlined and little attention paid to the decision-making processes that led to the chosen approach. Limited attention paid to these decision-making processes perpetuates a sense of mystery about qualitative approaches, particularly for new researchers who will…

In this four-investigation Monte Carlo simulation study, we examined the properties of nonparametric randomization and permutation statistical tests applied to single-case ABAB...AB and alternating treatment designs based on either systematically alternating or randomly determined phase assignments. Contrary to previous admonitions, when…

Using an experimental research design, 191 working adults were randomly assigned to two experimental conditions in order to test a theoretical model linking leader and follower positive psychological capital (PsyCap). Multiple methods were used to gather information from the participants. We found when leader PsyCap was manipulated experimentally,…