Single-case experimental designs (SCEDs) have a long history in clinical and educational disciplines. One underdeveloped area in advancing SCED design and analysis is understanding the process of how internal validity threats and operational concerns are avoided or mitigated. Two strategies to ameliorate such issues in SCED involve replication and…

As a research field geared toward understanding and improving learning, Learning Analytics (LA) must be able to provide empirical support for causal claims. However, as a highly applied field, tightly controlled randomized experiments are not always feasible nor desirable. Instead, researchers often rely on observational data, based on which they…

Experimental studies are often employed to test the effectiveness of teaching innovations such as new pedagogy, curriculum, or learning resources. This article offers guidance on good practice in developing research designs, and in drawing conclusions from published reports. Random control trials potentially support the use of statistical…

The debate on the validity of teaching students how to identify their own preferred learning style is not going to go away anytime soon as evidenced by the number of articles still being written about the topic. One can find numerous research studies that say students have different strengths and weaknesses when it comes to learning and retaining…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

The need for more theory building scholarship remains one of the pressing issues in the field of HRD. Researchers can employ quantitative, qualitative, and/or mixed methods to support vital theory-building efforts, understanding however that each approach has its limitations. The purpose of this article is to explore common method variance bias as…

The purpose of this paper is to describe the process of conducting ethnographic research. Methodology definition and key characteristics are given. The stages of the research process are described including preparation, data gathering and recording, and analysis. Important issues such as reliability and validity are also discussed.

The objective of this target article is to chart the potential threat to research validity in the field of giftedness research, and by implication also the study and practice of gifted education, in the light of cultural bias. It endeavours to pull together facts from a number of academic disciplines to make sense of how culture relates to…

Over the past few years, the focus group method has assumed a very important role as a method for collecting qualitative data in social and behavioural science research. This article elucidates theoretical and practical problems and prospects associated with the use of focus groups as a qualitative research method in social and behavioural science…

In recent decades, proponents of naturalistic and/or critical modes of inquiry advocating the use of ethnographic techniques for the narrative-based study of phenomena within pedagogical contexts have challenged the central methodological paradigm of educational research: that is, the tendency among its practitioners to adhere to quantitative…

This highly readable text demystifies the qualitative research process--and helps readers conceptualize their own studies--by organizing the different research paradigms and traditions into coherent clusters. Real-world examples and firsthand perspectives illustrate the research process; instructive exercises and activities build on each other so…

Agrees with the power of randomized clinical trials, but makes the case that random assignment raises other, unanticipated threats to internal validity as a result of failing to consider treatment preference in research participant behavior. Reviews benefits and limitations of research strategies that augment randomization while respecting…

This article discusses the difficulties in conducting intervention research or evaluating intervention programs in a school setting. In particular, the problems associated with randomization and obtaining control groups are examined. The use of quasi-experimental designs, specifically a paired comparison design using the individual as his or her…

It is not unusual for interest groups to issue reports that further their own political agendas--and to muddle the facts in the process. For this reason, newspapers generally ignore them, treat them with great skepticism, or make sure they properly vet the research with independent observers. Not so in the case of the study of charter schools…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…