Single-case experimental designs (SCEDs) have a long history in clinical and educational disciplines. One underdeveloped area in advancing SCED design and analysis is understanding the process of how internal validity threats and operational concerns are avoided or mitigated. Two strategies to ameliorate such issues in SCED involve replication and…

This article addresses conceptual and methodological shortcomings regarding conducting and interpreting intelligence test factor analytic research that appeared in the Decker, S. L., Bridges, R. M., Luedke, J. C., & Eason, M. J. (2020). Dimensional evaluation of cognitive measures: Methodological confounds and theoretical concerns.…

As a research field geared toward understanding and improving learning, Learning Analytics (LA) must be able to provide empirical support for causal claims. However, as a highly applied field, tightly controlled randomized experiments are not always feasible nor desirable. Instead, researchers often rely on observational data, based on which they…

An increased focus on transparency and replication in science has stimulated reform in research practices and dissemination. As a result, the research culture is changing: the use of preregistration is on the rise, access to data and materials is increasing, and large-scale replication studies are more common. In this article, I discuss two…

Experimental studies are often employed to test the effectiveness of teaching innovations such as new pedagogy, curriculum, or learning resources. This article offers guidance on good practice in developing research designs, and in drawing conclusions from published reports. Random control trials potentially support the use of statistical…

The debate on the validity of teaching students how to identify their own preferred learning style is not going to go away anytime soon as evidenced by the number of articles still being written about the topic. One can find numerous research studies that say students have different strengths and weaknesses when it comes to learning and retaining…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

This article offers a rationale for the contributions of qualitative research to evidence-based practice in special education. In it, I make the argument that qualitative research encompasses the ability to study significant problems of practice, engage with practitioners in the conduct of research studies, learn and change processes during a…

The need for more theory building scholarship remains one of the pressing issues in the field of HRD. Researchers can employ quantitative, qualitative, and/or mixed methods to support vital theory-building efforts, understanding however that each approach has its limitations. The purpose of this article is to explore common method variance bias as…

The purpose of this paper is to describe the process of conducting ethnographic research. Methodology definition and key characteristics are given. The stages of the research process are described including preparation, data gathering and recording, and analysis. Important issues such as reliability and validity are also discussed.

The August 16, 2011, "Chronicle of Higher Education" article "Want Data? Ask Students. Again and Again" by Sara Lipka posits that in higher education there is a culture of oversurveying students and too often relying on surveys as the main, or only, way of assessing the impact of programs and services on student satisfaction and learning. Because…

The objective of this target article is to chart the potential threat to research validity in the field of giftedness research, and by implication also the study and practice of gifted education, in the light of cultural bias. It endeavours to pull together facts from a number of academic disciplines to make sense of how culture relates to…

Over the past few years, the focus group method has assumed a very important role as a method for collecting qualitative data in social and behavioural science research. This article elucidates theoretical and practical problems and prospects associated with the use of focus groups as a qualitative research method in social and behavioural science…

In recent decades, proponents of naturalistic and/or critical modes of inquiry advocating the use of ethnographic techniques for the narrative-based study of phenomena within pedagogical contexts have challenged the central methodological paradigm of educational research: that is, the tendency among its practitioners to adhere to quantitative…

With increasing reliance being placed on the results of their surveys, the National Center for Education Statistics (NCES) recognized a need for these survey results to be valid and reliable. As part of the work of the Statistical Analysis Group in Education (SAGE), an effort was undertaken to investigate validity and reliability in survey…