Educational research enquiries differ based on philosophical beliefs and assumptions regarding researchers' explicitly stated views. This paper critically explores the most dominant philosophical stances in social research sciences, namely positivism, interpretivism and pragmatism. It begins with an overview of the role of the aforementioned…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Education researchers frequently have to choose between statistical models for their data, and in many cases the candidate models or parameters can be listed in a sequence, m=1,...,M, from less preferable choices to more. For instance, in choosing a bandwidth for regression discontinuity designs, researchers would favor the largest possible…

Concerns about the replication crisis and unreliable findings have spread through several fields, including education and psychological research. In some areas of education, researchers have begun to adopt reforms that have proven useful in other fields. These include preregistration, open materials and data, and registered reports. These reforms…

Professional development for teachers is regarded as one of the principal pathways through which we can understand and cultivate effective teaching and improve student outcomes. A critical component of studies that seek to improve teaching through professional development is the detailed assessment of the intermediate teacher development processes…

Like performance-enhancing drugs inflating apparent athletic achievements, several common social science practices contribute to the production of illusory results. In this article, we examine the processes that lead to illusory findings and describe their consequences. We borrow from an approach used increasingly by other disciplines--the norm of…

Researchers sometimes conduct a study and find that the predicted relation between variables did not exist or that the intervention did not have a positive impact on student outcomes; these are referred to as null findings because they fail to disconfirm the null hypothesis. Rather than consider such studies as failures and disregard the null…

Emerging professionals, particularly senior-level undergraduate and graduate students in kinesiology who have an interest in physical education for individuals with and without disabilities, should understand the basic assumptions of the quantitative research paradigm. Knowledge of basic assumptions is critical for conducting, analyzing, and…

Transformative researchers have the potential to contribute to both personal and societal transformation. In this article, I argue that the two are intertwined and that personal transformation is a necessary component of research that is designed to support change at the societal level in the form of furthering human rights and social justice. I…

This report presents the statistical theory underlying the "RCT-YES" software that estimates and reports impacts for RCTs for a wide range of designs used in social policy research. The report discusses a unified, non-parametric design-based approach for impact estimation using the building blocks of the Neyman-Rubin-Holland causal…

This paper outlines a novel approach to engineering education research that provides three dimensions of learning through an experiential class activity. A simulated decision activity brought current research into the classroom, explored the effect of experiential activity on learning outcomes and contributed to the research on innovation decision…

Research problems in a scientific research are formed after a certain process. This process starts with defining a research topic and transforms into a specific research problem or hypothesis. The aim of this study was to examine the way educational technology researchers identify their research problems. To this end, sources that educational…

The motivation for this paper is the authors' recent work on several randomized control trials in which they found the primary result, which averaged across subgroups or sites, to be moderated by demographic or site characteristics. They are led to examine a distinction that the Institute of Education Sciences (IES) makes between "confirmatory"…

In cluster-randomized trials (CRTs) of social work interventions, groups are assigned to treatment conditions. Conducting a power analysis ensures that enough groups are sampled for testing hypotheses. The power analysis method and inputs must be informed by the hypotheses, effects to be tested, and the data analysis plans. The authors present a…

A common mistake in analysis of cluster randomized experiments is to ignore the effect of clustering and analyze the data as if each treatment group were a simple random sample. This typically leads to an overstatement of the precision of results and anticonservative conclusions about precision and statistical significance of treatment effects.…