Criteria are briefly proposed for final conclusions, research problems, and research hypotheses in quantitative research. Moreover, based on a proposed definition of applied and basic/general research, it is argued that (1) in applied quantitative research, while research problems are necessary, research hypotheses are unjustified, and that (2) in…

Conducting research with human subjects can be difficult because of limited sample sizes and small empirical effects. We demonstrate that this problem can yield patterns of results that are practically indistinguishable from flipping a coin to determine the direction of treatment effects. We use this idea of random conclusions to establish a…

Pain is human-universal since it is experienced by people across the world. However, since it is related to personal feelings, different people may feel it in a different way and rely on language to communicate. This paper presents a cross-cultural comparison of the study of the emotion of pain in Indonesian by examining the usage of two…

Educational research enquiries differ based on philosophical beliefs and assumptions regarding researchers' explicitly stated views. This paper critically explores the most dominant philosophical stances in social research sciences, namely positivism, interpretivism and pragmatism. It begins with an overview of the role of the aforementioned…

A vast body of work highlights executive functions (EFs) as robust correlates of mathematics achievement over the primary and preschool years. Yet, despite such correlational evidence, there is limited evidence that EF interventions yield improvements in early years mathematics. As intervention studies are a powerful tool to move beyond…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Students often believe that statistical significance is the only determinant of whether a quantitative result is "important." In this paper, I review traditional null hypothesis statistical testing to identify what questions inferential statistics can and cannot answer, including statistical significance, effect size and direction,…

The purpose of this article is to illustrate the dynamic process involved in developing and utilizing a theoretical model in a mixed methods study. Specifically, I illustrate how the theoretical model can serve as the starting point in framing the study, as a lens for guiding the data collection and analysis, and as the end point in explaining the…

We explored the impact a new quantitative biology course for biology majors had on their ability and confidence to utilize hypothesis testing. Students currently in the quantitative biology course and the first cohort of students who took the course (currently seniors) were surveyed on ability and confidence regarding four types of hypothesis…

Concerns about the replication crisis and unreliable findings have spread through several fields, including education and psychological research. In some areas of education, researchers have begun to adopt reforms that have proven useful in other fields. These include preregistration, open materials and data, and registered reports. These reforms…

This design case introduces a design and development process of theories from environmental psychology, humanities, and social sciences as heuristic thinking devices to measure human-centered design solutions. The pedagogical review of the traditional studio design process revealed obstacles as students translated their research and program to the…

Professional development for teachers is regarded as one of the principal pathways through which we can understand and cultivate effective teaching and improve student outcomes. A critical component of studies that seek to improve teaching through professional development is the detailed assessment of the intermediate teacher development processes…

Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

In this article we focus on "cooperative engineering", in which teachers and researchers co-design didactic sequences. In the first part of the article, we present cooperative engineering by describing some of the main principles on which it is grounded. The second part is dedicated to a case study, which enables us to illustrate some…