Criteria are briefly proposed for final conclusions, research problems, and research hypotheses in quantitative research. Moreover, based on a proposed definition of applied and basic/general research, it is argued that (1) in applied quantitative research, while research problems are necessary, research hypotheses are unjustified, and that (2) in…

Conducting research with human subjects can be difficult because of limited sample sizes and small empirical effects. We demonstrate that this problem can yield patterns of results that are practically indistinguishable from flipping a coin to determine the direction of treatment effects. We use this idea of random conclusions to establish a…

Quasi-experimental methods are a cornerstone of applied social science, providing critical answers to causal questions that inform policy and practice. Although open science principles have influenced experimental research norms across the social sciences, these practices are rarely implemented in quasi-experimental research. In this paper, we…

Educational research enquiries differ based on philosophical beliefs and assumptions regarding researchers' explicitly stated views. This paper critically explores the most dominant philosophical stances in social research sciences, namely positivism, interpretivism and pragmatism. It begins with an overview of the role of the aforementioned…

Students often believe that statistical significance is the only determinant of whether a quantitative result is "important." In this paper, I review traditional null hypothesis statistical testing to identify what questions inferential statistics can and cannot answer, including statistical significance, effect size and direction,…

Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

Like performance-enhancing drugs inflating apparent athletic achievements, several common social science practices contribute to the production of illusory results. In this article, we examine the processes that lead to illusory findings and describe their consequences. We borrow from an approach used increasingly by other disciplines--the norm of…

Integral to most undergraduate psychology degree programs are research methods courses. Students learn about theory, study design and hypothesis testing, and gain knowledge that is assessed by laboratory reports. We describe a problem-based learning approach with an emphasis on acquisition of study design skills. Working in small groups, students…

Single case studies can provide vital contributions to theory-testing in social science studies. Particularly, by applying the process-tracing method, case studies can test theoretical frameworks through a rigorous research design that ensures substantial empirical leverage. While most scholarly contributions on process-tracing focus on either…

Purpose: Single-case experimental designs are widely used to study interventions for communication disorders. Traditionally, single-case experiments follow a response-guided approach, where design decisions during the study are based on participants' observed patterns of behavior. However, this approach has been criticized for its high rate of…

Could the research you read be fundamentally flawed? Could critical defects in methodology slip by you undetected? To become informed consumers of research, students need to thoughtfully evaluate the research they read rather than accept it without question. This second edition of a classic text gives students the tools they need to apply critical…

Transformative researchers have the potential to contribute to both personal and societal transformation. In this article, I argue that the two are intertwined and that personal transformation is a necessary component of research that is designed to support change at the societal level in the form of furthering human rights and social justice. I…

We tested the effectiveness of a course-long intervention in an undergraduate Research Methods course aimed toward reducing students' endorsement of hostile sexism (HS) and benevolent sexism (BS). Reading assignments illustrating diverse research methodologies, lecture examples, and a hands-on research project designed by student teams focused on…