Qualitative thematic analysis is a commonly used and widely applicable form of qualitative analysis, though it can be challenging to implement. Due to its use across research questions, qualitative traditions, and fields, thematic analysis is also prevalent in mixed methods studies. Despite its widespread use, the term "thematic…

Hamdani et al. recently provided guidance for prospective authors on a wide range of issues encountered in quantitative research papers submitted for review at the "Journal of Management Education." Building on their insights, this essay focuses on experimental designs and provides more specific guidance and recommendations for…

The randomized control trial (RCT) is the primary experimental design in education research due to its strong internal validity for causal inference. However, in situations where RCTs are not feasible or ethical, quasi-experiments are alternatives to establish causal inference. This paper serves as an introduction to several quasi-experimental…

This article explains the basic ideas and practical challenges in clinical trials of new medicines to show the practical application of statistics in the real-world. The article explores the key considerations for the objectives and design of clinical trials and how these relate to the statistical investigation process. The article also includes…

Two- and three-level designs in educational and psychological research can involve entire populations of Level-3 and possibly Level-2 units, such as schools and educational districts nested within a given state, or neighborhoods and counties in a state. Such a design is of increasing relevance in empirical research owing to the growing popularity…

In this essay, we focus on methodological issues that reviewers and editors commonly encounter when evaluating empirical articles in scholarship of teaching and learning in management education. We organize our discussion around three stages--design, analysis, and reporting. The essay identifies which types of issues are likely to receive…

Single case experimental designs are an important research design in behavioral and medical research. Although there are design standards prescribed by the What Works Clearinghouse for single case experimental designs, these standards do not include statistically derived power computations. Recently we derived the equations for computing power for…

Whether you believe you need a methodologist is very much dependent on academic training and your experience working with methodologists in pursuit of research. Methodologists are indispensable at all phases of the research process but perhaps nowhere more than at the beginning, when formulating your research questions and specifying what it is…

The causal mediation literature has developed techniques to assess the sensitivity of an inference to pretreatment confounding, but these techniques are limited to the case of a single mediator. In this article, we extend sensitivity analysis to possible violations of pretreatment confounding in the case of multiple mediators. In particular, we…

A randomized experiment that measures the impact of a social policy in a sample of the population reveals whether the policy will work on average with universal application. An experiment that includes only the subset of the population that volunteers for the intervention generates narrower "proof-of-concept" evidence of whether the…

When well-implemented, mediation analyses play a critical role in probing theories of action because their results help lay the ground work for the critical development of a treatment and the iterative advancement of theories that are foundational to a discipline. Despite strong interest in designs that incorporate mediation, few studies have…

This article develops new closed-form variance expressions for power analyses for commonly used difference-in-differences (DID) and comparative interrupted time series (CITS) panel data estimators. The main contribution is to incorporate variation in treatment timing into the analysis. The power formulas also account for other key design features…

Students often believe that statistical significance is the only determinant of whether a quantitative result is "important." In this paper, I review traditional null hypothesis statistical testing to identify what questions inferential statistics can and cannot answer, including statistical significance, effect size and direction,…

Propensity score analysis is a statistical method that balances pre-existing differences across treatment conditions achieving a similar condition as randomization and thus, allowing the estimation of causal effects in non-randomized experimental designs. The four stages in propensity score analysis are (1) propensity score estimation, (2)…

Mixed methods research is still an evolving area. However, it has various characteristics like "paradigm pluralism", "focus on research questions than the research design" etc. Mixed methods research is not just one phase of a research but it enters into all stages of research process right from the stage of writing the…