Several branches of the potential outcome causal inference literature have discussed the merits of blocking versus complete randomization. Some have concluded it can never hurt the precision of estimates, and some have concluded it can hurt. In this article, we reconcile these apparently conflicting views, give a more thorough discussion of what…

Background: The generalizability of a study's results continues to be at the forefront of concerns in evaluation research in education (Tipton & Olsen, 2018). Over the past decade, statisticians have developed methods, mainly based on propensity scores, to improve generalizations in the absence of random sampling (Stuart et al., 2011; Tipton,…

Fetters et al.'s (2013) mixed methods integration framework uses construction metaphors: building, connecting, merging, and embedding. In a similar vein, this article uses an architectural metaphor and introduces design patterns as building blocks for mixed methods research design. A design pattern embeds one specific design decision into its…

The quality of mixing methods has been widely debated in the field of applied linguistics (AL) and the integration of data from both quantitative and qualitative research paradigms has always been open to controversy. The present study was aimed at recognizing the status quo of MMR in AL, investigating the nature of various sections of MMR…

I. Purpose of the Study: Detecting whether interventions work or not (through main effect analysis) can provide empirical evidence regarding the causal linkage between malleable factors (e.g., interventions) and learner outcomes. In complement, moderation analyses help delineate for whom and under what conditions intervention effects are most…

Recent metascience suggests that motor behavior research may be underpowered, on average. Researchers can perform a priori power analyses to ensure adequately powered studies. However, there are common pitfalls that can result in underestimating the required sample size for a given design and effect size of interest. Critical evaluation of power…

This paper informs users of data collected in international large-scale assessments (ILSA), by presenting argumentsunderlining the importance of considering two design features employed in these studies. We examine a commonmisconception stating that the uncertainty arising from the assessment design is negligible compared with that arisingfrom the…

Simple matrix sampling planned missing (SMS PD) design, introduce missing data patterns that lead to covariances between variables that are not jointly observed, and create difficulties for analyses other than mean and variance estimations. Based on prior research, we adopted a new multigroup confirmatory factor analysis (CFA) approach to handle…

Optimal sampling frameworks attempt to identify the most efficient sampling plans to achieve an adequate statistical power. Although such calculations are theoretical in nature, they are critical to the judicious and wise use of funding because they serve as important starting points that guide practical discussions around sampling tradeoffs and…

Experimental studies of educational interventions are rarely based on representative samples of the target population. This simulation study tests two formal sampling strategies for selecting districts and schools from within strata when they may not agree to participate if selected: (1) balanced selection of the most typical district or school…

We conducted a systematic literature review examining the participant characteristics of studies of students with emotional disturbance (ED) with the purpose of better understanding potential similarities and differences between students with ED in research and the population of students with ED. Results indicate (a) participants with reported…

The study aimed to conduct a systematic literature review to identify the trends, impacts, and challenges of mobile microlearning (MML) research. Using five academic databases from the fields of social science, engineering, and medical science as search sources, 26 scholarly articles, published between 2015 and 2020, were retrieved. The study…

Sample size determination in multilevel randomized trials (MRTs) and multilevel regression discontinuity designs (MRDDs) can be complicated due to multilevel structure, monetary restrictions, differing marginal costs per treatment and control units, and range restrictions in sample size at one or more levels. These issues have sparked a set of…

The topic of gifted adults is underexamined and little is known about what issues are important to those interested in the topic, and the ideas influencing their work. This online questionnaire study, part of a larger project investigating the current status of research with gifted adults, examines what 76 international experts are interested in,…

Although STEM is an essential feature of 21st-century education and learning, there is a lack of awareness about it in Pakistan, especially at the K-12 and tertiary levels. Recently many initiatives have been launched across Pakistan to create more interest in STEM education. In order to assist in raising the level of STEM awareness in Pakistan,…