This article presents design principles and practical steps for web-based Q methodology surveys. Drawing on the experience of two online Q studies, we discuss theoretical concerns, sort and survey design, software programs, and issues in researcher-participant engagement. We argue that opening Q methodology to online modes of data collection is…

The study of infant gaze has long been a key tool for understanding the developing mind. However, labor-intensive data collection and processing limit the speed at which this understanding can be advanced. Here, we demonstrate an asynchronous workflow for conducting violation-of-expectation (VoE) experiments, which is fully "hands-off"…

Cluster randomized trials (CRTs) are commonly used to evaluate educational interventions, particularly their effectiveness. Recently there has been greater emphasis on using these trials to explore cost-effectiveness. However, methods for establishing the power of cluster randomized cost-effectiveness trials (CRCETs) are limited. This study…

Teaching chemistry and biology students about biologics design remains challenging despite its increasing importance in pharmaceutical development. Monoclonal antibodies, commonly called mAbs, are the most popular biologics. They have been developed into drugs to treat various diseases in the past decades. Multiple challenges exist for designing…

The increasing volume of large-scale assessment data poses a challenge for testing organizations to manage data and conduct psychometric analysis efficiently. Traditional psychometric software presents barriers, such as a lack of functionality for managing data and conducting various standard psychometric analyses efficiently. These challenges…

The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

The enormous developments in technology and hence the widespread use of hand-held devices in the last few decades have led to great interest in mobile-assisted language learning (MALL) as a new way of language education. MALL is considered an effective method particularly for young language learners due to their higher level of familiarity with…

The aim of this paper is to introduce a software that is appropriate for the generalizability theory for not only balanced but also unbalanced data sets. Because it is possible to have unbalanced data sets while conducting a study, the researchers have devised an easy solution, other than deleting data, to balance the design to cope with this…

Propensity score analysis is a statistical method that balances pre-existing differences across treatment conditions achieving a similar condition as randomization and thus, allowing the estimation of causal effects in non-randomized experimental designs. The four stages in propensity score analysis are (1) propensity score estimation, (2)…

Numerous studies in different science fields have examined the various aspects of educational interventions designed to facilitate learning outcomes in students with dyslexia. The aim of this study was to present an overview of empirical research related to interventions aimed at primary school students with dyslexia. Mapping was conducted to…

Network meta-analysis compares multiple treatments in terms of their efficacy and harm by including evidence from randomized controlled trials. Most clinical trials use parallel design, where patients are randomly allocated to different treatments and receive only 1 treatment. However, some trials use within person designs such as split-body,…

This paper discusses some of the recurrent issues which the authors have noticed in educational research. These might be concerned with the nature of social science research, such as its representation of the reality of student learning, the role for replication studies, and the tolerance for disagreements. There are also issues related to the…

Data analysis is one of the most important, yet least understood, stages of the qualitative research process. Through rigorous analysis, data can illuminate the complexity of human behavior, inform interventions, and give voice to people's lived experiences. While significant progress has been made in advancing the rigor of qualitative analysis,…

Many randomized experiments in the social sciences allocate subjects to treatment arms at the time the subjects enroll. Desirable features of the mechanism used to assign subjects to treatment arms are often (1) equal numbers of subjects in intervention and control arms, (2) balanced allocation for population subgroups and across covariates, (3)…

This article describes the analysis of regression-discontinuity designs (RDDs) using the R packages rdd, rdrobust, and rddtools. We discuss similarities and differences between these packages and provide directions on how to use them effectively. We use real data from the Carolina Abecedarian Project to show how an analysis of an RDD can be…