Although generalizability theory (GT) designs typically are analyzed using analysis of variance (ANOVA) procedures, they also can be integrated into structural equation models (SEMs). In this tutorial, we review basic concepts for conducting univariate and multivariate GT analyses and demonstrate advantages of doing such analyses within SEM…

Cluster randomized trials (CRTs) are commonly used to evaluate the causal effects of educational interventions, where the entire clusters (e.g., schools) are randomly assigned to treatment or control conditions. This study introduces statistical methods for designing and analyzing two-level (e.g., students nested within schools) and three-level…

Background/Context: Predictive analytics has emerged as an indispensable tool in the education sector, offering insights that can improve student outcomes and inform more equitable policies (Friedler et al., 2019; Kleinberg et al., 2018). However, the widespread adoption of predictive models is hindered by several challenges, including the lack of…

Clinical prediction models are widely used in modern clinical practice. Such models are often developed using individual patient data (IPD) from a single study, but often there are IPD available from multiple studies. This allows using meta-analytical methods for developing prediction models, increasing power and precision. Different studies,…

Background: For randomized trials that use text as an outcome, traditional approaches for assessing treatment impact require each document first be manually coded for constructs of interest by trained human raters. These hand-coded scores are then used as a measured outcome for an impact analysis, with the average scores of the treatment group…

Latent class analysis (LCA) is a useful statistical approach for understanding heterogeneity in a population. This article provides a pedagogical introduction to LCA modeling and provides an example of its use to understand youths' daily coping strategies. The analytic procedures are outlined for choosing the number of classes and integration of…

Setting cutoff scores is one of the most common practices when using scales to aid in classification purposes. This process is usually done univariately where each optimal cutoff value is decided sequentially, subscale by subscale. While it is widely known that this process necessarily reduces the probability of "passing" such a test,…

Academic engagement has been studied for several years because of its influence on student attrition. According to Tinto, engagement is the most important predictor for student dropout, which makes it relevant to understand how the environment influences engagement. Yet very few studies have addressed this relationship outside higher income…

This research aims to propose a bibliometric map of studies on the use of STEM in education. This study used publication co-citation analysis, author co-citation analysis, and word frequency analysis methods to reveal the structure and transformation of STEM literature. Descriptive data such as the distribution of studies in the field by country,…

This paper summarises the exploratory quantitative analysis undertaken to investigate how vocational education and training (VET) students cluster and segment in the Australian VET market. This analysis is outlined in three sections. The first section focuses on 'clustering' as a technique for grouping data and the three clustering algorithms…

In this article, we present a two-stage estimation approach applied to multilevel latent class analysis (LCA) with covariates. We separate the estimation of the measurement and structural model. This makes the extension of the structural model computationally efficient. We investigate the robustness against misspecifications of the proposed…

Transfer beliefs are understudied in the training transfer field, whereas structural equation modelling (SEM) has been a widely used technique to study transfer models. New methodologies are needed to study training transfer and network analysis (NA) has emerged as a new approach that provides a visual representation of a given network. We…

Item harvesters who memorize, record and share test items can jeopardize the validity and fairness of credentialing tests. Item harvesting behaviors are difficult to detect by the existing statistical modeling approaches due to the absence of operational definitions and the idiosyncratic nature of human behaviors. Motivated to detect the…

Individual participant data (IPD) meta-analysis projects obtain, harmonise, and synthesise original data from multiple studies. Many IPD meta-analyses of randomised trials are initiated to identify treatment effect modifiers at the individual level, thus requiring statistical modelling of interactions between treatment effect and participant-level…

Normative studies are needed to obtain norms for comparing individuals with the reference population on relevant clinical or educational measures. Norms can be obtained in an efficient way by regressing the test score on relevant predictors, such as age and sex. When several measures are normed with the same sample, a multivariate regression-based…