The increased availability of time-related information as a result of computer-based assessment has enabled new ways to measure test-taking engagement. One of these ways is to distinguish between solution and rapid guessing behavior. Prior research has recommended response-level filtering to deal with rapid guessing. Response-level filtering can…

Although generalizability theory (GT) designs typically are analyzed using analysis of variance (ANOVA) procedures, they also can be integrated into structural equation models (SEMs). In this tutorial, we review basic concepts for conducting univariate and multivariate GT analyses and demonstrate advantages of doing such analyses within SEM…

Research in human development often relies on composites, that is, composed variables such as indices. Their composite nature renders these variables inaccessible to conventional factor-centric psychometric validation techniques such as confirmatory factor analysis (CFA). In the context of human development research, there is currently no…

This Perspectives on Practice manuscript focuses on an innovation associated with "Engaging Teachers in the Powerful Combination of Mathematical Modeling and Social Justice: The Flint Water Task" [EJ1264816] from Volume 7, Issue 2 of "MTE." We built on Aguirre et al.'s (2019) integration of mathematical modeling and social…

Combining observational and experimental data for causal inference can improve treatment effect estimation. However, many observational data sets cannot be released due to data privacy considerations, so one researcher may not have access to both experimental and observational data. Nonetheless, a small amount of risk of disclosing sensitive…

Applied researchers faced with limited resources can utilize planned missing designs by incorporating missing data into their research design to collect more and higher quality data compared to a conventional experimental design. Two-method measurement planned missing designs (TMM-PMD) are a type of planned missing design whereby researchers…

A procedure for evaluating the average R-squared index for a given set of observed variables in an exploratory factor analysis model is discussed. The method can be used as an effective aid in the process of model choice with respect to the number of factors underlying the interrelationships among studied measures. The approach is developed within…

Simulation studies involving mixture models inevitably aggregate parameter estimates and other output across numerous replications. A primary issue that arises in these methodological investigations is label switching. The current study compares several label switching corrections that are commonly used when dealing with mixture models. A growth…

A widely applicable procedure of examining proximity to unidimensionality for multicomponent measuring instruments with multidimensional structure is discussed. The method is developed within the framework of latent variable modeling and allows one to point and interval estimate an explained variance proportion-based index that may be considered a…

A two-level data set can be structured in either long format (LF) or wide format (WF), and both have corresponding SEM approaches for estimating multilevel models. Intuitively, one might expect these approaches to perform similarly. However, the two data formats yield data matrices with different numbers of columns and rows, and their "cols :…

Random encouragement designs are randomized controlled trials (RCTs) that test interventions aimed at increasing participation in a program or activity whose take up is not universal. In these RCTs, instead of randomizing individuals or clusters directly into treatment and control groups to participate in a program or activity, the randomization…

When analyzing treatment effects on test scores, researchers face many choices and competing guidance for scoring tests and modeling results. This study examines the impact of scoring choices through simulation and an empirical application. Results show that estimates from multiple methods applied to the same data will vary because two-step models…

Structural equation models offer a valuable tool for delineating the complicated interrelationships among multiple variables, including observed and latent variables. Over the last few decades, structural equation models have successfully analyzed complete and right-censored survival data, exemplified by wide applications in psychological, social,…

This study draws on quantitative reasoning research to explain how secondary mathematics preservice teachers' (PSTs) modelling competencies changed as they participated in a teacher education programme that integrated modelling experience. Adopting a mixed methods approach, we documented 110 PSTs' competencies in Vietnam using an adapted Modelling…

Evaluators are often called upon to assess the effects of programs. To assess a program effect, evaluators need a clear understanding of how a program effect is defined. Arguably, the most widely used definition of a program effect is the counterfactual one. According to the counterfactual definition, a program effect is the difference between…