A linear model is often used to find the effect of a binary treatment D on a noncontinuous outcome Y with covariates X. Particularly, a binary Y gives the popular "linear probability model (LPM)," but the linear model is untenable if X contains a continuous regressor. This raises the question: what kind of treatment effect does the…

Mediation analysis plays an important role in understanding causal processes in social and behavioral sciences. While path analysis with composite scores was criticized to yield biased parameter estimates when variables contain measurement errors, recent literature has pointed out that the population values of parameters of latent-variable models…

The aim of this study is to develop a valid and reliable measurement tool to identify teachers' tendencies towards professional development models. In line with the purpose of scale development, a survey model was preferred. The scale was designed to be applicable to teachers from various disciplines currently working in any institution…

When a researcher proposes an SEM model to explain the dynamics among some latent variables, the real question in model evaluation is the fit of the model's structural part. A composite index that lumps the fit of the structural part and measurement part does not directly address that question. The need for more attention to structural-level fit…

Given the lack of cultural consideration of studies on digital natives, this study reports on a large-scale validation of the Digital Native Assessment Scale (DNAS) among university students from three regions of Greater China: Chinese mainland, Macau, and Taiwan, to examine measurement invariance and latent mean differences in the four constructs…

Research in the social and behavioral sciences relies on a wide range of experimental and quasi-experimental designs to estimate the causal effects of specific programs, policies, and events. In this paper we highlight measurement issues relevant to evaluating the validity of causal estimation and generalization. These issues impact all four…

Academic engagement plays a crucial role in students' learning and performance. One of the most popular measures for assessing this construct is the Utrecht Work Engagement Scale for Students (UWES-S), which is based on a tridimensional conceptualization consisting of dedication, vigor, and absorption. However, prior research on its factor…

Background: Secondary behaviours, which encompass reactions developed due to an individual's fear and stress about stuttering, have the potential to exacerbate the condition. Therefore, self-evaluation of secondary behaviours is significant in the multidimensional approach for people who stutter (PWS). Aim: To determine the validity and…

When randomized control trials are not possible, quasi-experimental methods often represent the gold standard. One quasi-experimental method is difference-in-difference (DiD), which compares changes in outcomes before and after treatment across groups to estimate a causal effect. DiD researchers often use fairly exhaustive robustness checks to…

Regression discontinuity (RD) designs have gained significant popularity as a quasi-experimental device for evaluating education programs and policies. In this paper, we present a comprehensive review of RD designs, focusing on the continuity-based framework, the most widely adopted RD framework. We first review the fundamental aspects of RD…

When comparing relations and means of latent variables, it is important to establish measurement invariance (MI). Most methods to assess MI are based on confirmatory factor analysis (CFA). Recently, new methods have been developed based on exploratory factor analysis (EFA); most notably, as extensions of multi-group EFA, researchers introduced…

While significant attention has been given to test equating to ensure score comparability, limited research has explored equating methods for rater-mediated assessments, where human raters inherently introduce error. If not properly addressed, these errors can undermine score interchangeability and test validity. This study proposes an equating…

Internalizing and externalizing problems are common targets for school mental health screening. Prior research supports the interpretation of scores from the Youth Internalizing Problems Screener (YIPS) and the Youth Externalizing Problems Screener (YEPS), which were developed separately yet intended as companion measures. We extended previous…

Working with approximations is a common practice in physics. This paper presents an exploratory study of student understanding of some of the elementary aspects of approximations encountered in college physics. For this purpose, a questionnaire (a set of 14 multiple-choice questions) was developed to probe how students dealt with these aspects in…

Online learning has grown due to the advancement of technology and flexibility. Online examinations measure students' knowledge and skills. Traditional question papers include inconsistent difficulty levels, arbitrary question allocations, and poor grading. The suggested model calibrates question paper difficulty based on student performance to…