In the literature of modern psychometric modeling, mostly related to item response theory (IRT), the fit of model is evaluated through known indices, such as X[superscript 2], M2, and root mean square error of approximation (RMSEA) for absolute assessments as well as Akaike information criterion (AIC), consistent AIC (CAIC), and Bayesian…

Network meta-analysis has been an essential methodology of systematic reviews for comparative effectiveness research. The restricted maximum likelihood (REML) method is one of the current standard inference methods for multivariate, contrast-based meta-analysis models, but recent studies have revealed the resultant confidence intervals of average…

For estimation of heterogeneity variance T[superscript 2] in meta-analysis of log-odds-ratio, we derive new mean- and median-unbiased point estimators and new interval estimators based on a generalized Q statistic, Q[subscript F], in which the weights depend on only the studies' effective sample sizes. We compare them with familiar estimators…

This article presents generalizations of SIBTEST and crossing-SIBTEST statistics for differential item functioning (DIF) investigations involving more than two groups. After reviewing the original two-group setup for these statistics, a set of multigroup generalizations that support contrast matrices for joint tests of DIF are presented. To…

Although generalizability theory (GT) designs have traditionally been analyzed within an ANOVA framework, identical results can be obtained with structural equation models (SEMs) but extended to represent multiple sources of both systematic and measurement error variance, include estimation methods less likely to produce negative variance…

Purpose: This study aims to answer pertinent questions related to the quality of the organisational learning capability measurement model. Design/methodology/approach: A time-separated design informed data collection. The organisational learning capability was exposed to classical higher-order and bifactor confirmatory factor analyses. Multigroup…

Technology education research is a growing field, with the rate of growth increasing over the last 2 decades. As the field grows, it is paramount that credibility is maintained in published findings. To date there is no evidence to suggest a lack trust is warranted, however in the midst of the replication crisis there is need to ensure continued…

Interrupted time series (ITS) are often meta-analysed to inform public health and policy decisions but examination of the statistical methods for ITS analysis and meta-analysis in this context is limited. We simulated meta-analyses of ITS studies with continuous outcome data, analysed the studies using segmented linear regression with two…

Researchers have recognized the need for updates of test anxiety scales for more measurement accuracy. However, studies that investigated the measurement invariance of the Test Anxiety Inventory (TAI), and identified the latent profiles remain scare not withstanding its wide usage in Nigeria. This might have an impact on how generalizability and…

Since the vibration of a single pendulum is very periodic, measuring its period is a very interesting topic. When students are asked to measure the period of a single vibration, they start and stop the stopwatch when the pendulum reaches the top point as a reference point. In this paper, we try to show that the error can be reduced more by using…

Multisite field experiments using the (generalized) randomized block design that assign treatments to individuals within sites are common in education and the social sciences. Under this design, there are two possible estimands of interest and they differ based on whether sites or blocks have fixed or random effects. When the average treatment…

Data harmonization is an emerging approach to strategically combining data from multiple independent studies, enabling addressing new research questions that are not answerable by a single contributing study. A fundamental psychometric challenge for data harmonization is to create commensurate measures for the constructs of interest across…

Reweighting a distribution to minimize a distance to a target distribution is a powerful and flexible strategy for estimating a wide range of causal effects, but can be challenging in practice because optimal weights typically depend on knowledge of the underlying data generating process. In this paper, we focus on design-based weights, which do…

Measurement invariance allows for the comparison and interpretation of scores obtained from the same scales at different times. In this respect, the purpose of this research is to examine the measurement invariance of the satisfaction with life scale applied to different age groups. The study employs the survey model, a type of quantitative…

The Q-matrix played a key role in implementations of diagnostic classification models (DCMs) or cognitive diagnostic models (CDMs) -- a family of psychometric models that are gaining attention in providing diagnostic information on students' mastery of cognitive attributes or skills. Using two Monte Carlo simulation studies, this dissertation…