Measurement invariance (MI) is an essential part of validity evidence concerned with ensuring that tests function similarly across groups, contexts, and time. Most evaluations of MI involve multigroup confirmatory factor analyses (MGCFA) that assume simple structure. However, recent research has shown that constraining non-target indicators to…

This study argues that readability formulas should be used as one measure of linguistic equivalence when adapting psychometric scales from one language to another. Assuming that the psychological structure being measured was not changed, it was observed that calculated readability levels and interpretations were different for two different…

In health technology assessment, matching-adjusted indirect comparison (MAIC) is the most common method for pairwise comparisons that control for imbalances in baseline characteristics across trials. One of the primary challenges in MAIC is the need to properly account for the additional uncertainty introduced by the matching process. Limited…

To address the computational constraints of parameter estimation in the polytomous Cognitive Diagnosis Model (pCDM) in large-scale high data volume situations, this study proposes two two-stage polytomous attribute estimation methods: P_max and P_linear. The effects of the two-stage methods were studied via a Monte Carlo simulation study, and the…

Pedagogical content knowledge (PCK) is important for teachers' instructional effectiveness. This study investigated the self-reported level of PCK among in-service elementary school science teachers in a municipality in Ghana, examining the overall level of PCK. An In-Service Elementary Science Teachers Self-Reported PCK (IEST-SR-PCK) scale was…

Mokken Scale Analysis (MSA) is a nonparametric approach that offers exploratory tools for understanding the nature of item responses while emphasizing invariance requirements. MSA is often discussed as it relates to Rasch measurement theory, which also emphasizes invariance, but uses parametric models. Researchers who have compared and combined…

This study aimed to assess the methods and outcomes of The Measurement Tool to Assess systematic Reviews (AMSTAR) 2 appraisals in overviews of reviews (overviews) of interventions in the cardiovascular field and identify factors that are associated with these outcomes. MEDLINE, Scopus, and the Cochrane Database of Systematic Reviews were searched…

Big Ideas in school mathematics can be seen as overarching concepts that occur in various mathematical topics in a syllabus. For teachers, this knowledge can be used to help students develop a better understanding of mathematics by making visible the central ideas, and connection across topics and across levels. For students, this knowledge can…

This paper is motivated by a desire to advance assessment in the health professions through encouraging the judicious and productive use of metaphors. Through five specific examples (pixels, driving lesson/test, jury deliberations, signal processing, and assessment as a toolbox), we interrogate how metaphors are being used in assessment to…

The measurement of resistance training (RT) is often based on adaptations of aerobic physical activity measures which may not contain the elements necessary to assess RT. The purpose of this systematic review was to examine what measures are used to assess RT and appraise their composition. Specifically, the inclusion of frequency, duration,…

Researchers who use measurement models for evaluation purposes often select models with stringent requirements, such as Rasch models, which are parametric. Mokken Scale Analysis (MSA) offers a theory-driven nonparametric modeling approach that may be more appropriate for some measurement applications. Researchers have discussed using MSA as a…

We present the validation of a questionnaire for compulsory secondary school students (seventh to tenth grade), designated "Educational learning environments for ESO pupils" (CEApA_ESO), for the purpose of evaluating learning environments. Although many instruments have been developed in this area, our work attempts to comprehensively…

We investigated three different approaches for quantifying individual change and reporting it back to persons: (a) the common change score, which is obtained by first computing scale scores from two consecutive measurements and then subtract these scores from one another, (b) the ad-hoc approach, which is similar to the former approach but uses…

Multidimensional measuring instruments are often used in behavioral, social, educational, marketing, and biomedical research. For these scales, the paper discusses how to find the optimal score based on their components that is associated with the highest possible reliability. Within the framework of structural equation modeling, an approach to…

Although most evaluators are familiar with participatory evaluation (PE), the ability to measure stakeholder participation in an evaluation remains challenging. Based on Cousins and Whitmore's (1998) PE theoretical model, Daigneault and Jacob (2009, 2012, 2014) developed an instrument for measuring the degree to which an evaluation can be…