Background: Learning analytics (LA) research often aggregates learning process data to extract measurements indicating constructs of interest. However, the warranty that such aggregation will produce reliable measurements has not been explicitly examined. The reliability evidence of aggregate measurements has rarely been reported, leaving an…

Scale validation is vital to psychological research because it ensures that scores from measurement scales represent the intended construct. Factor analysis fit indices are commonly used to provide quantitative evidence that a proposed factor structure is plausible. However, there is mismatch between guidelines for evaluating fit of factor models…

Survey instruments and assessments are frequently used in many domains of social science. When the constructs that these assessments try to measure become multifaceted, multidimensional item response theory (MIRT) provides a unified framework and convenient statistical tool for item analysis, calibration, and scoring. However, the computational…

Purpose: Utilizing teacher socialization in physical education theory, the aim of this study was to develop a survey to measure physical education teachers' socialization experiences and comprehensive school physical activity program involvement. Method: Instrument development included a review of existing comprehensive school physical activity…

The increasing volume of large-scale assessment data poses a challenge for testing organizations to manage data and conduct psychometric analysis efficiently. Traditional psychometric software presents barriers, such as a lack of functionality for managing data and conducting various standard psychometric analyses efficiently. These challenges…

Computational thinking (CT) is an emerging and multifaceted competence important to the computing era. However, despite the growing consensus that CT is a competence domain, its theoretical and empirical account remain scarce in the current literature. To address this issue, rigorous psychometric evaluation procedures were adopted to investigate…

In educational and psychological research, we are often interested in discrete latent states of individuals responding to an assessment (e.g., proficiency or non-proficiency on educational standards, the presence or absence of a psychological disorder). Diagnostic classification models (DCMs; also called cognitive diagnostic models [CDMs]) are a…

Structural equation models comprise a large class of popular statistical models, including factor analysis models, certain mixed models, and extensions thereof. Model estimation is complicated by the fact that we typically have multiple interdependent response variables and multiple latent variables (which may also be called random effects or…

Background and Context: Valid assessment of understanding of programming concepts in primary school children is essential to implement and improve programming education. Objective: We developed and validated the Computerized Adaptive Programming Concepts Test (CAPCT) with a novel application of Item Response Theory. The CAPCT is a web-based and…

The main goal of the current study is to develop a reliable instrument to measure programming anxiety in university students. A pool of 33 items based on extensive literature review and experts' opinions were created by researchers. The draft scale comprised three factors applied to 392 university students from two different universities in Turkey…

This study is designed to reveal the research trends of graduate theses published in the field of computer programming in K-12 between 2018 and 2022. Document analysis was used for data collection in this study. The data was divided into 9 categories, and the results demonstrated that the scholars in the Departments of Computer Educational and…

We are moving toward a future in which digital practices are becoming more ubiquitous. Also, there is evidence to suggest that innovative digital practices are changing the face of 21st-century learning environments. Critical to 21st-century teaching and learning success is continued emphasis on learner preferences, shaped by innovative digital…