The use of the aggregate scoring method for scoring concordance tests requires the weighting of test items to be derived from the performance of a group of experts who take the test under the same conditions as the examinees. However, the average score of experts constituting the reference panel remains a critical issue in the use of these tests.…

The patterns of skills in adults who have difficulty with reading may be different from those of children, and thus applying and interpreting methods of measurement may be complex. The goal of this study was to examine the relations among reading skills in this population, by modeling specific reading skills and method of measurement…

Evidence synthesis findings depend on the assumption that the included studies follow good clinical practice and results are not fabricated or false. Studies which are problematic due to scientific misconduct, poor research practice, or honest error may distort evidence synthesis findings. Authors of evidence synthesis need transparent mechanisms…

This paper proposes to evaluate learning efficiency by implementing the flipped classroom and automatic source code evaluation based on the Kirkpatrick evaluation model in students of CS1 programming course. The experimentation was conducted with 82 students from two CS1 courses; an experimental group (EG = 56) and a control group (CG = 26). Each…

The use of bibliometric indicators in research evaluation has a series of complex impacts on academic inquiry. These systems have gradually spread into a wide range of locations and disciplines, including the humanities. The aim of this study is to examine their effects as perceived by philosophy and ethics researchers in Spain, a country where…

This study proposed Gibbs sampling algorithms for variable selection in a latent regression model under a unidimensional two-parameter logistic item response theory model. Three types of shrinkage priors were employed to obtain shrinkage estimates: double-exponential (i.e., Laplace), horseshoe, and horseshoe+ priors. These shrinkage priors were…

This paper reports a series of studies that assessed the performance of students on continuous assessment components from two courses in an undergraduate psychology programme. Data were collected from two consecutive cohorts of students (total N = 576) and the grades of students were compared based on additional learning needs (ALN; ALN versus No…

To uncover and analyze conceptualizations of cross-institutional collaboration in engineering education, a systematic review study was conducted, identifying commonalities in frameworks, assessments and evaluations, and challenges across prior studies. 74 papers were reviewed, revealing "study descriptors," "theoretically applied…

The multiple imputation two-stage (MI2S) approach holds promise for evaluating the model fit of structural equation models for ordinal variables with multiply imputed data. However, previous studies only examined the performance of MI2S-based residual-based test statistics. This study extends previous research by examining the performance of two…

Purpose: This study aims to help researchers design observational measurement systems that yield sufficiently stable scores for estimating caregiver talk among caregivers of infant siblings of autistic and non-autistic children. Stable estimates minimize error introduced by facets of the measurement system, such as variability between coders or…

This work tested the hypothesis that the academic performance of students in a distance learning course in Biological Sciences (PBS-CEDERJ) decreased during the COVID-19 pandemic in disciplines with and without practical activities. Performance was quantified via students' grades in PBS-CEDERJ disciplines in pre-pandemic years (2018 and 2019) and…

Time is often an accommodation used to ensure equity during assessments. The assumption is that the provision of additional time would help learners who require accommodations. In this study we examined 29 learners of differing spatial ability on visual learning tasks using static and dynamic digital images. The performance and time required to…

This study proposes a Bayesian method for diagnostic classification models (DCMs) for a partially known Q-matrix setting between exploratory and confirmatory DCMs. This Q-matrix setting is practical and useful because test experts have pre-knowledge of the Q-matrix but cannot readily specify it completely. The proposed method employs priors for…

The aim of this article is to provide a model for assessing service-learning projects mediated by a stakeholder approach to managing such educational pursuits. The method used for substantiating this proposal consists of matching the process of stakeholder analysis, customised for experiential learning, with the project scope and monitoring…

Factor analysis is widely utilized to identify latent factors underlying the observed variables. This paper presents a comprehensive comparative study of two widely used methods for determining the optimal number of factors in factor analysis, the K1 rule, and parallel analysis, along with a more recently developed method, the bass-ackward method.…