Accounting for model misspecification in Bayesian structural equation models is an active area of research. We present a uniquely Bayesian approach to misspecification that models the degree of misspecification as a parameter--a parameter akin to the correlation root mean squared residual. The misspecification parameter can be interpreted on its…

Researchers often have hypotheses concerning the state of affairs in the population from which they sampled their data to compare group means. The classical frequentist approach provides one way of carrying out hypothesis testing using ANOVA to state the null hypothesis that there is no difference in the means and proceed with multiple comparisons…

This article compares the purposes and content of the four foundational documents of the American Evaluation Association (AEA): the Program Evaluation Standards, the AEA Public Statement on Cultural Competence in Evaluation, the AEA Evaluator Competencies, and the AEA Guiding Principles. This reflection on alignment is an early effort in the third…

Quality Assessment Frameworks (QAFs) are standardized templates that include pre-defined criteria, open questions, or a combination to assess the quality of evaluations. They support organizations to limit risks associated with poor-quality evaluation. Qualitative research focused on four QAFs shows that five dimensions of quality are assessed…

University rankings have a growing impact on how people view the academic excellence of higher education. The complicated relationship between rankings and academic excellence is explored in this essay along with how it may affect higher education policy and practice. The importance of rankings and their influence on institutional decision-making…

Network meta-analysis (NMA) uses both direct and indirect evidence to compare the efficacy and harm between several treatments. Structural equation modeling (SEM) is a statistical method that investigates relations among observed and latent variables. Previous studies have shown that the contrast-based Lu-Ades model for NMA can be implemented in…

Thinking skills play a critical role in determining language performance. Recent advancement in cognitive diagnostic modelling (CDM) provides a powerful tool for obtaining fine-grained information regarding these thinking skills during reading. Studies are scant, however, exploring the relations between thinking skills and language performance,…

This dissertation investigates the application of network models in educational assessment across diverse learning settings, encompassing both clinical and classroom environments. As educational paradigms shift and digital tools become more embedded in learning processes, traditional assessment methods often fall short in effectively capturing the…

Purpose: Multilingual children are disproportionately represented on speech pathology caseloads, in part due to the limited ability of traditional language assessments to accurately capture multilingual children's language abilities. This systematic review evaluates the evidence for identification of language disorder in multilingual children…

This study uses a complexity-accuracy-lexis-fluency (CALF) framework to explore performance on 2 speaking tasks: a narrative picture-based task and an interactive decision-making task. A preliminary aim is to compare performance on the 2 tasks, using a wide range of CALF measures to explore where scores are similar and where they are different.…

The main objective of the article is to compare several methods of evaluating multiple-choice options through classical item analysis. The methods subjected to examination include the tabulation of choice distribution, the interpretation of trace lines, the point-biserial correlation, the categorical analysis of trace lines, and the investigation…

Digital technologies have transformed the way people interact, work and learn. The emergency transition to online teaching and learning necessitated by the coronavirus (COVID-19) pandemic has posed a serious challenge to instructional routines of higher education systems across OECD countries. The pandemic has demonstrated the ability of higher…

Many institutions of higher education increasingly place a focus on various forms of experiential education, including personal reflections. While much work has been done in this and related areas, the resources currently available are not sufficient to effectively guide, assess, and evaluate student learning through reflection. Guiding students…

Concept inventories (CIs) are assessment instruments designed to measure students' conceptual understanding of fundamental concepts in particular fields. CIs utilise multiple-choice questions (MCQs), and specifically designed response selections, to help identify misconceptions. One shortcoming of this assessment instrument is that it fails to…

This study investigated the effects of two types of classroom instructions on EFL learners' oral proficiency by implementing teachers' judgment. Two intact classes of EFL university students studied a compulsory subject of their department under two different types of classroom instruction. The first group of students was trained with explicit…