The population relationship between coefficient alpha and scale reliability is studied in the widely used setting of unidimensional multicomponent measuring instruments. It is demonstrated that for any set of component loadings on the common factor, regardless of the extent of their inequality, the discrepancy between alpha and reliability can be…

In this article we attempt to reconstruct the tacit and implicit notions of quality in the humanities. This reconstruction is based on a series of semi-structured qualitative interviews with 33 humanities scholars. Applying Max Weber's theory of authority, we argue the quality notions have two different sources--external and internal. External…

Generative Artificial Intelligence (GenAI), such as ChatGPT, is reshaping educational paradigms by offering unparalleled benefits and introducing challenges, particularly academic integrity. This study investigates teaching laboratory practices (traditional, recorded, remote, simulation and virtual), considered an academic safe haven due to its…

Evaluation capacity building (ECB) continues to attract the attention and interest of scholars and practitioners. Over the years, models, frameworks, strategies, and practices related to ECB have been developed and implemented. Although ECB is highly contextual, the evolution of knowledge in this area depends on learning from past efforts in a…

Although robust evidence has been accumulating over the last decades supporting the effectiveness of career counseling in various populations, yet there are scarce conceptual or empirical studies investigating the impact of distinct approaches, such as traditional-"psychometric," narrative, or a mixed (integrative) one. The primary aim…

The study of national research assessment exercises serves to evaluate the effectiveness of policies versus their objectives and to improve the formulation of future initiatives. The aim of the current study is to verify whether the introduction of the first performance-based research funding in Italy, based on the 2004-10 VQR assessment, achieved…

The purpose of this study is to review the status of differential item functioning (DIF) research in language testing, particularly as it relates to the investigation of sources (or causes) of DIF, which is a defining characteristic of the third generation DIF. This review included 110 DIF studies of language tests dated from 1985 to 2019. We…

This review aims to synthesize a published set of evaluative criteria for good qualitative research. The aim is to shed light on existing standards for assessing the rigor of qualitative research encompassing a range of epistemological and ontological standpoints. Using a systematic search strategy, published journal articles that deliberate…

This bibliometric article examines the current state of publication in the field of classroom assessment, exploring the productivity and influence of countries, institutions, and authors. A search query of on the Scopus database using the term "classroom assessment" or "classroom-based assessment" or "assessment for…

This article sheds light on criticism of the increasing degree of formalisation in collating and synthesising research findings in the systematic review format in education. A textual analysis of two systematic reviews produced by the Swedish Institute for Educational Research unpacks the significance of interaction between formalisation and…

More than 20 years after the first round of the OECD's Programme for International Student Assessment (PISA), it has become one of the most important large-scale international assessments, at a global level and in particular in Europe. Thus, a growing number of scholars have examined or discussed its research design. Nonetheless, a key feature of…

The use of Mixed Methods (MM) in evaluation has increasingly become a valuable asset in evaluators' methodological toolbox. Despite prolific research on various aspects of mixed methods, from typologies to ontological debates, there remains a dearth of empirically derived evidence on effectively communicating MM findings. This lack of empirical…

Mixed-format tests that include both multiple-choice (MC) and constructed-response (CR) items have become widely used in many large-scale assessments. When an item response theory (IRT) model is used to score a mixed-format test, the unidimensionality assumption may be violated if the CR items measure a different construct from that measured by MC…

This dissertation contributes to the discussion of what contributes to school district rankings in the state of Ohio. It uses Latent Profile Analysis to explore different variables at the contextual and district level as they correspond to Ohio's Performance Index academic measure and Value-Added academic measure. Results show that contextual…

In many sectors and in many respects, interdisciplinarity has made progress in recent decades, but less so when it comes to evaluating interdisciplinary work. Challenges remain, especially regarding what counts as 'good' interdisciplinarity. While previous reviews describe broad trends contributing to these challenges, high-level observations are…