The number of low-performing schools has drastically increased since COVID-19. During the 2018-2019 school year, there were 488 low-performing schools (North Carolina Department of Public Instruction, 2024). The number increased to 736 schools during the 2023- 2024 school year, a 50.8% increase (North Carolina Department of Public Instruction,…

This scope-review presents the milestones of how Hierarchical Rater Models (HRMs) become operable to used in automated essay scoring (AES) to improve instructional evaluation. Although essay evaluations--a useful instrument for evaluating higher-order cognitive abilities--have always depended on human raters, concerns regarding rater bias,…

One of the central components of cognitive diagnostic assessment is the Q-matrix, which is an essential loading indicator matrix and is typically constructed by subject matter experts. Nonetheless, to a large extent, the construction of Q-matrix remains a subjective process and might lead to misspecifications. Many researchers have recognized the…

This article seeks to contribute to the reflection around the training of future designers regarding teamwork. Collaboration, teamwork and negotiations are common everyday interactions that are now known to contribute positively to the design process. This article builds on a theoretical model that was initially proposed as a Ph.D. thesis…

This study proposes a Bayesian method for diagnostic classification models (DCMs) for a partially known Q-matrix setting between exploratory and confirmatory DCMs. This Q-matrix setting is practical and useful because test experts have pre-knowledge of the Q-matrix but cannot readily specify it completely. The proposed method employs priors for…

Educational tests often have a cluster of items linked by a common stimulus ("testlet"). In such a design, the dependencies caused between items are called "testlet effects." In particular, the directional testlet effect (DTE) refers to a recursive influence whereby responses to earlier items can positively or negatively affect…

Purpose: The increasing societal requirement requests higher education institutions to be more responsive to socioeconomic needs and new governmental demands. This study aims to present a self-developed multidimensional quality assurance and assessment model for higher education institutions -- R.I.S.E model (relevance, impact, significance and…

Assessing instruction quality is a fundamental component of any improvement efforts in the education system. However, traditional manual assessments are expensive, subjective, and heavily dependent on observers' expertise and idiosyncratic factors, preventing teachers from getting timely and frequent feedback. Different from prior research that…

Traditional validation approaches fail to account for the ways oppressive systems (e.g. racism, radical nationalism) impact the test design and development process. To disrupt this legacy of white supremacy, we illustrate how justice-oriented, antiracist validation (JAV) framework can be applied to construct articulation and validation, data…

The purpose of this study was to demonstrate the effectiveness level of the Provus-Alkin-amalgamation evaluation application based on Weighted-Product-"Rwa-Bhineda" modification through the results of field trials. This evaluation application was an evaluation tool formed by a combination of educational evaluation models (Provus model…

This article presents the consensus of an National Council on Measurement in Education Presidential Task Force on Foundational Competencies in Educational Measurement. Foundational competencies are those that support future development of additional professional and disciplinary competencies. The authors develop a framework for foundational…

Research in the area of Open Student Models (OSMs) has shown that external representations of the student model can be used to facilitate educational processes such as student reflection, knowledge awareness, learning, collaboration, negotiation, and student model diagnosis. OSMs can be integrated into existing learning systems or become a…

Senate Bill (SB) 1882 partnerships, codified into Texas state law in 2017, are the latest iteration of portfolio management models (PMMs) in elementary and secondary education. PMMs aim to overhaul the current governance structure of public education, granting autonomy over critical areas of school operations to school operators, while using the…

Cognitive Diagnosis Models (CDMs) are a special family of discrete latent variable models that are widely used in educational and psychological measurement. A key component of CDMs is the Q-matrix characterizing the dependence structure between the items and the latent attributes. Additionally, researchers also assume in many applications certain…

Through this point-of-departure paper we aim to prompt discussion and action around redesigning university learning to help students tackle climate-related challenges in a personally and societally meaningful way. We use the lens of assessment to draw attention to how discipline areas without an explicit environmental or climate science focus can…