While multimodality and multiliteracies has been a concept for 25 years (Kalantzis & Cope, 2023; The New London Group, 1996), research on and application of the concept within text complexity measures has been limited. Attempts to assess multiliteracies and multimodality (Jacobs, 2013; Schmerbeck & Lucht, 2017; Wyatt-Smith & Kimber,…

Many methods are used to measure interrater reliability for studies where each target receives ratings by a different set of judges. The purpose of this study is to explore the use of hierarchical modeling for estimating interrater reliability using the intraclass correlation coefficient. This study provides a description of how the ICC can be…

This study, grounded in a phenomenological exploration, investigates whether current teacher evaluation methods account for subjectivism in teaching, learning, and evaluation within the context of Georgia's Teacher Keys Effectiveness System TKES. Through focus groups with instructional evaluators IEs, the study reveals the significant impact of…

The assessment of human performance is not a new phenomenon. We have evidence that people have been required to prove their worth dating back at least to the Epic of Gilgamesh. What has changed, at least on a large scale, is the importance given to quantitative evidence in the evaluation process. For example, many employers have begun subjecting…

Constructed response (CR) items are widely used in large-scale testing programs, including the National Assessment of Educational Progress (NAEP) and many district and state-level assessments in the United States. One unique feature of CR items is that they depend on human raters to assess the quality of examinees' work. The judgment of human…

Nursing education programs are faced with urgent demands to transition to competency-based education (CBE) to address the limitations of the nursing workforce. The AACN (2021) has developed the Essentials, or the core competencies for graduating entry- and advanced-level nurses to inform CBE. A concept analysis of Foundational Competence was…

For decades, evaluators have noted that it is difficult for stakeholders to accept negative evaluation results (Carter, 1971; Taut & Brauns, 2003). There is a need for additional research on evaluation to better understand when and why stakeholders reject negative or critical evaluation findings. Drawing on social identity theory (SIT), the…

The Performance Assessment and Evaluation System (PAES) is used by all major universities in the state of Utah to measure the effective teaching skills of preservice candidates as they progress through their teaching preparation program. The resulting ratings are used to make high-stakes decisions relating to course completion as well as…

The use of Simulation-Based Learning (SBL) has increased in Nutrition and Dietetic (N&D) programs, although the research supporting its usability in N&D students is lacking. There are limited quality SBL instruments available that have been validated and tested for reliability in N&D students preparing for clinical practice. This…

No Child Left Behind (NCLB) cemented a standardized testing assessment culture in the United States but research has highlighted the inequities (Au, 2020; Dixon, 1978; Grodsky et al., 2008; Khan, 2020; Moses & Nanna, 2007), unreliability (Hunt et al., 2010; Pizmony-Levy & Green Saraisky, 2016) and negative impacts (Berryhill et al., 2009;…

Clinical Reasoning (CR) integrates thinking and decision-making in clinical practice (Huhn et al., 2019). CR is an established area of research in Doctor of Physical Therapy (DPT) education (Musolino & Jensen, 2019; Jensen & Mostrom, 2012) and has been acknowledged as a core competency of physical therapist residency education (APTA…

As assessments move towards computerized testing and making continuous testing available the need for rapid assembly of forms is increasing. The objective of this study was to investigate variability in assembled forms through the lens of first- and second-order equity properties of equating, by examining three factors and their interactions. Two…

Background: Accurate and meaningful assessment of language and communication skills to monitor child progress is the cornerstone to appropriate intervention for children with complex communication needs (CCN; Brady et al., 2016; Rowland et al., 2012). Despite this need, there is a lack of high quality and validated measurement of young children…

The purpose of this study was to develop a multidimensional College Mental Health Assessment Inventory (CMHAI) specifically for the college student population. In the first phase, a conceptual and theoretical review of general existing scales was performed, followed by conducting exploratory semi-structured interviews with twelve participants.…

The study aimed to elicit information from Vietnamese EFL university instructors about their knowledge and skills regarding the principles, theory, and practices of language assessment by means of revision and validation of the Language Assessment Literacy--Revised Vietnam (LAL-RV), which was previously developed by Kremmel and Harding (2020). A…