In this study, we introduced a cross-classified multidimensional nominal response model (CC-MNRM) to account for various response styles (RS) in the presence of cross-classified data. The proposed model allows slopes to vary across items and can explore impacts of observed covariates on latent constructs. We applied a recently developed variant of…

Much has been made of the apparent capacity for creativity of generative AI. However, as research expands the knowledge base regarding the capabilities and performance of this technology, the prevailing view is shifting away from "AI is creative" and towards a more balanced model of Human-AI co-creativity. Nevertheless, even this…

The quantitative study examined the impact of intercultural competency training on Education Support Professionals (ESP) through pre- and post-testing using the Intercultural Development Inventory (IDI®). The IDI® is based upon Bennett's Developmental Model of Intercultural Sensitivity (DMIS). The examination of ESP intercultural competency was…

Fitting wrongly specified models to observed data may lead to invalid inferences about the model parameters of interest. The current study investigated the performance of the posterior predictive model checking (PPMC) approach in detecting model-data misfit of the hierarchical rater model (HRM). The HRM is a rater-mediated model that incorporates…

Computer programming is a difficult course for many students. Prior works advocated for group learning pedagogies in pursuit of higher-level reasoning and conceptual understanding. However, the methodological gaps in existing implementations warrant further research. This study conducted a three-armed cluster-randomized controlled trial to…

Traditional letter and number grades are inaccurate and harmful to children, while research indicates that standards-based grading is both more accurate and better for all stakeholders. However, despite standards-based report cards (SBRCs) coming in many forms, the best number and arrangement of performance level descriptors (PLDs) remains…

Since the pandemic, the United States has faced tremendous teacher shortages (Riser-Kositsky, 2021) and national organizations have called for measures to address barriers related to teacher hiring and retention (NEA, 2022a., b; White House, 2022). Many states -- including California -- require pre-service teachers to pass state performance…

These are the appendices for the technical report, "An Investigation of the Comparability of Commission-Approved Teaching Performance Assessment Models." California's Commission on Teacher Credentialing (Commission) requires all programs of preliminary multiple and single subject teacher preparation to use a Commission-approved Teaching…

Performance assessments, scenario-based tasks, and other groups of items carry a risk of violating the local item independence assumption made by unidimensional item response theory (IRT) models. Previous studies have identified negative impacts of ignoring such violations, most notably inflated reliability estimates. Still, the influence of this…

The purpose of this longitudinal, mixed methods quasi-experimental study was to investigate the impact of balanced literacy coaching on teacher efficacy, practices, beliefs, and student achievement. The participants were third- through sixth-grade teachers from five elementary schools within the same south suburban Chicago public school district.…

Background: In low-stakes educational assessments, test takers might show a performance decline (PD) on end-of-test items. PD is a concern in educational assessments, especially when groups of students are to be compared on the proficiency variable because item responses gathered in the groups could be differently affected by PD. In order to…

Using nine years of student evaluation of teaching (SET) data from a large US research university, we examine whether changes to the SET instrument have a substantial impact on overall instructor scores. Our study exploits four distinct natural experiments that arose when the SET instrument was changed. To maximise power, we compare the same…

We study whether changes in school emphasis on academic success (SEAS) and safe schools (SAFE) may explain the increased science performance in Norway between TIMSS 2007 and 2011. Two-level structural equation modelling (SEM) of merged TIMSS data was used to investigate whether changes in levels of SEAS and SAFE mediate the changes in science…

This paper examines empirically the determinants of student evaluation of teaching (SET). Empirical models were specified and estimated using the SET data collected in Hong Kong over six academic years. A key finding is that three different origins of students had a differentiated impact on teaching evaluation. In particular, students from…

This study integrated the Spiral Curriculum approach into the Robust Learning Model as part of a continuous improvement process that was designed to improve educational effectiveness and then assessed the differences between the initial and integrated models as well as the predictability of the first course in the integrated learning model on a…