Coefficient alpha reliability persists as the most common reliability coefficient reported in research. The assumptions for its use are, however, not well-understood. The current paper challenges the commonly used expressions of coefficient alpha and argues that while these expressions are correct when estimating reliability for summed scores,…

Our study investigates whether confidence correlates with consistency in reasoning, specifically about radioactive decay. In prior work, we developed and tested a survey designed to measure consistency of student reasoning about radioactive decay by comparing responses to three prompts that are isomorphic, meaning that, despite having different…

The assessment of human performance is not a new phenomenon. We have evidence that people have been required to prove their worth dating back at least to the Epic of Gilgamesh. What has changed, at least on a large scale, is the importance given to quantitative evidence in the evaluation process. For example, many employers have begun subjecting…

Though qualitative research has become more prevalent in practice over the last 30 years, there is still considerable uncertainty among researchers regarding how to ensure inter-rater consistency when teams are tasked with coding qualitative data. In this article, we offer an explanation of a methodology our qualitative team used to achieve…

The advent of artificial intelligence (AI), particularly large language models (LLMs) like ChatGPT and Gemini, has significantly impacted the educational landscape, offering unique opportunities for learning and assessment. In the realm of written assessment grading, traditionally viewed as a laborious and subjective process, this study sought to…

This study analyzed the fit of data collected with the Measure of Engagement, Independence, and Social Relationships for 3- to 5-year-olds (MEISR 3-to-5-years-old) to a proposed theoretical model based on the cross-walk of MEISR 3-to-5-years-old items and codes from 7 chapters of the Activities and Participation component of the International…

Research universities are increasingly incorporating interdisciplinary education into their strategies. In this transition from monodisciplinary to interdisciplinary education, there is a need for insight into the optimal implementation of such activities. The current study investigates university lecturers' interpretations of interdisciplinary…

This study aimed to develop a test to measure university students' spatial thinking skills. The research was conducted using a survey design, with a sample of 260 undergraduate students from geography teaching and geography departments. GIS software was used to incorporate maps and satellite images, enhancing the spatial representation in the…

We study the returns to experience in teaching, estimated using supervisor ratings from classroom observations. We describe the assumptions required to interpret changes in observation ratings over time as the causal effect of experience on performance. We compare two difference-in-differences strategies: the two-way fixed effects estimator common…

This paper introduces a framework aimed at assessing the sustainability of fashion designers, intending to evaluate their proficiency in sustainability and enhance higher education in design. To establish a system for assessing and evaluating sustainable design competence, we initiated interviews with both designers and fashion design students.…

A large body of research shows that physical activity helps school-aged children and adolescents improve their health and academic performance, and many different types of technology can be used to facilitate and promote physical activity within a school community. This study aimed to develop a valid and reliable questionnaire, titled the…

Purpose: Current knowledge and research on students' utilization and interaction with generative artificial intelligence (AI) tools in their academic work is limited. This study aims to investigate students' engagement with these tools. Design/methodology/approach: This research used survey-based research to investigate generative AI literacy…

There is a need for valid and reliable instruments to assess learning outcomes in education for sustainable development (ESD). Measurement invariance (MI) needs to be established before results of these instruments can be validly compared between groups. Despite its importance, establishing MI is an often overlooked validation step. To provide an…

Traditional authentic assessment tasks are frequently tied to future work and enmeshed in neoliberal and capitalist visions of education. We advocate an alternative approach where authenticity signifies meaningful learning outside the confines of the classroom to promote deep learning that 'sticks'. We proffer an understanding of "assessment…

Introduction: The study of emotional regulation in university students is of great importance given the negative consequences of stress and mental distress caused by emotional dysregulation. The purpose of the study therefore was to carry out confirmatory factor and invariance analysis of Difficulties in Emotional Regulation Scale Short Form,…