The detection of differential item functioning (DIF) is important in psychological and behavioral sciences. Standard DIF detection methods perform an item-by-item test iteratively, often assuming that all items except the one under investigation are DIF-free. This article proposes a Bayesian adaptive Lasso method to detect DIF in graded response…

Assessment is usually considered as an afterthought in the instructional design process. Given the many challenges of assessment design--and the lack of ready solutions--teachers may fall back on familiar forms of assessments and hope for the best. As a result, the problem is not a lack of will on the part of teachers. Instead, it is the lack of…

Confirmatory factor analyses (CFA) are often used in psychological research when developing measurement models for psychological constructs. Evaluating CFA model fit can be quite challenging, as tests for exact model fit may focus on negligible deviances, while fit indices cannot be interpreted absolutely without specifying thresholds or cutoffs.…

Diagnostic classification models (DCMs) have grown in popularity as stakeholders increasingly desire actionable information related to students' skill competencies. Longitudinal DCMs offer a psychometric framework for providing estimates of students' proficiency status transitions over time. For both cross-sectional and longitudinal DCMs, it is…

This article provides an overview of the unique model and comprehensive approach to tracking, enhancing, and assessing students' global learning outcomes at the University of Pittsburgh's University Center for International Studies (UCIS). In the conclusion, the authors provide a discussion of strengths and challenges of this model that will be…

The evaluation of student projects is a difficult task, especially when they involve both a technical and a creative component. We propose an artificial intelligence (AI)-based methodology to help in the evaluation of complex projects in engineering and computer science courses. This methodology is intended to evaluate the assessment process…

The purpose of this study was to conduct a program evaluation case study on the impact of standards-based grading in a North Carolina school district. The implementation procedures and end products of grading reform were assessed using the CIPP model. Data from teacher questionnaires, principal implementation checklists, interviews, and…

Longitudinal data analysis has been widely employed to examine between-individual differences in within-individual changes. One challenge of such analyses is that the rate-of-change is only available indirectly when change patterns are nonlinear with respect to time. Latent change score models (LCSMs), which can be employed to investigate the…

Purpose: The purpose of this clinical focus article was to illustrate the potential of employing conversation analysis (CA) as a method for assessing social communication that is neurodiversity affirming. Method: This clinical focus article will provide an overview of CA and explain how it offers a theoretically grounded means of analyzing…

The challenge of accurately assessing critical thinking in physics education, particularly on topics like work and energy, remains a key issue for educators. The current study aims to address this challenge by exploring students' critical thinking abilities using two-tier test data analyzed through the Rasch model. Data were collected from…

Argumentation Method, which is based on data, claims, justifications, is used in education when it comes to scientific and controversial issues. The purpose of this research, is to demonstrate how argumentation method can be used in social studies courses and to guide social studies pedagogy. Examples of activities related to how argumentation can…

The recent integration of visual capabilities into Large Language Models (LLMs) has the potential to play a pivotal role in science and technology education, where visual elements such as diagrams, charts, and tables are commonly used to improve the learning experience. This study investigates the performance of ChatGPT-4 Vision, OpenAI's most…

Knowledge tracing (KT) models are a popular approach for predicting students' future performance at practice problems using their prior attempts. Though many innovations have been made in KT, most models including the state-of-the-art Deep KT (DKT) mainly leverage each student's response either as correct or incorrect, ignoring its content. In…

The present study compares two methods for assessing peer influence: the longitudinal actor-partner interdependence model (L-APIM) and the longitudinal social network analysis (L-SNA) Model. The data were drawn from 1,995 (49% girls and 51% boys) third grade students (M[subscript age] = 9.68 years). From this sample, L-APIM (n = 206…

This paper proposes a training model for raters, with the goal to improve the intra- and inter-consistency of evaluation quality for higher education curricula. The model, termed the learning, behaviour and reaction (LBR) circular training model, is an interdisciplinary application from the business and organisational training domain. The…