In this study, we take a critical look at the degree to which the measurement of bullying and sense of belonging at school is invariant across groups of students defined by immigrant status. Our study focuses on the invariance of these constructs as measured on a recent PISA administration and includes a discussion of two statistical methods for…

Mathematical modeling is crucial in the field of education, particularly in mathematics, as it enhances students' mathematical skills and prepares them for solving real-world problems. The study focuses on the challenges of teaching mathematical modeling, specifically in the Malaysian education system. We utilized a case study approach, involving…

Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

Learning objectives (LOs) are a pillar of course design and execution and thus a focus of curricular reforms. This study explored the extent to which the creation and usage of LOs might be facilitated by three leading chatbots: ChatGPT-4o, Claude 3.5 Sonnet, and Google Gemini Advanced. We posed three main questions, as follows: "question…

Background: Automated writing evaluation (AWE) systems, used as formative assessment tools in writing classrooms, are promising for enhancing instruction and improving student performance. Although meta-analytic evidence supports AWE's effectiveness in various contexts, research on its effectiveness in the U.S. K-12 setting has lagged behind its…

This study focuses on the second round of Taiwanese teacher preparation program (TPP) evaluation (2012-2017) to analyze how evaluation policy shapes TPPs. In-depth interviews were conducted with 13 stakeholders, which included professors, administrators, researchers, and staff involved in TPP evaluation. First, the findings revealed that…

Connecting assessment with teaching through faculty capacity building can be a design principle in any assessment project aimed at improving student learning. This design principle is supported by the evaluation capacity-building literature, backward design curriculum approach, research on learning, and inquiry-driven assessment-for-learning…

This article emerges as part of the Grand Challenges in Assessment Project and describes two approaches to driving innovation in assessment. Each approach can be used to drive innovation, promising failure, and equity in assessment, teaching, and learning. The first approach, the TRIZ exercise, focuses on an approach to drive innovation at a…

Background: People with aphasia rely on gesture more than healthy controls to get their message across, but use a limited range of gesture types. Gesture therapy is thus a potential avenue of intervention for people with aphasia. However, currently no gesture assessment evaluates how they use gesture. Such a tool could inform therapy targets and…

The didactic evaluation represents one of the most important components of the teaching / learning process, that can offer professors the image of the level in which their students acquire the knowledge they were taught. In the present paper, we are planning to describe the status and role of self-evaluation in student assessment and a possible…

Journals that adopt open peer review (OPR), where review reports of published articles are publicly available, provide an opportunity to study both review content characteristics and quantitative aspects of the overall review process. This study investigates two areas relevant to the quality assessment of manuscript reviews. First, do journal…

The idea of group work assessment is often seen as complicated, but necessary given the value of group work to learning. However, the traditional method involving a collective grade has been shown to be a less effective option, and raises questions about fairness for the students. Utilizing an evaluation factor provides a more inclusive assessment…

Funders of social interventions that address complex child and family welfare concerns for highly vulnerable populations are increasingly seeking cost-effective and rapid mixed method evaluations of their services. This paper describes a mind mapping approach that was used to collect valid and reliable qualitative data from large numbers of…

Paraprofessionals have become a significant portion of the educational workforce for students with or at risk for needing, or receiving special educational services. Although best practice and federal legislation require supervision of paraprofessionals by certified professional educators, research indicates that supervision rendered to…

Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we…