In recent years, educators, administrators, policymakers, and measurement experts have called for assessments that support educators in making better instructional decisions. One promising approach to measurement to support instructional decision-making is diagnostic classification models (DCMs). DCMs are flexible psychometric models that…

A decision consistency (DC) index is an estimate of the consistency of a classification decision on an exam. More specifically, DC estimates the percentage of examinees that would have the same classification decision on an exam if they were to retake the same or a parallel form of the exam again without memory of taking the exam the first time.…

In many large-scale testing programs, examinees are frequently categorized into different performance levels. These classifications are then used to make high-stakes decisions about examinees in contexts such as in licensure, certification, and educational assessments. Numerous approaches to estimating the consistency and accuracy of this…

This dissertation examined classification outcome differences among four popular individual supervised machine learning (ISML) models (logistic regression, decision tree, support vector machine, and multilayer perceptron) when predicting minor class membership within imbalanced datasets. The study context and the theoretical population sampled…

Evaluation competency frameworks across the globe regard evaluation approaches as important to know and use in practice. Prior classifications have been developed to aid in understanding important differences among varying approaches. Nevertheless, there is an opportunity for a new classification of evaluation approaches, in particular one that is…

This study investigates how 11- to 12-year-old students construct data-based decision trees using data cards for classification purposes. We examine the students' heuristics and reasoning during this process. The research is based on an eight-week teaching unit during which students labeled data, built decision trees, and assessed them using test…

We report findings of this replication study, examining the internalizing subscale (SRSS-I4) of the revised version of the Student Risk Screening Scale for Internalizing and Externalizing behavior (SRSS-IE 9) and the internalizing subscale of the Teacher Report Form (TRF). Using the sample from 13 elementary schools across three U.S. states with…

By assessing student engagement with learning tasks along with students' understanding of subject matter before and during teaching, teachers are able to shift their teaching approaches through improvisational pedagogical reasoning in real time. However, if a teacher does not know how to respond to students' cues, their capacity to effectively…

Student outcomes are of great importance in higher education institutions. Accreditation bodies focus on them as an indicator to measure the performance and effectiveness of the institution. Forecasting students' academic performance is crucial for every educational establishment seeking to enhance performance and perseverance of its students and…

This study analyzed how closely ChatGPT aligned with university IRB (institutional review board) decisions regarding which review category applies to research proposals. A literature review revealed that studies about IRBs mostly focus on ethical aspects of the process; this study offers additional insight into IRB administration. For this study,…

Using data from multiple informants has long been considered best practice in education. However, multiple informants often disagree on similar constructs, complicating decision-making. Polynomial regression and response-surface analysis (PRA) is often used to test the congruence effect between multiple informants on an outcome. However, PRA…

Selecting undergraduate majors or specializations is a crucial decision for students since it considerably impacts their educational and career paths. Moreover, their decisions should match their academic background, interests, and goals to pursue their passions and discover various career paths with motivation. However, such a decision remains…

The nature of education has been transformed by technological advances and online learning platforms, providing educational institutions with more options than ever to thrive in a complex and competitive environment. However, they still face challenges such as academic underachievement, graduation delays, and student dropouts. Fortunately, by…

We have maintained the customer grade system that is being implemented to customers with excellent performance through customer segmentation for years. Currently, financial institutions that operate the customer grade system provide similar services based on the score calculation criteria, but the score calculation criteria vary from the financial…

In recent decades, history and education scholars in the Western world have argued for a constructivist approach to disciplinary thinking in the teaching and learning of History, known as "historical thinking". Yet, there has been little classroom-based empirical research exploring how teachers engage with historical thinking theory,…