Latent profile analysis (LPA) identifies heterogeneous subgroups based on continuous indicators that represent different dimensions. It is a common practice to measure each dimension using items, create composite or factor scores for each dimension, and use these scores as indicators of profiles in LPA. In this case, measurement models for…

Replicating research studies is considered one way of establishing validity and confidence of findings in a field of study. In this paper, we introduce a replication framework for classifying studies conducted in the area of educational technology as a possible guide to conducting and reporting replication studies in the field. The paper includes…

Industrial design (ID) education involves students with different cognition types. This study aims to explore and compare the design activities of problem-driven and solution-driven students and examine the stability of the design process of the two classifications regarding constraints. Based on the P-S index derived from…

Courses: Communication Theory; Research Methods; Mass Communication Theory. Objectives: This activity introduces students to the socially constructed nature of theorizing through having a few students sort a bag of random items in ways of their choice. The class then discusses the categories of sorted items in terms of their properties as theories…

When scores are used to make decisions about respondents, it is of interest to estimate classification accuracy (CA), the probability of making a correct decision, and classification consistency (CC), the probability of making the same decision across two parallel administrations of the measure. Model-based estimates of CA and CC computed from the…

Sociologists increasingly face choices among competing algorithms that represent reasonable approaches to the same task, with little guidance in choosing among them. We develop a strategy that uses simulated data to identify the conditions under which different methods perform well and applies what is learned from the simulations to predict which…

The notion of definition is a central building block of mathematics. In addition to specific definitions, it is desirable that students learn about meta-mathematical aspects of definitions such as their role of classification, and about characteristics of definitions such as arbitrariness. We investigated how such meta-mathematical aspects emerge…

Subject departments are an increasingly important unit of analysis for research on schools and beginning teachers' experiences. By analysing a practice-based typology of eight departmental types through an exploratory factor analysis of questionnaires completed by beginning teachers (n = 55), the authors refined the typology to four (hierarchical;…

Increased use of computer-based assessments has facilitated data collection processes that capture both response product data (i.e., correct and incorrect) and response process data (e.g., time-stamped action sequences). Evidence suggests a strong relationship between respondents' correct/incorrect responses and their problem-solving proficiency…

This dissertation examines the effectiveness of machine learning algorithms and feature engineering techniques for analyzing process data and predicting test performance. The study compares three classification approaches and identifies item-specific process features that are highly predictive of student performance. The findings suggest that…

The automated classification of examination questions based on Bloom's Taxonomy (BT) aims to assist the question setters so that high-quality question papers are produced. Most studies to automate this process adopted the machine learning approach, and only a few utilised the deep learning approach. The pre-trained contextual and non-contextual…

This study, framed by dignity-focused language policy and intersectional anti-adultism, investigates how 74 adults misclassified as English learners (ELs) during U.S. K-12 education conceptualize essential knowledge for educating bilingual students. Through semi-structured interviews, participants stressed two key areas for schools that serve…

False alarming, or detecting an error when there is not one, is a pervasive problem across numerous industries. The present study investigated the role of elaboration, or additional information about non-error differences in complex visual displays, for mitigating false error responding. In Experiment 1, learners studied errors and non-error…

Recent developments in the use of large-language models have led to substantial improvements in the accuracy of content-based automated scoring of free-text responses. The reported accuracy levels suggest that automated systems could have widespread applicability in assessment. However, before they are used in operational testing, other aspects of…

In scholarly research, racial categories are typically taken for granted. However, race categories vary over time and geography and reflect the social beliefs of the people who use them. Informed by quantitative critical race theory analysis, we interrogate how race categories align (or not) with 24,000 U.S. higher education students' responses to…