In this study, we developed machine learning algorithms to automatically score students' written arguments and then applied the cognitive diagnostic modeling (CDM) approach to examine students' cognitive patterns of scientific argumentation. We abstracted three types of skills (i.e., attributes) critical for successful argumentation practice:…

To provide personalized support on educational platforms, it is crucial to model the evolution of students' knowledge states. Knowledge tracing is one of the most popular technologies for this purpose, and deep learning-based methods have achieved state-of-the-art performance. Compared to classical models, such as Bayesian knowledge tracing, which…

Confirmation bias is a universal characteristic of human cognition, with consequences for information processing and reasoning in everyday situations as well as in professional work such as forensic interviewing. Cognitive measures such as general intelligence are also related to personality traits, but there is a lack of research on personality…

Cognitive diagnosis models (CDMs) have been studied as a means of providing detailed diagnostic information about the skills that have been mastered, and the skills that have not, by examinees. Prior research has examined the use of automated test assembly (ATA) alongside CDMs; however, no previous study has investigated how to perform ATA when a…

Feedback is a powerful instructional tool for motivating learning. But effective feedback, requires that instructors have accurate information about their students' current knowledge status and their learning progress. In modern educational measurement, two major theoretical perspectives on student ability and proficiency can be distinguished.…

This meta-analysis examined the validity of an alternative to traditional assessments called the Wonderlic which is a brief measure of general mental ability. Our results showed significant, positive correlations between Wonderlic scores and academic performance in general ([r-bar] = 0.26), between Wonderlic scores and undergraduate GPA in…

This paper presents the concepts and observations in the author's keynote address at the May 2019 "Opportunity versus Challenge: Exploring Usage of Log-File and Process Data in International Large-Scale Assessments" conference in Dublin, Ireland. This paper recaps briefly some key points that emerged at the December 2018 ETS symposium on…

This study investigates the underlying structure of the listening test of the Singapore-Cambridge General Certificate of Education (GCE) exam, comparing the fit of five cognitive diagnostic assessment models comprising the deterministic input noisy "and" gate (DINA), generalized DINA (G-DINA), deterministic input noisy "or"…

This study aims to investigate the relation between preschoolers' social skills as a mediator and delay of gratification as a moderator, and their cognitive distraction strategies and problem behaviors. The participants of this study were 100 randomly selected preschoolers aged 3 to 5 years, who were attending a private preschool in Ankara, the…

This study aimed to address the need for a comprehensive assessment tool to evaluate the mathematical abilities of first-grade students through cognitive diagnostic assessment (CDA). The primary challenge involved in this endeavor was to delineate the specific cognitive skills and sub-skills pertinent to first-grade mathematics (FG-M) and to…

The co-occurrence between autism and gender dysphoria has received much attention recently. We found that, among 101 adults from the general population number of autism traits, as measured using the autism-spectrum quotient was associated significantly with recalled and current gender dysphoric traits. Furthermore, performance on an objective…

Cognitive diagnosis models (CDMs) have gained increasing popularity recently because of their potential to provide diagnostic inferences that can inform learning and teaching. However, the development of cognitive diagnostic assessments (CDAs) is lagging behind the development of the associated psychometric models. At present, it is not clear…

This study aims to conduct differential item functioning analyses in the context of cognitive diagnosis assessments using various formulations of the Wald test. In implementing the Wald test, two scenarios are considered: one where the underlying reduced model can be assumed; and another where a saturated CDM is used. Illustration of the different…

The purpose of this study is to investigate the use of both formative and summative assessment in Taiwan and the United States. The focus is on the comparisons between undergraduate and graduate students and between U.S. and Taiwanese students in their attitudes toward the use of assessment in higher education. Responses from 349 undergraduate and…

The main goal of this study was to validate the strategy for the assessment of the cognitive complexity of chemical kinetics exam items. The strategy included three steps: 1) assessment of the difficulty of concepts, 2) assessment of distractor value, and 3) assessment of concepts' interactivity. One of the tasks was to determine whether there…