Understanding student cognitive states is essential for assessing human learning. The deep neural networks (DNN)-inspired cognitive state prediction method improved prediction performance significantly; however, the lack of explainability with DNNs and the unitary scoring approach fail to reveal the factors influencing human learning. Identifying…

Performance in elementary cognitive tasks is moderately correlated with fluid intelligence and working memory capacity. These correlations are higher for more complex tasks, presumably due to increased demands on working memory capacity. In accordance with the binding hypothesis, which states that working memory capacity reflects the limit of a…

Recent advances in cognitive science and psychometrics have expanded the possibilities for the next generation of literacy assessment as an integrated domain (Bennett, 2011a; Deane, Sabatini, & O'Reilly, 2011; Leighton & Gierl, 2011; Sabatini, Albro, & O'Reilly, 2012). In this paper, we discuss four key areas supporting innovations in…

Over the last several decades, researchers have studied many and varied aspects of rater cognition. Those interested in pursuing basic research have focused on gaining an understanding of raters' thought processes as they score different types of performances and products, striving to understand how raters' mental representations and the cognitive…

We examined the contribution of the phonological loop to immediate free recall (IFR) and immediate serial recall (ISR) of lists of between one and 15 words. Following Baddeley (1986, 2000, 2007, 2012), we assumed that visual words could be recoded into the phonological store when presented silently but that recoding would be prevented by…

The ability to flexibly adapt to the changing demands of the environment is often reported as a core deficit in fragile X syndrome (FXS). However, the cognitive processes that determine this attentional set-shifting deficit remain elusive. The present study investigated attentional set-shifting ability in fragile X syndrome males with the…

In representation-rich domains such as organic chemistry, students must be facile and accurate when translating between different 2D representations, such as diagrams. We hypothesized that translating between organic chemistry diagrams would be more accurate when concrete models were used because difficult mental processes could be augmented by…

A variety of cognitive diagnosis approaches (CDAs) have been used by researchers to extract fine-grained information about the linguistic knowledge states and skill mastery levels of test takers based on their performance on language tests. Although some of these approaches have been in use in the psychometric community for quite some time, many…

Assessment of complex task performance is crucial to evaluating personnel in critical job functions such as Navy damage control operations aboard ships. Games and simulations can be instrumental in this process, as they can present a broad range of complex scenarios without involving harm to people or property. However, "automatic"…

Presents a model of the cognitive frameworks and processes used by essay scorers. Investigates the relationship between a scorer's reading style and proficiency with a scoring rubric. Finds that proficient scorers are better able to withhold judgment and may focus their efforts more intensely on the process of evaluation. Discusses implications of…

A probabilistic approach is introduced to classify and diagnose erroneous rules of operation resulting from a variety of misconceptions ("bugs") in a procedural domain of arithmetic. The model is contrasted with the deterministic approach which has commonly been used in the field of artificial intelligence, and the advantage of treating the…

Conjunctive item response models are introduced such that: (1) sufficient statistics for latent traits are not necessarily additive in item scores; (2) items are not necessarily locally independent; and (3) existing compensatory (additive) item response models including the binomial, Rasch, logistic, and general locally independent model are…

The recently published fourth edition of the Wechsler Intelligence Scale for Children (WISC-IV) represents a considerable departure from previous versions of the scale. The structure of the instrument has changed, and some subtests have been added and others deleted. The technical manual for the WISC-IV provided evidence supporting this new…

Critical variables that underlie the performance of a national sample of young adults on a diverse set of document literacy tasks were identified. The final sample was 3,618 adults. The identification of these variables provides an important first step toward building a theoretical model that would systematically account for the constructs of…

Constructed-response formats are desired for measuring complex and dynamic response processes that require the examinee to understand the structures of problems and micro-level cognitive tasks. These micro-level tasks and their organized structures are usually unobservable. This study shows that elementary graph theory is useful for organizing…