In recent years, educators, administrators, policymakers, and measurement experts have called for assessments that support educators in making better instructional decisions. One promising approach to measurement to support instructional decision-making is diagnostic classification models (DCMs). DCMs are flexible psychometric models that…

The forced-choice (FC) item formats used for noncognitive tests typically develop a set of response options that measure different traits and instruct respondents to make judgments among these options in terms of their preference to control the response biases that are commonly observed in normative tests. Diagnostic classification models (DCMs)…

The drift diffusion model (DDM) is a widely applied computational model of decision making that allows differentiation between latent cognitive and residual processes. One main assumption of the DDM that has undergone little empirical testing is the level of independence between cognitive and motor responses. If true, widespread incorporation of…

Although there is a broad consensus that both the procedural and declarative memory systems play a crucial role in language learning, use, and knowledge, the mapping between linguistic types and memory structures remains underspecified: by default, a dual-route mapping of language systems to memory systems is assumed, with declarative memory…

High stakes testing, such as IELTS, is designed to select individuals for decision-making purposes (Fulcher, 2013b). Hence, there is a slow-growing stream of research investigating the subskills of IELTS listening and, in feedback terms, its effects on individuals and educational programs. Here, cognitive diagnostic assessment (CDA) performs it…

This article introduces the Diagnostic Profiles (DP) standard setting method for setting a performance standard on a test developed from a cognitive diagnostic model (CDM), the outcome of which is a profile of mastered and not-mastered skills or attributes rather than a single test score. In the DP method, the key judgment task for panelists is a…

The encoding of letter position is a key aspect in all recently proposed models of visual-word recognition. We analyzed the impact of lexical frequency on letter position assignment by examining the temporal dynamics of lexical activation induced by pseudowords extracted from words of different frequencies. For each word (e.g., BRIDGE), we created…

Prior knowledge is a very important part of teaching and learning, as it affects how instructors and students interact with the learning materials. In general, tests are used to assess students' prior knowledge. Nevertheless, conventional testing approaches usually assign only an overall score to each student, and this may mean that students are…

Double reading of chest x-rays is often used to ensure that fewer abnormalities are missed, but very little is known about how the search behavior of others affects observer performance. A series of experiments investigated whether radiographers benefit from knowing where another person looked for pulmonary nodules, and whether the expertise of…

RTI as a framework for decision making has implications for the diagnosis of specific learning disabilities. Any diagnostic tool must meet certain standards to demonstrate that its use leads to predictable decisions with minimal risk. Classification agreement analyses are described as optimal for demonstrating the technical adequacy of RTI…

According to classical theories, automatic processes are autonomous and independent of higher level cognitive influence. In contrast, the authors propose that automatic processing depends on attentional sensitization of task-congruent processing pathways. In 3 experiments, the authors tested this hypothesis with a modified masked semantic priming…

After reviewing the information that teachers and other decision makers need to have about student achievement and some recent advances in the theory and practice of reading assessment, the author makes a number of recommendations for improving assessment programs. These include: do less massive, broad-band testing, but improve the reliability and…

A study was conducted to investigate learner control of instruction in contrast to response sensitive branching algorithms with respect to two specific types of instructional decisions: (1) whether a student should enter and study a particular instructional module given his score on an associated diagnostic pretest; and (2) when a student should…

This paper lays out the rationale and implementation of student modeling and updating in the HYDRIVE intelligent tutoring system (ITS) for aircraft hydraulic systems. An epistemic level of modeling concerns the plans and goals students are using to guide their problem solving, as inferred from specific actions in specific contexts. These results…

The goal of the Pre Teacher Assessment Center is to give college sophomores a diagnostic assessment of their potential teaching skills across 13 skill dimensions felt to be prerequisites for teaching. The pre teacher assessment provides students with detailed information about potential teaching strengths and weaknesses and helps remediate…