A tree model for diagnostic educational testing is described along with Monte Carlo simulations designed to evaluate measurement accuracy based on the model. The model is implemented in an assessment of inferential reading comprehension, the Multiple-Choice Online Causal Comprehension Assessment (MOCCA), through a sequential, multidimensional,…

In the 21st century, the urgent educational demand for cultivating complex skills in vocational training and learning is met with the effectiveness of the four-component instructional design model. Despite its success, research has identified a notable gap in the address of formative assessment, particularly within computer-supported frameworks.…

This study investigates the differential impacts of various online language assessment models--specifically, the Nonlinear Dynamic Individual-Centered Language Assessment (NDICLA), diagnostic assessment, and formative assessment--on the cognitive load and learning outcomes of English as a Foreign Language (EFL) learners within computer-assisted…

In learning, errors are ubiquitous and inevitable. As these errors may signal otherwise latent cognitive processes, tutors--and students alike--can greatly benefit from the information they provide. In this paper, we introduce and evaluate the Systematic Error Tracing (SET) model that identifies the possible causes of systematically observed…

Increased online learning is helping many appreciate that online grading, formative assessment, and summative testing can cause instructor burnout and leave little time for more productive instructor interactions. We reimagined grading, assessment, and testing in an extended program of design-based research using situative theory to refine online…

Performance in elementary cognitive tasks is moderately correlated with fluid intelligence and working memory capacity. These correlations are higher for more complex tasks, presumably due to increased demands on working memory capacity. In accordance with the binding hypothesis, which states that working memory capacity reflects the limit of a…

U.S. Supreme Court justices and other federal judges are, effectively, appointed for life, with no built-in check on their cognitive functioning as they approach old age. There is about a century of research on aging and intelligence that shows the vulnerability of processing speed, fluid reasoning, visual-spatial processing, and working memory to…

A family of learning models that integrates a cognitive diagnostic model and a higher-order, hidden Markov model in one framework is proposed. This new framework includes covariates to model skill transition in the learning environment. A Bayesian formulation is adopted to estimate parameters from a learning model. The developed methods are…

The combination of different item formats is found quite often in large scale assessments, and analyses on the dimensionality often indicate multi-dimensionality of tests regarding the task format. In ICILS 2013, three different item types (information-based response tasks, simulation tasks, and authoring tasks) were used to measure computer and…

Complex Problem Solving (CPS) is seen as a cross-curricular 21st century skill that has attracted interest in large-scale-assessments. In the Programme for International Student Assessment (PISA) 2012, CPS was assessed all over the world to gain information on students' skills to acquire and apply knowledge while dealing with nontransparent…

Humans are characterized by an especially highly developed ability to use instructions to prepare toward upcoming events; yet, it is unclear just how powerful instructions can be. Although prior work provides evidence that instructions can be sufficiently powerful to proactively program working memory to execute stimulus-response (S-R)…

The serial and spatially extended nature of many real-world visual tasks suggests the need for control over the content of visual working memory (VWM). We examined the management of VWM in a task that required participants to prioritize individual objects for retention during scene viewing. There were 5 principal findings: (a) Strategic retention…

Identification of the second of two targets (T2) is impaired when presented shortly after the first (T1). This "attentional blink" (AB) is thought to arise from a delay in T2 processing during which T2 is vulnerable to masking. Conventional studies have measured T2 accuracy which is constrained by the 100% ceiling. We avoided this problem by using…

For native (L1) comprehenders, lower-level language processes such as lexical access and parsing are considered to consume few cognitive resources. In contrast, these processes pose considerable demands for second-language (L2) comprehenders. Two reading-time experiments employing inconsistency detection found that English learners did not detect…

This study explores the potential for automated indices related to speech delivery, language use, and topic development to model human judgments of TOEFL speaking proficiency in second language (L2) speech samples. For this study, 244 transcribed TOEFL speech samples taken from 244 L2 learners were analyzed using automated indices taken from…