A tree model for diagnostic educational testing is described along with Monte Carlo simulations designed to evaluate measurement accuracy based on the model. The model is implemented in an assessment of inferential reading comprehension, the Multiple-Choice Online Causal Comprehension Assessment (MOCCA), through a sequential, multidimensional,…

We conducted a collective case study investigating two college algebra students' graph reasoning and selection on an online assessment. Students completed the assessment during individual, semi-structured interviews, as part of a broader validation study. The assessment contained six items; students selected Cartesian graphs to represent…

This is an editorial for a special issue "Innovations in Exploring Sequential Process Data" in the journal Zeitschrift für Psychologie. Process data refer to log files generated by human-computer interactive items. They document the entire process, including keystrokes, mouse clicks as well as the associated time stamps, performed by a…

The rising use of technology in classrooms has also brought with it a concomitant wave of computer-based assessments. The argument for computer-based testing is often framed in terms of efficiency and data management: computer-based tests facilitate more efficient processing of test data and the rate at which feedback can be leveraged for student…

This study was conducted to reveal potential sources of students' difficulty and misconceptions about geometrical concepts with the help of eye tracking. In this study, the students' geometrical misconceptions were explored by answering the questions on the geometry test prepared based on the literature and test-taking processes and represented…

Many test items use both an image and text, but present them in a spatially separate manner. This format could potentially cause a split-attention effect in which the test taker's cognitive load is increased by having to split attention between the image and text, while mentally integrating the two sources of information. We investigated the…

The last three decades have seen significant development in understanding and describing the effects of task complexity on learner internal processes. However, researchers have primarily employed behavioral methods to investigate task-generated cognitive load. Being the first to adopt neuroimaging to study second language (L2) task effects, we…

Introduction: Students often answer questions from available expository texts for assessment and learning purposes. These activities require readers to activate not only meaning-making processes (e.g., paraphrases or elaborations), but also metacognitive operations (e.g., monitoring readers' own comprehension or self-regulating reading behaviors)…

The aim of the present study is to reconcile previous findings (a) that testing mode has no effect on test outcomes or cognitive load (Comput Hum Behav 77:1-10, 2017) and (b) that younger learners' working memory processes are more sensitive to computer-based test formats (J Psychoeduc Assess 37(3):382-394, 2019). We addressed key methodological…

In the 21st century, the urgent educational demand for cultivating complex skills in vocational training and learning is met with the effectiveness of the four-component instructional design model. Despite its success, research has identified a notable gap in the address of formative assessment, particularly within computer-supported frameworks.…

Students' problem-solving strategies and the differences among strategy groups were explored by analyzing the process data collected during student interactions with computer-based science items. Data were gathered from 1516 eleventh-grade students from 4 schools in China. Analyses of the sequences of students' response actions revealed that the…

This first attempt aims to determine the extent of students' covert use of machine translation (MT) in the online assessment of their sight translation, the strategies of such use, and its signs. The study is based on the analysis of target texts (TT) of specialised online sight translation from Ukrainian into English by 13 BA and 10 MA students.…

The current study aimed to investigate the effectiveness of an online dynamic test in reading and writing, differentiating in typically developing children (n = 47) and children diagnosed with dyslexia (n = 30) aged between nine and twelve years. In doing so, it was analysed whether visual working memory, auditory working memory, inhibition,…

Psychophysiological responses have been studied as objective indicators for measuring a learner's cognitive load. Previous studies have correlated pupil dilation or fixation length with increased cognitive load. Our aims were to confirm whether these findings could be applied in a general learning context and to verify the additivity hypothesis of…

This paper presents the concepts and observations in the author's keynote address at the May 2019 "Opportunity versus Challenge: Exploring Usage of Log-File and Process Data in International Large-Scale Assessments" conference in Dublin, Ireland. This paper recaps briefly some key points that emerged at the December 2018 ETS symposium on…