Designing and constructing pedagogical tests that contain items (i.e. questions) which measure various types of skills for different levels of students equitably is a challenging task. Teachers and item writers alike need to ensure that the quality of assessment materials is consistent, if student evaluations are to be objective and effective.…

Insufficient effort responding (IER) refers to a lack of effort when answering survey or questionnaire items. Such items typically offer more than two ordered response categories, with Likert-type scales as the most prominent example. The underlying assumption is that the successive categories reflect increasing levels of the latent variable…

The debate about whether the capacity of working memory (WM) varies with the complexity of memory items continues. This study employed novel experimental materials to investigate the role of complexity in WM capacity. Across seven experiments, we explored the relationship between complexity and WM capacity. The results indicated that the…

Assessing the difficulty of reading comprehension questions is crucial to educational methodologies and language understanding technologies. Traditional methods of assessing question difficulty rely frequently on human judgments or shallow metrics, often failing to accurately capture the intricate cognitive demands of answering a question. This…

Many people use technological tools that are widely accessible, respond quickly, and have extensive information networks today. Due to recent technological advances in education and the increasing acceptance of Artificial Intelligence (AI) technologies, the issues regarding their implementation in education require identification and analysis.…

Background: During the COVID-19 pandemic, the United States' Centers for Disease Control and Prevention (CDC) created guidance documents that were too complex to be read and understood by the majority of adults with intellectual and developmental disabilities who often read at or below a third-grade reading level. This study explored the extent to…

According to cognitive load theory, learning can only be successful when instructional materials and procedures are designed in accordance with human cognitive architecture. In this context, one of the biggest challenges is the accurate measurement of the different cognitive load types as these are associated with various activities during…

Learning engagement has gained increasing attention in the field of education. Previous studies have adopted conventional methods to analyze learning engagement, but these methods cannot provide timely feedback for learners. This study analyzed automated group learning engagement via deep neural network models in a computer-supported collaborative…

To assemble a high-quality test, psychometricians rely on subject matter experts (SMEs) to write high-quality items. However, SMEs are not typically given the opportunity to provide input on which content standards are most suitable for multiple-choice questions (MCQs). In the present study, we explored the relationship between perceived MCQ…

The "ACTFL Proficiency Guidelines" serve as a roadmap for foreign/second language (L2) instruction, assessment, curriculum development, and textbook writing. However, very little research has investigated the validity claims of the "ACTFL Guidelines." This study empirically verifies the difficulty hierarchy suggested by…

In organizational anarchies (i.e., public institutions) decisions are typically made by oversight or flight. Decision makers and choice opportunities exist simultaneously but on separate tracks resulting in few problems being solved. This paper presents the findings of a study surveying current literature on organizational anarchy as well as…

When displaying text on a page or a screen, only a finite number of characters can be presented on a single line. If the text exceeds that finite value, then text wrapping occurs. Often this process results in longer, more difficult to process words being positioned at the start of a line. We conducted an eye movement study to examine how this…

Serious games are a growing field in academic research and they are considered an effective tool for education. Game-based learning invokes motivation and engagement in students resulting in effective instructional outcomes. An essential aspect of a serious game is the method of support for presenting the teaching material and providing feedback.…

Considerable research suggests a link between mind wandering and diminished levels of motivation and interest. During episodes of mind wandering, individuals may engage in efforts to redirect their attention back to the task at hand (known as focus back effort). Building on the resource-control hypothesis, we hypothesized that the influence of…

Math anxiety (MA) is an important affective factor that contributes to individuals' math proficiency. While self-reports are commonly used to measure MA, a number of limitations are inherently connected to this measuring method. Physiological responses are considered a promising alternative approach, but research is scarce and the empirical…