As a form of assessment, examinations are designed to determine whether students have met learning outcomes. However, students with disabilities report avoiding examinations, selecting units of study where the assessments align with their strengths. To ensure examinations do not contribute to the systematic exclusion of students with disabilities,…

Automated writing evaluation (AWE) systems are developed based on interdisciplinary research and technological advances such as natural language processing, computer sciences, and latent semantic analysis. Despite a steady increase in research publications in this area, the results of AWE investigations are often mixed, and their validity may be…

This work investigates how people make judgments about the content of their visual working memory (VWM). Some studies on long-term memory suggest that people base those metacognitive judgments on the outcome of a retrieval attempt. In contrast, Son and Metcalfe (2005) observed that people identify poorly remembered items immediately, presumably by…

Objectives: The purpose of this study is to determine university students' views on online exams during the pandemic. The study was carried out with the participation of 15 undergraduate students studying at an engineering university in Azerbaijan. Methods: Interpretive phenomenology guided the study. Data were collected through semi-structured…

Meta-analytic models for dependent effect sizes have grown increasingly sophisticated over the last few decades, which has created challenges for a priori power calculations. We introduce power approximations for tests of average effect sizes based upon several common approaches for handling dependent effect sizes. In a Monte Carlo simulation, we…

Free text answers to short questions can reflect students' mastery of concepts and their relationships relevant to learning objectives. However, automating the assessment of free text answers has been challenging due to the complexity of natural language. Existing studies often predict the scores of free text answers in a "black box"…

Purpose: This article provides a tutorial introduction to ordinal pattern analysis, a statistical analysis method designed to quantify the extent to which hypotheses of relative change across experimental conditions match observed data at the level of individuals. This method may be a useful addition to familiar parametric statistical methods…

Online tests offer many advantages but they still belong to assessment, which may make learners have anxiety. Thus, students may experience certain emotion. Academic emotion is a branch of emotion and has great effects on student learning. Such effects can be associated with individual differences, especially prior knowledge. To this end, this…

Therapeutic reasoning is when the purpose, task, or goal for engaging in reasoning is to determine the patient's management plan. As the field's understanding of the process of therapeutic reasoning is less well understood, we focused on studies that collected data on the process of therapeutic reasoning. To synthesize previous studies of…

Research on multi-attempt online assessments is sparse and inconclusive and lacks the voice of students. To help bridge the gap, this paper analyzes student survey data across multiple supply chain management classes. The results show that students prefer three attempts on quantitative assessments. The preferences do not depend on age, gender or…

Background: Over the last 20 years, educational large-scale assessments have undergone dramatic changes moving away from simple paper-pencil assessments to innovative, technology-based assessments. This comprehensive switch has led to some rather technical improvements such as identifying early guessing or improving standardization. Objectives: At…

E-assessments are becoming increasingly common and progressively more complex. Consequently, how these longer, more complex questions are designed and marked is imperative. This article uses the NUMBAS e-assessment tool to investigate the best practice for creating longer questions and their mark schemes on surveying modules taken by engineering…

In line with the journal volume's theme, this essay considers lessons from the past and visions for the future of test validity. In the first part of the essay, a description of historical trends in test validity since the early 1900s leads to the natural question of whether the discipline has progressed in its definition and description of test…

A cornerstone activity in undergraduate organic laboratories revolves around students running instrumental analysis on their products and interpreting their spectra. They are left to link the theory they have learned in lecture to practical spectral interpretation. Students often memorize benchmark interpretations of peaks, such as the broad…

Context: A perennial problem in applied statistics is the inability to justify strong claims about cause-and-effect relationships without full knowledge of the mechanism determining selection into treatment. Few research designs other than the well-implemented random assignment study meet this requirement. Researchers have proposed partial…