Postsecondary mathematics classrooms continue to become more diverse, which implores educators to continue to incorporate more diverse modes of assessment to support all learners. However, researchers have found that mathematics assessment at the postsecondary level has remained mostly stagnant, with traditional, closed-book exams dominating the…

This paper started with the examination of the effect of mobile-based reading test on EFL test-takers of different attitudes from their perception of metacognitive strategy use and the knock-on impact on test results. Then other possible factors of such impact are explored and corresponding solutions are presented. Quantitative analysis of…

Universities use learning management systems (LMS) to support teaching practices and add value to the educational system. A leading university in the gulf region (XYZ) provides support for faculty members (FMs) through its Center of Excellence in Teaching and Learning (CETL), where experts respond to their enquiries on how to use the LMS features.…

Summative year end assessments are a major component of student assessment at the Department of Chemical Engineering, Imperial College London. More than 600 students participate in over 40 different exams during the summer term. At the end of the spring term, the college moved to fully remote operation due to COVID-19, leaving the academic…

Automated scoring based on Latent Semantic Analysis (LSA) has been successfully used to score essays and constrained short answer responses. Scoring tests that capture open-ended, short answer responses poses some challenges for machine learning approaches. We used LSA techniques to score short answer responses to the Consequences Test, a measure…

Research has shown that the context of practice tasks can have a significant impact on learning, with long-term retention and transfer improving when tasks of different types are mixed by interleaving (abcabcabc) compared with grouping together in blocks (aaabbbccc). This study examines the influence of context via interleaving from a psychometric…

The interest in using online formative assessment activities has gradually increased in both traditional teaching and distance education processes. Research emphasizes the importance of using online formative assessment in learning processes. Due to this fact, it is essential to uncover pre-service teachers' thoughts about online formative…

The use of new digital formats in language learning and testing improves both the learning and acquisition skills development process of language tests. The process of listening comprehension is considered one of the most complex in the field of Computer Aided Learning Language (CALL) because it relates to multimodal learning channels and brain…

A new vision of science learning described in the "Next Generation Science Standards"--particularly the science and engineering practices and their integration with content--pose significant challenges for large-scale assessment. This article explores what might be learned from advances in large-scale science assessment and…

This paper is the second in a series from Educational Testing Service (ETS) that conceptualizes next-generation English language proficiency (ELP) assessment systems for K-12 English learners (ELs) in the United States.The first paper articulated a high-level conceptualization of next-generation ELP assessment systems (Hauck, Wolf, & Mislevy,…

Exploratory and confirmatory factor analyses of domestic data from the" GRE"® revised General Test, introduced in 2011, were conducted separately for the verbal (VBL) and quantitative (QNT) reasoning measures to evaluate the unidimensionality and local independence assumptions required by item response theory (IRT). Results based on data…

This article addresses the issue of how to detect item preknowledge using item response time data in two computer-based large-scale licensure examinations. Item preknowledge is indicated by an unexpected short response time and a correct response. Two samples were used for detecting item preknowledge for each examination. The first sample was from…

This study examined whether computerized dynamic testing by utilizing a robot would lead to different patterns in children's (aged 6-9 years) potential for learning and strategy use when solving series-completion tasks. The robot, in a "Wizard of Oz" setting, provided instructions and prompts during dynamic testing. It was found that a…

Over the past decade, large-scale testing programs have employed technology-enhanced items (TEI) to improve the fidelity with which an item measures a targeted construct. This paper presents findings from a review of released TEIs employed by large-scale testing programs worldwide. Analyses examine the prevalence with which different types of TEIs…

Recently it has been shown that rewarded variability can be used to adapt visuomotor behavior. However, its relevance seems limited because adaptation to binary rewards has been demonstrated only when the same movement is repeated throughout the experiment. We therefore investigated whether the adaptation is action-specific and whether the amount…