Evidence from various domains underlines the critical role that human factors, and especially trust, play in adopting technology by practitioners. In the case of Artificial Intelligence (AI) powered tools, the issue is even more complex due to practitioners' AI-specific misconceptions, myths and fears (e.g., mass unemployment and privacy…

Modern digital technologies enable the efficient collection and processing of student perceptions of teaching quality. However, students' ratings could be confounded by student, teacher, and classroom characteristics. We investigated students' ratings of 26 teachers who used the digital tool Impact! in their mathematics lessons with 14- and…

Purpose: The advancement of technology in the last decades transformed the education from mortar and brick into online teaching and learning. It also changed the assessments from paper-based to technology-supported assessments. This study aims to examine how technology support student's online assessments in higher education institutions from…

The present study is part of a larger mixed methods project that investigated the speaking section of the Advanced Placement (AP) Japanese Language and Culture Exam. It investigated assumptions for the evaluation inference through a content analysis of test taker responses. Results of the content analysis were integrated with those of a many-facet…

Previous research on online features embedded in language assessments have been limited to the use of dictionary or spell/grammar check. Few have examined the role of accessibility features in the Kindergarten to Grade 12 (K-12) English learner (EL) context in the U.S. This study examined how K-12 EL educators perceive and instruct online…

Instructors use a variety of online formative assessment (FA) activities to support learning outside class. Previous studies have revealed barriers for students in online courses, but little is known about the barriers students experience when completing online FA assignments. Understanding these barriers to access is critical to fostering more…

Frequent forced switching between tasks has been shown to reduce switch costs and increase voluntary switch rates. So far, however, the boundary conditions of the influence of forced task switching on voluntary task switching are unknown. Thus, the present study was aimed to test different aspects of generalizability (across items, tasks, and…

Semantic distance is increasingly used for automated scoring of originality on divergent thinking tasks, such as the Alternate Uses Task (AUT). Despite some psychometric support for semantic distance -- including positive correlations with human creativity ratings -- additional work is needed to optimize its reliability and validity, including…

Figural matrices tasks are one of the most prominent item formats used in intelligence tests, and their relevance for the assessment of cognitive abilities is unquestionable. However, despite endeavors of the open science movement to make scientific research accessible on all levels, there is a lack of royalty-free figural matrices tests. The Open…

The transition of our large ([approximately]300 student) introductory soil science course to the online setting created several challenges, including engaging first- and second-year students, providing meaningful hands-on learning activities, and setting up online exams. The objective of this paper is to describe the development and use of…

The arrival of the COVID-19 pandemic had a profound effect on K-12 education. Most schools transitioned to remote instruction, and some used remote testing to assess student learning. Remote testing, however, is less controlled than in-school testing, leading to concerns regarding test-taking engagement. This study compared the disengagement of…

This study aimed to explore the washback effects of implementing online formative assessment (OFA) in Iranian Teacher Education Universities. To this end, a sample of 227 prospective teachers majoring in Teaching English as a Foreign Language and 21 teacher educators were randomly selected. In an explanatory sequential design, their perceptions of…

This quasi-experimental study explored how different online exam types differentiate learners' academic achievement and perceived learning. The participants comprised 95 undergraduate students enrolled in an English course at a Turkish university in three groups, each taking a different type of quiz: with multiple-choice, open-ended, and mixed…

To ensure that student academic growth in a subject area is accurately captured, it is imperative that the underlying scale remains stable over time. As item parameter stability constitutes one of the factors that affects scale stability, NWEA® periodically conducts studies to check for the stability of the item parameter estimates for MAP®…

Many national science frameworks (e.g., Next Generation Science Standards) argue that developing mathematical modeling competencies is critical for students' deep understanding of science. However, science teachers may be unprepared to assess these competencies. We are addressing this need by developing virtual lab performance assessments that…