Background: There is a lack of critical or empirical work interrogating the nature and purpose of evaluating technology use in education. Objectives: In this study, we examine the values underpinning the evaluation of technology use in education through field specialist perceptions. The study also poses critical reflections about the rigour of…

Background: The sudden growth in online instruction due to COVID-19 restrictions has given renewed urgency to questions about remote learning that have remained unresolved. Web-based assessment software provides instructors an array of options for varying testing parameters, but the pedagogical impacts of some of these variations has yet to be…

Background Studies: Captioning and repetition are widely used multimedia instructional devices for non-native students. Generally, studies in this area have tended to focus on second language literacy skills rather than on learning new content knowledge. Additionally, posttests were administered immediately after the treatments, while the delayed…

Tingir et al. (2017) concluded from their meta-analysis that the subject areas taught through mobile devices had significantly higher achievement scores (d = 0.48) than the ones taught with traditional teaching methods. Given the relatively high positive effect of mobile devices on student achievement, we carefully analysed the selected research…

Background study: Chinese tone pronunciation instruction gains increasingly attention and various instructional strategies have been studied to develop effective tones in students. Students usually listen to successful pronunciation stimuli provided by the teacher or peers, to be copied by themselves. However, individuals seem more sensitive to…

Most massive open online courses (MOOC) use simple schemes for aggregating peer grades, taking the mean or the median, or compute weights from information other than the instructor's opinion about the students' knowledge. To reduce the difference between the instructor and students' aggregated scores, some proposals compute specific weights to…

When students are working collaboratively and communicating verbally in a technology-enhanced environment, the system cannot track what collaboration is happening outside of the technology, making it difficult to fully assess the collaboration of the students and adapt accordingly. In this article, we propose using gaze measures as a proxy for…

Background: Digital-first assessments leverage the affordances of technology in all elements of the assessment process--from design and development to score reporting and evaluation to create test taker-centric assessments. Objectives: The goal of this paper is to describe the engineering, machine learning, and psychometric processes and…

Background: The unprecedented access to information in the 21st century entails a deep understanding of information and communication technology (ICT)-related factors in education and their impacts on learning and teaching. The role of attitudes towards ICT is a proven factor in student achievement. However, there is no consensus about the…

In computer-based testing (CBT) environments instructors can provide students with feedback immediately. Commonly, instructors give students their percentage correct without additional descriptive feedback. Our objectives were (a) to compare students' perceived usefulness of a percentage-only score report vs. a descriptive feedback report in a CBT…

Background: The most challenging task in eye-tracking-based multimedia research is to establish a relationship between eye-tracking metrics (or cognitive processes) and learners' performance scores. Additionally, there are current debates about the effectiveness of animations (or simulations) in promoting learning in multimedia settings.…

Emotional design for multimedia learning can be implemented primarily using aesthetic design elements (e.g., color, shape and layout); however, we still have limited understanding on emotional design using content features visually depicting motivational cues. This study examines how valence and arousal of emotional learning content, generated by…

Background: Mobile devices facilitate learning activities in a self-paced way. However, the current understanding of learning participation and its consequence are minimal when learners take advantage of opportunities provided by mobile technologies worldwide. Aims: The primary purpose of this study is to examine the effectiveness of environmental…

Background: Performance goal orientations are influential motivational factors for predicting learning performance. However, a lack of attention has been paid to investigating the effects of performance goal orientations on learning performance and in-game performance in the context of digital game-based learning. Objectives: This study…

This study compares the effects of object-oriented and robot programming activities on programming achievement, abstraction, problem solving, and motivation. In the study, two consecutive experimental cases were conducted to examine the consistency of findings. The research sample comprises 81 tenth-grade students undergoing vocational secondary…