Automated essay scoring (AES) has emerged as a secondary or as a sole marker for many high-stakes educational assessments, in native and non-native testing, owing to remarkable advances in feature engineering using natural language processing, machine learning, and deep-neural algorithms. The purpose of this study is to compare the effectiveness…

Aim/Purpose: This article presents a comprehensive rubric for evaluating educational virtual reality experiences for mobile devices. The aim of this article is to systematically analyze research to address the quality of virtual reality experiences on mobile applications in order to extend the work of Lee and Cherner (2015) and their instructional…

Summary writing is essential for academic success, and has attracted renewed interest in academic research and large-scale language test. However, less attention has been paid to the development and evaluation of the scoring scales of summary writing. This study reports on the validation of a summary rubric that represented an approach to scale…

Aldol chemistry is highlighted in many introductory organic chemistry laboratory experiments because it provides synthesis, mechanism, and experimental challenges for students. In the experiment described here, students synthesize dibenzalacetone derivatives by crossed aldol condensation, observe reaction rates using a semiquantitative rubric, and…

This article reports on the validity of the admi (MMI) method as it was used by a post-degree teacher education program as part of their admissions process to select candidates for entry into the program. The MMI, primarily used for medical school admittance, involves several stations with different interviewers. Comparisons were made between the…

Performance assessments (PAs) offer a more authentic measure of higher order skills, which is ideal for competency-based education (CBE) especially for students already in the workplace and striving to advance their careers. The goal of the current study was to examine the validity of undergraduate PA score interpretation in the college of IT at a…

The study reported on here contributes to the growing body of knowledge on the use of standard setting methods for improving the reporting and utility value of assessment results in South Africa as well as for addressing the conceptual shortcomings of the Curriculum and Assessment Policy Statement (CAPS) reporting framework. Using data from the…

Contribution: A technical course in a multidisciplinary university program has to provide high-level skills, with limited lecturing hours and student background. This article investigates the principles for its design and reports about a study case. Background: The overall course organization needs to address specific learning targets and teaching…

Scoring constructed-response items can be highly difficult, time-consuming, and costly in practice. Improvements in computer technology have enabled automated scoring of constructed-response items. However, the application of automated scoring without an investigation of test equating can lead to serious problems. The goal of this study was to…

Acid-base chemistry is a key reaction motif taught in postsecondary organic chemistry courses. More specifically, concepts from the Lewis acid-base model are broadly applicable to understanding mechanistic ideas such as electron density, nucleophilicity, and electrophilicity; thus, the Lewis model is fundamental to explaining an array of reaction…

In the initial sociocultural theory (SCT) timeline, Lantolf and Beckett (2009) surveyed a broad spectrum of research informed by sociocultural psychology as it was extended into the field of second language acquisition and language teaching. Since that time, the amount of research that has been published within the SCT framework has grown…

Teacher evaluation systems that use in-class observations, particularly in high-stakes settings, are frequently understood as accountability systems intended as nonintrusive measures of teacher quality. Presumably, the evaluation system motivates teachers to improve their practice--an accountability mechanism--and provides actionable feedback for…

Artificial Intelligence is at the heart of modern society with computers now capable of making process decisions in many spheres of human activity. In education, there has been intensive growth in systems that make formal and informal learning an anytime, anywhere activity for billions of people through online open educational resources and…

Although dialogue can augment the impact of feedback on student learning, dialogic feedback is unaffordable by instructors teaching large classes. In this regard, peer feedback can offer a scalable and effective solution. However, the existing practices optimistically rely on students' discussion about feedback and lack a systematic design…

This study aims to explore to what extent syntactic complexity predicts holistic scores generated by China's two prominent automated writing evaluation systems--"pigai" and "iWrite," the results of which will have some implications for the validity of these two systems. In the meanwhile, this study targets how syntactic…