This article discusses critical methodological design decisions for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems. The discussion is inspired by work on operational large-scale systems for automated essay scoring but many of the…

In this study, we examined the accuracy and dynamics of visually guided saccades in 20 adults with autism spectrum disorder, as compared to 20 typically developed adults using the Step/Overlap/Gap paradigms. Performances in participants with autistic spectrum disorder were characterized by preserved Gap/Overlap effect, but reduced gain and peak…

Studies on emotions in learning are often based on interviews conducted after the learning. These do not capture the multi-componential nature of emotions, nor how emotions are related to the processes of learning. We see emotions as dimensional, multi-componential responses to personally meaningful events and situations. In this methodologically…

Notable mean score differences for the "e-rater"® automated scoring engine and for humans for essays from certain demographic groups were observed for the "GRE"® General Test in use before the major revision of 2012, called rGRE. The use of e-rater as a check-score model with discrepancy thresholds prevented an adverse impact…

The purpose of this study was to examine the relationship between metacognition as measured in real-life situations and IQ scores as reflected by performance on the Raven Standard Progressive Matrices Scale. It is also intended in this study to report on whether or not there were significant differences in performance on the metacognitive…

The scope of this article is an investigation into students' attitudes toward blended learning and related concepts (e.g. paperless and traditional classroom). There were 162 students who participated in this study (100 females and 62 males, with the mean age of 18.80 and its standard deviation of 1.16). The study revealed that students prefer…

Considering instructional time is one of the most valuable and expensive resources in public education, there is nominal research examining the effectiveness of its use (Farbman, 2015). The purpose of this study was to determine the correlation between the amount of extended learning time provided to eligible students at least one grade level…

The assessment of writing proficiency generally includes analyses of the specific linguistic and rhetorical features contained in the singular essays produced by students. However, researchers have recently proposed that an individual's ability to flexibly adapt the linguistic properties of their writing might more closely capture writing skill.…

In the study herein aimed at incorporating the entrepreneurship mindset early on in the engineering curriculum of undergraduate students via a final project of an introductory programming course with MATLAB. Students were asked to find a need on campus, in the society, or in the market with a business potential and write a standalone application…

This article describes the development and validation of the new CATSS (Computer Adaptive Test of Size and Strength), which measures vocabulary knowledge in four modalities -- productive recall, receptive recall, productive recognition, and receptive recognition. In the first part of the paper we present the assumptions that underlie the test --…

First-year undergraduate classes present challenges in teaching as they usually have high student enrolment numbers and students studying across a range of higher education programs that require a fundamental understanding of knowledge that is not perceived in their area of study. This provides a challenge in terms of engaging and maintaining…

Multimedia in assessing clinical decision-making skills (CDMS) has been poorly studied, particularly in comparison to traditional text-based assessments. The literature suggests multimedia is more difficult for trainees. We hypothesize that pediatric residents score lower in diagnostic skill when clinical vignettes use multimedia rather than text…

Computer-supported assessment tools can bring significant benefits to both students and teachers. When integrated in traditional education workflows, they may help to reduce the time required to perform the evaluation and consolidate the perception of fairness of the overall process. When integrated within on-line intelligent tutoring systems,…

In this paper we report the results of an experiment designed to test the hypothesis that when faced with a question involving the inverse direction of a reversible mathematical process, students solve a multiple-choice version by verifying the answers presented to them by the direct method, not by undertaking the actual inverse calculation.…

This study examined whether web-based phonological awareness (PA) assessment in early childhood, specifically the year preceding formal schooling, could help educators reliably predict children's risk for reading difficulties in the first year of school. Ninety Australian children participated in several web-based PA tasks with a high priority…