Autograding short textual answers has become much more feasible due to the rise of NLP and the increased availability of question-answer pairs brought about by a shift to online education. Autograding performance is still inferior to human grading. The statistical and black-box nature of state-of-the-art machine learning models makes them…

Autograding systems are being increasingly deployed to meet the challenges of teaching programming at scale. Studies show that formative feedback can greatly help novices learn programming. This work extends an autograder, enabling it to provide formative feedback on programming assignment submissions. Our methodology starts with the design of a…

Quality control (QC) in testing is paramount. QC procedures for tests can be divided into two types. The first type, one that has been well researched, is QC for tests administered to large population groups on few administration dates using a small set of test forms (e.g., large-scale assessment). The second type is QC for tests, usually…

Educational institutions worldwide conduct summative examinations to evaluate academic performance of students. Such summative examinations are normally subjective in nature in higher education institutions and needs manual evaluation. However, the manual evaluation of subjective answer-scripts often suffers from evaluation anomalies and the…

This study implemented a data-driven approach to identify Chinese high school students' common errors in a Java-based introductory programming course using the data in an automated assessment tool called the Mulberry. Students' error-related behaviors were also analyzed, and their relationships to success in introductory programming were…

This study investigated the relative effectiveness of two instructional interventions (implicit and explicit feedback) as a function of implicit sequence-learning ability. Second language (L2) attainment was measured by means of a self-paced reading task, which shows online sensitivity to language errors. Implicit sequence-learning ability was…

Theoretically grounded in Vygotsky's sociocultural theory of mind, Dynamic Assessment (DA) provides researchers with the opportunity to investigate different aspects of learners' developmental trajectory, including the ways they overcome their errors. As a qualitative inquiry into the nature of errors reflecting learners' development in academic…

We demonstrate how the re-marker and reporter facility of the DEWIS e-Assessment system facilitates the capture, analysis and reporting of student errors using two case studies: logarithms and indices for first-year computing students at the University of the West of England, and Sturm-Liouville problems for second-year mathematics students at…

In this paper we discuss the use of automated assessment in a variety of computer science courses that have been taught at Israel Academic College by the authors. The course assignments were assessed entirely automatically using Checkpoint, a web-based automated assessment framework. The assignments all used free-text questions (where the students…

Retrieval practice is a powerful way to promote long-term retention and meaningful learning. However, students do not frequently practice retrieval on their own, and when they do, they have difficulty evaluating the correctness of their responses and making effective study choices. To address these problems, we have developed a guided retrieval…

This report presents work on the development of a new corpus of non-native English writing. It will be useful for the task of native language identification, as well as grammatical error detection and correction, and automatic essay scoring. In this report, the corpus is described in detail.

"The EUROCALL Review" is EUROCALL's open access online scientific journal. Regular sections include: (1) Reports on EUROCALL Special Interest Groups: up-to-date information on SIG activities; (2) Projects: reports on on-going CALL or CALL-related R&D projects; (3) Recommended websites: reports and reviews of examples of good practice…