Automated essay scoring (AES), where natural language processing is applied to score written text, can underpin educational resources in blended and distance learning. AES performance has typically been reported in terms of correlation coefficients or agreement statistics calculated between a system and an expert human examiner. We describe the…

Simulated testing has become more prevalent in higher education, especially as competency-based institutions begin to incorporate micro-credentials and skills certificates into their curriculum. Competency-based assessment falls outside traditional norm-based testing practices used in K-12 education, and is largely focused on criterion referenced…

Video is used widely in language education as a learning tool and a production tool for students to demonstrate oral competence. In response to the COVID-19 pandemic, Irish language lecturers at Dublin City University (DCU) set asynchronous video assessment tasks for students on teacher education programmes. Tasks were completed using the…

Research on automated affect detection in educational software using play log data has shown promising results. Yet most studies use classroom-based software designed for adolescents or adults. In this paper, we aim to detect affection in an online educational platform primarily aimed at home use by young children. This presents two challenges: we…

The "Framework" and NGSS bring to the forefront the role of language in doing science and in learning from doing science. Yet, most existing science assessments for elementary learners do not integrate or attend to aspects of scientific language and literacy that are essential components of science proficiency. Accordingly, there is a…

In 1984 Benjamin Bloom stated that one-to-one tutorial support increased students' achievement by two standard deviations (two sigma problem). In the literature for solving two sigma problem (in order to increase student achievement), many systems were developed as intelligent tutoring systems, adaptive hypermedia systems, recommender systems and…

We compared students' performance on a paper-based test (PBT) and three computer-based tests (CBTs). The three computer-based tests used different test navigation and answer selection features, allowing us to examine how these features affect student performance. The study sample consisted of 9,698 fourth through twelfth grade students from across…

The global pandemic and subsequent quarantine measures and restrictions have posed a challenge to the structure and procedure of university summative assessment process. Qualification assessment for Foreign Languages major programs in particular is a strict regimen process that involves different stages (oral and written exams, final project viva,…

Comparability studies between CBT and PPT studied if there were score differences between these two versions. However, there were no consistent results across studies and time. The purpose of this study is to summarize the testing mode effects for K-12 mathematics tests by conducting a meta-analysis. 103 effect sizes of 32 studies were collected…

This paper examines the impact of the informational value of feedback choices on students' performance, their choice to revise, and the time they spend designing posters and reading feedback in an assessment game. Choices to seek confirmatory or critical feedback and to revise posters in a poster design task were collected from a hundred and six…

In this paper we present a mobile application for self-assessment. The work describes the main features of the application and focuses on its acceptance by students and the increase on their learning, through its usage in real testing settings. The application supports the retrieval of questions based on a number of criteria and it was evaluated…

In laboratory courses, the assessment of exercises and assignments typically is treated as a simple, quantifiable approach. This approach however rarely includes qualitative factors, especially if the grading is being automatically performed by the system, and provides little to no feedback for the students to reflect on their work. The role of…

Prerequisite skill structures have been closely studied in past years leading to many data-intensive methods aimed at refining such structures. While many of these proposed methods have yielded success, defining and refining hierarchies of skill relationships are often difficult tasks. The relationship between skills in a graph could either be…

In the context of education and training, competency measurement (CM) is a central challenge in competency management. For complex CMs, a compromise must be addressed between the time available and the number of dimensions to be measured or the quality of the measurements. Increasing the efficiency of existing tests for CMs therefore poses a key…

On-line quizzes are used to help first year University Mathematics students identify weaknesses in their basic skills and improve them. Quizzes developed as a formative tool have been utilised at JCU [James Cook University] for eight years. However, before this research no-one has questioned the effectiveness of quizzes for this task. We present a…