Background: Digital-first assessments leverage the affordances of technology in all elements of the assessment process--from design and development to score reporting and evaluation to create test taker-centric assessments. Objectives: The goal of this paper is to describe the engineering, machine learning, and psychometric processes and…

Background: Collaborative problem solving (CPS) is important for success in the 21st century, especially for teamwork and communication in technology-enhanced environments. Measurement of CPS skills has emerged as an essential aspect in educational assessment. Modern research in CPS relies on theory-driven measurements that are usually carried out…

A partially-automated method of assessment is proposed, in which automated question setting is used to generate individualized versions of a coursework assignment, which is completed by students and marked by hand. This is designed to be (a) comparable to a traditional written coursework assignment in validity, in that complex and open-ended tasks…

The role of internet technology in higher education and particularly in teaching English as a Foreign language is increasingly prominent because of the interest in the ways in which technology can be applied to support students. The automated evaluation scoring system is a typical demonstration of the application of network technology in the…

The dimensionality is one of the most investigated concepts in the psychological assessment, and there are many ways to determine the dimensionality of a measured construct. The Automated Item Selection Procedure (AISP) and the DETECT are non-parametric methods aiming to determine the factorial structure of a data set. In the current study,…

This paper presents an investigation of using a co-attention based neural network for source-dependent essay scoring. We use a co-attention mechanism to help the model learn the importance of each part of the essay more accurately. Also, this paper shows that the co-attention based neural network model provides reliable score prediction of…

Accelerating digitization, algorithmic computation, artificial intelligence, and machine learning, along with the increasing automation of work, communication, and everyday life, are central to critical studies of technology and political economy, as well as to public discourse concerning technology's role in creating futures. Ongoing…

In this paper, we put in dialogue the local dimension of a nation-state with the global challenges faced by universities worldwide. We focus on the case of Denmark, a nation that was exceptionally active in implementing international university reforms and where digitalisation is a high priority of the public sector governance. The article seeks…

What are the origins of object permanence? Despite widespread interest in this question, methodological barriers have prevented detailed analysis of how experience shapes the development of object permanence in newborn organisms. Here, we introduce an automated controlled-rearing method for studying the emergence of object permanence in strictly…

Students' questions categorization is a challenging task as the available corpora are often limited in size (particularly with languages other than English) and require a costly preliminary manual annotation to train the classifiers. Ensemble learning can help improve machine learning results by combining several models, and is particularly…

Summarization is an effective strategy to promote and enhance learning and deep comprehension of texts. However, summarization is seldom implemented by teachers in classrooms because the manual evaluation of students' summaries requires time and effort. This problem has led to the development of automated models of summarization quality. However,…

Ethical considerations, including transparency, play an important role when using artificial intelligence (AI) in education. Explainable AI has been coined as a solution to provide more insight into the inner workings of AI algorithms. However, carefully designed user studies on how to design explanations for AI in education are still limited. The…

The Internet of Things (IoT) is a network of objects that can exchange data with other devices also connected to the Internet. One of the most common consumer examples of IoT is home automation, as a variety of smart devices, including doorbells, lightbulbs, thermostats, and refrigerators are now available which users can control remotely using…

The development of artificial intelligence (AI) technology has enhanced the use of automated speech evaluation systems for language learners to practice speaking skills. This study investigated whether various automatic feedback offered by AI speech evaluation programs can help English as a foreign language (EFL) learners develop speaking skills.…

Student Evaluation of Teaching surveys (SETs) are used at universities to inform teaching practice and subject design. However, there is increasing concern about the impact of allegations, abuse, and discrimination in survey open text components. Here we discuss the implementation of an automated screening mechanism using a combination of…