This scope-review presents the milestones of how Hierarchical Rater Models (HRMs) become operable to used in automated essay scoring (AES) to improve instructional evaluation. Although essay evaluations--a useful instrument for evaluating higher-order cognitive abilities--have always depended on human raters, concerns regarding rater bias,…

The recent development of Large Language Models (LLMs) such as Claude, Gemini, and GPT has led to widespread attention on potential applications of these models. Marking exams is a domain which requires the ability to interpret and evaluate student responses (often consisting of written text), and the potential for artificial intelligence (AI)…

Multiple-choice questions have become ubiquitous in educational measurement because the format allows for efficient and accurate scoring. Nonetheless, there remains continued interest in constructed-response formats. This interest has driven efforts to develop computer-based scoring procedures that can accurately and efficiently score these items.…

We present the Teacher Talk Tool, which automatically analyzes classroom audio and provides formative feedback on key aspects of teachers' classroom discourse (e.g., use of open-ended questions). The tool was designed to promote teacher learning by focusing attention and sense-making on their discourse. We conducted a feedback-response study where…

Digital platforms have become central to interaction and participation in contemporary societies. New forms of 'platformized education' are rapidly proliferating across education systems, bringing logics of datafication, automation, surveillance, and interoperability into digitally mediated pedagogies. This article presents a conceptual framework…

Knowledge Management Systems (KMS) have been used to provide automated assistance to customers in different organizations from diverse sectors. In the context of higher educational institutions (HEIs) especially in universities, research indicates that KMS assist universities with quicker response time to key issues, share vital knowledge, improve…

Intelligent systems of essay grading constitute important tools for educational technologies. They can significantly replace the manual scoring efforts and provide instructional feedback as well. These systems typically include two main parts: a feature extractor and an automatic grading model. The latter is generally based on computational and…

Large language models (LLMs) are increasingly being utilized to develop tools and services in various domains, including education. However, due to the nature of the training data, these models are susceptible to inherent social or cognitive biases, which can influence their outputs. Furthermore, their handling of critical topics, such as privacy…

Automatic short-answer grading has been studied for more than a decade. The technique has been used for implementing auto assessment as well as building the assessor module for intelligent tutoring systems. Many early works automatically grade mainly based on the similarity between a student answer and the reference answer to the question. This…

Revision plays an important role in writing, and as revisions break down the linearity of the writing process, they are crucial in describing writing process dynamics. Keystroke logging and analysis have been used to identify revisions made during writing. Previous approaches include the manual annotation of revisions, building nonlinear…

Scientific modeling is a vital educational practice that helps students apply scientific knowledge to real-world phenomena. Despite advances in AI, challenges in accurately assessing such models persist, primarily due to the complexity of cognitive constructs and data imbalances in educational settings. This study addresses these challenges by…

This article argues that sociotechnical imaginaries, defined as collectively held, institutionally stabilized, and publicly performed visions of desirable sociotechnical futures, are significantly connected to visions, policies, and projects of educating citizens. These visions, policies, and projects -- or educational imaginaries -- constitute…

An interactive textbook for a material and energy balances course measured over 1,300 reading interactions and hundreds of auto-graded problems per student each term. Specifically, seven cohorts and 601 students completed over 700,000 reading interactions and 150,000 auto-graded problems. Median reading participation was over 93%. Median correct…

Automated writing evaluation (AWE) is an artificial intelligence (AI)-empowered educational technology designed to assist writing instruction and improve students' writing proficiency. The present study adopted a quasi-experimental design using the inverse probability of treatment weighting method to explore the long-term effects of an AWE system…

Significant advancements in artificial intelligence (AI) technologies have led to the development of Google Gemini, which can be used to provide automated writing assistance. Within higher education, this feature extends to research writing. However, skepticism is particularly evident as students, teachers, and researchers in universities explore…