Theories of discourse argue that comprehension depends on the coherence of the learner's mental representation. Our aim is to create a reliable automated representation to estimate readers' level of comprehension based on different productions, namely self-explanations and answers to open-ended questions. Previous work relied on Cohesion Network…

This study aims to evaluate the effectiveness and potential utility of using machine learning and natural language processing techniques to develop models that can reliably predict the relative difficulty of incoming chat reference questions. Using a relatively large sample size of chat transcripts (N = 15,690), an empirical experimental design…

Text summarization is an effective reading comprehension strategy. However, summary evaluation is complex and must account for various factors including the summary and the reference text. This study examines a corpus of approximately 3,000 summaries based on 87 reference texts, with each summary being manually scored on a 4-point Likert scale.…

Peer assessment has been widely applied across diverse academic fields over the last few decades, and has demonstrated its effectiveness. However, the advantages of peer assessment can only be achieved with high-quality peer reviews. Previous studies have found that high-quality review comments usually comprise several features (e.g., contain…

This study examines the extent to which instructions to self-explain vs. "other"-explain a text lead readers to produce different forms of explanations. Natural language processing was used to examine the content and characteristics of the explanations produced as a function of instruction condition. Undergraduate students (n = 146)…

This study investigates the perceptions of English language teachers regarding the use of ChatGPT in English Language Teaching (ELT). The study aims to fill the research gap by exploring teachers' perspectives on the integration of ChatGPT as an instructional tool and its implications for ELT practices. Using a mixed methods approach, the study…

We propose a novel model, Wide & Deep Item Response Theory (Wide & Deep IRT), to predict the correctness of students' responses to questions using historical clickstream data. This model combines the strengths of conventional Item Response Theory (IRT) models and Wide & Deep Learning for Recommender Systems. By leveraging clickstream…

With the exponential increase of digital assessment, different types of data in addition to item responses become available in the measurement process. One of the salient features in digital assessment is that process data can be easily collected. This non-conventional structured or unstructured data source may bring new perspectives to better…

Background/purpose: ChatGPT has become one of the groundbreaking examples of artificial intelligence-based chatbots with its capacity to produce texts and engage in human-like conversations. Therefore, it has garnered the attention of people with diverse backgrounds, including educational professionals. The current study aims to investigate how…

Background/Purpose: Integrating artificial intelligence tools within educational settings has generated considerable debate, yet empirical research that offers implications of its usage remains scarce. This study aims to qualitatively assess the perceptions and experiences of school principals and teachers regarding the use of ChatGPT in K-12…

Purpose: This qualitative work aims to explore the university students' attitude toward advantages, drawbacks and prospects of ChatGPT. Design/methodology/approach: This paper applies well accepted Colaizzi's phenomenological descriptive method of enquiry and content analysis method to reveal the ChatGPT user experience of students in the higher…

Massive online user review platforms, with their star ratings and text reviews, are reshaping the information available for consumer and public service decisions. We study the leading K-12 schooling platform, GreatSchools, applying machine learning (Natural Language Processing, NLP) to 600,000 reviews that encompass the vast majority of the…

In real-world settings, vision language models (VLMs) should robustly handle naturalistic, noisy visual content as well as domain-specific language and concepts. For example, K-12 educators using digital learning platforms may need to examine and provide feedback across many images of students' math work. To assess the potential of VLMs to support…

During the last few years, the popularity of chatbots has risen and grown exponentially with the increase in demand for smartphones and messaging applications. Chatbots can be utilized in education by providing information about educational content, communication, and assistance, enhancing classroom participation, and facilitating collaborative…

Recent developments in technology have accelerated the influence of artificial intelligence (AI) on our lives. The National Literacy Trust is interested in exploring how such platforms might influence, and potentially redefine, what it means to be literate in the digital age. Based on data from more than 50,000 children and young people taking…