This study aims to evaluate the effectiveness and potential utility of using machine learning and natural language processing techniques to develop models that can reliably predict the relative difficulty of incoming chat reference questions. Using a relatively large sample size of chat transcripts (N = 15,690), an empirical experimental design…

Text summarization is an effective reading comprehension strategy. However, summary evaluation is complex and must account for various factors including the summary and the reference text. This study examines a corpus of approximately 3,000 summaries based on 87 reference texts, with each summary being manually scored on a 4-point Likert scale.…

Peer assessment has been widely applied across diverse academic fields over the last few decades, and has demonstrated its effectiveness. However, the advantages of peer assessment can only be achieved with high-quality peer reviews. Previous studies have found that high-quality review comments usually comprise several features (e.g., contain…

The advancement of artificial intelligence (AI) tools has revolutionized teaching and learning, particularly in healthcare education, where they enhance pedagogy, foster immersive learning, and support healthcare provision. However, their use in healthcare education is contentious, warranting careful examination, especially regarding Generative AI…

The application of natural language processing (NLP) technology in the field of education has attracted considerable attention. This study takes 716 articles from the Web of Science database from 1998 to 2023 as its research sample. Using bibliometrics as the theoretical foundation, and employing methods such as literature review and knowledge…

As AI technologies like GPT models continue to reshape various aspects of society, it is imperative to investigate the perceptions and ethical considerations of graduate students regarding GPT's use in academic settings. This mixed-method exploratory study engaged 21 graduate students through surveys and focus group interviews. The findings…

This study investigates the perceptions of English language teachers regarding the use of ChatGPT in English Language Teaching (ELT). The study aims to fill the research gap by exploring teachers' perspectives on the integration of ChatGPT as an instructional tool and its implications for ELT practices. Using a mixed methods approach, the study…

We propose a novel model, Wide & Deep Item Response Theory (Wide & Deep IRT), to predict the correctness of students' responses to questions using historical clickstream data. This model combines the strengths of conventional Item Response Theory (IRT) models and Wide & Deep Learning for Recommender Systems. By leveraging clickstream…

With the exponential increase of digital assessment, different types of data in addition to item responses become available in the measurement process. One of the salient features in digital assessment is that process data can be easily collected. This non-conventional structured or unstructured data source may bring new perspectives to better…

Background/purpose: ChatGPT has become one of the groundbreaking examples of artificial intelligence-based chatbots with its capacity to produce texts and engage in human-like conversations. Therefore, it has garnered the attention of people with diverse backgrounds, including educational professionals. The current study aims to investigate how…

Background/Purpose: Integrating artificial intelligence tools within educational settings has generated considerable debate, yet empirical research that offers implications of its usage remains scarce. This study aims to qualitatively assess the perceptions and experiences of school principals and teachers regarding the use of ChatGPT in K-12…

Purpose: This qualitative work aims to explore the university students' attitude toward advantages, drawbacks and prospects of ChatGPT. Design/methodology/approach: This paper applies well accepted Colaizzi's phenomenological descriptive method of enquiry and content analysis method to reveal the ChatGPT user experience of students in the higher…

Massive online user review platforms, with their star ratings and text reviews, are reshaping the information available for consumer and public service decisions. We study the leading K-12 schooling platform, GreatSchools, applying machine learning (Natural Language Processing, NLP) to 600,000 reviews that encompass the vast majority of the…

In real-world settings, vision language models (VLMs) should robustly handle naturalistic, noisy visual content as well as domain-specific language and concepts. For example, K-12 educators using digital learning platforms may need to examine and provide feedback across many images of students' math work. To assess the potential of VLMs to support…

During the last few years, the popularity of chatbots has risen and grown exponentially with the increase in demand for smartphones and messaging applications. Chatbots can be utilized in education by providing information about educational content, communication, and assistance, enhancing classroom participation, and facilitating collaborative…