In the rapidly evolving field of artificial intelligence (AI) literature generation, understanding how society perceives AI-generated content, compared with human-produced literature is of paramount importance. This study investigated societal perceptions and biases toward AI-generated versus human-produced poetry. A sample of 123 participants was…

Generalizability theory is a modern and powerful framework for conducting reliability analyses. It is flexible to accommodate both random and fixed facets. However, there has been a relative scarcity in the practical literature on how to handle the fixed facet case. This article aims to provide practitioners a conceptual understanding and…

Identifying high-quality educators at the point of hire can reduce future recruitment costs and minimize the impact of attrition on school organizations and student learning. One low-cost way to screen applicants and learn about their beliefs, values, and pedagogy is through their short-essay writing samples. However, there is limited research…

As ChatGPT continues to reshape student engagement and instructional design, it is crucial to examine its practical implications. This study aims to evaluate the effectiveness of ChatGPT3.5 and ChatGPT4 as potential automated essay scoring (AES) systems. Fifty authentic, student-written annotated bibliographies were evaluated by three human raters…

We use a continuous improvement model to evaluate an information design assignment by analyzing 120 student drafts and finals alongside instructor feedback. Using data from across sections (N = 118), we illustrate a process focused on improving student learning that other technical and professional communication program administrators and faculty…

The new era of generative artificial intelligence has sparked the blossoming academic fireworks in the realm of education and information technologies. Driven by natural language processing (NLP), automated writing evaluation (AWE) tools become a ubiquitous practice in intelligent computer-assisted language learning (CALL) environments. Based on…

Background: Learning to write the complex academic language (AL) associated with a discipline (like science) is a critical task in education, with middle school being a key developmental period. However, we need more research to guide how we assess students' learning to write AL, especially if we want to create assessment that guides more…

This study examines the potential to use non-expert, crowd-sourced raters to score essays by comparing expert raters' and crowd-sourced raters' assessments of writing quality. Expert raters and crowd-sourced raters scored 400 essays using a standardised holistic rubric and comparative judgement (pairwise ratings) scoring techniques, respectively.…

This study examines the potential to use non-expert, crowd-sourced raters to score essays by comparing expert raters' and crowd-sourced raters' assessments of writing quality. Expert raters and crowd-sourced raters scored 400 essays using a standardised holistic rubric and comparative judgement (pairwise ratings) scoring techniques, respectively.…

Many previous studies have compared automated analyses to writing experts' assessments, and less is known about the relationship between such features and content instructors' assessments of writing. The data analysed in this study is part of a larger study investigating growth in academic writing skills during undergraduate study. In this…

The evaluation of student essay corrections has become a focal point in understanding the evolving role of Artificial Intelligence (AI) in education. This study aims to assess the accuracy, efficiency, and cost-effectiveness of ChatGPT's essay correction compared to human correction, with a primary focus on identifying and rectifying grammatical…

In this article, I think with trains to reflect about education, its rhythms, trajectories, and the possibilities that "attentive looking through windows" can afford us in moving toward just futures. Using two of Alfonsina Storni's poems, the yellow train of "Cien años de soledad" as well as educational philosophy, I argue that…

Generative artificial intelligence technologies, such as ChatGPT, bring an unprecedented change in education by leveraging the power of natural language processing and machine learning. Employing ChatGPT to assist with marking written assessment presents multiple advantages including scalability, improved consistency, eliminating biases associated…

Educators are faced with many decisions regarding supporting students' writing. While writing achievement and curriculum-based measure scores provide numbers that are important for high-stakes decisions like determining special education eligibility, they do not provide educators with information on a student's explicit instruction needs. Written…

Research has revealed that critical thinking (CT) can predict undergraduate academic performance well. It is essential for nurturing students' unique voice and creativity, especially in the era of Large Language Models (LLMs). LLMs can generate linguistically complex texts, potentially overshadowing students' authorial voices--particularly those…