ERIC Number: EJ1483971
Record Type: Journal
Publication Date: 2025
Pages: 23
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0196-9641
EISSN: EISSN-2381-5485
Available Date: 0000-00-00
Characterizing ChatGPT's Feedback for FYW: Analyzing Feedback Responses to Inquiry-Driven Essays
Kirkwood Adams; Maria G. Baker
Thresholds in Education, v48 n2 p159-181 2025
In response to (1) studies finding that essay feedback generated by ChatGPT might be useful for student writers and (2) studies observing ChatGPT's tendency to adhere to narrow genre definitions when producing writing, our study seeks to examine whether ChatGPT can provide useful feedback in a first-year writing learning environment that targets a more nuanced genre definition of the academic essay as a form of inquiry. Our study employed three sequentially constructed feedback request prompts to assess how ChatGPT would go about generating outputs when asked to respond to a set of 50 published student essays that successfully achieve the goals of Columbia University's FYW class. The use of exemplary essays as input data revealed a durability in ChatGPT's feedback priorities under the influence of more robust prompting strategies. We found that in two-part responses, ChatGPT provided a descriptive as well as a prescriptive portion of feedback, the former largely affirmative, the latter critical with a focus on revision suggestions that guide toward narrow genre markers. The descriptive feedback mode seemed more adaptable to our capacious definition of genre, and the model responded less critically to exemplary essays when in descriptive mode, suggesting that further study of descriptive feedback capacities might be helpful in developing ChatGPT's potential to give useful feedback to students in FYW courses. However, in two brief stress tests of our results, we found cause for amending our findings.
Descriptors: Freshman Composition, Artificial Intelligence, Man Machine Systems, Natural Language Processing, Feedback (Response), Writing Evaluation, Essays, Technology Uses in Education
Academy for Educational Studies. 2419 Berkeley Street, Springfield, MO 65804. Tel: 417-299-1560; e-mail: cqieeditors@gmail.com; Web site: http://academyforeducationalstudies.org
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: New York (New York)
Grant or Contract Numbers: N/A
Author Affiliations: N/A

Peer reviewed
