ERIC Number: EJ1373788
Record Type: Journal
Publication Date: 2023-Apr
Pages: 31
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0741-0883
EISSN: EISSN-1552-8472
Available Date: N/A
Prompting Reflection: Using Corpus Linguistic Methods in the Local Assessment of Reflective Writing
Messina, Cara Marta; Jones, Cherice Escobar; Poe, Mya
Written Communication, v40 n2 p620-650 Apr 2023
We report on a college-level study of student reflection and instructor prompts using scoring and corpus analysis methods. We collected 340 student reflections and 24 faculty prompts. Reflections were scored using trait and holistic scoring and then reflections and faculty prompts were analyzed using Natural Language Processing to identify linguistic features of high, middle, and low scoring reflections. The data sets were then connected to determine if there was a relationship between faculty prompts and scores. Additional analysis was completed to determine if there was a relationship between scores and students' GPAs. The corpus linguistics analysis showed that higher-scoring reflections used words that referred to the self, the writing process, and specific rhetorical terms. Additional analysis showed student GPAs did not correlate with holistic scores but that higher scoring reflections were from faculty who included learning goals on reflective writing prompts. Results suggest that teachers can de-mystify reflective writing by linking learning outcomes to textual tasks and that corpus linguistics methods can provide an understanding of how local learning goals are transmitted to students.
Descriptors: Reflection, Writing Instruction, Computational Linguistics, Cues, Scoring, Undergraduate Students, College Faculty, Natural Language Processing, Writing Evaluation, Grade Point Average, Writing Processes, Correlation, Holistic Approach, Outcomes of Education, Teaching Methods
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Massachusetts (Boston)
Grant or Contract Numbers: N/A
Author Affiliations: N/A