NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1413641
Record Type: Journal
Publication Date: 2023
Pages: 8
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1526-2367
EISSN: EISSN-1557-5284
Available Date: N/A
Automatic Text Analysis of Reflective Essays to Quantify the Impact of the Modification of a Mechanical Engineering Course
Aneet Dharmavaram Narendranath; Jeffrey S. Allen
Journal of STEM Education: Innovations and Research, v24 n3 p6-13 2023
Investigations on the utility of reflective essays in engineering education are firmly grounded in the theory of metacognition. Besides being a tool to measure metacognition, insight acquired from assessing reflective essays can provide context for future instruction and assessment. Some challenges that hinder the critical assessment of reflective essays is the assessment of the large volume of text generated, and the difficulty in quantitatively assessing threshold concepts that are embedded in reflective essays and are communicated via free-form writing, whose presence and recurrence is indicative of an identity transformation during an education experience of learners. This paper demonstrates an automated, quantitative assessment process composed of Text Mining (TM), Natural Language Processing (NLP), and Recurrence Quantification Analysis (RQA) to assess the presence of a specific thematic element in reflective essays for the purpose of confirming the impact of the modification of the assessment structure in producing a change in students' focus. The thematic element of interest an attitude of teamwork or "working in teams" in an immersive course in team-driven, model-based engineering design. The novel innovation of this approach is that the input (text from hundreds of reflective essays, sourced one at a time) when passed through this process quickly produces an output that quantifies the presence of thematic elements and their recurrence thereby quantitatively signaling a change in student focus towards a desired outcome.
Institute for STEM Education and Research. P.O. Box 4001, Auburn, AL 36831. Tel: 334-844-3360; Web site: https://www.jstem.org
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A