ERIC Number: EJ1478173
Record Type: Journal
Publication Date: 2025-Aug
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0266-4909
EISSN: EISSN-1365-2729
Available Date: 2025-06-09
From Reflection to Action: A Controlled Field Study on How Learners Interpret and Respond to Feedback in Learning Analytics Dashboards
Tornike Giorgashvili1,2; Ioana Jivet3; Cordula Artelt4; Daniel Biedermann5; Daniel Bengs5; Frank Goldhammer5,6; Carolin Hahnel5,7; Julia Mendzheritskaya1; Julia Mordel1; Monica Onofrei4; Marc Winter1; Ilka Wolter4; Holger Horz1; Hendrik Drachsler1,2,5
Journal of Computer Assisted Learning, v41 n4 e70073 2025
Background: Learning analytics dashboards (LAD) have been developed as feedback tools to help students self-regulate their learning (SRL) by using the large amounts of data generated by online learning platforms. Despite extensive research on LAD design, there remains a gap in understanding how learners make sense of information visualised on LADs and how they self-reflect using these tools. Objectives: We address this gap through an experimental study where a LAD delivered personalised SRL feedback based on interactions and progress to a treatment group, and minimal feedback based on the average scores of the lecture to a control group. Methods: After receiving feedback, students were asked to write down how they planned to adjust their study habits. These reflection texts are the target of this study. Three human coders analysed 1251 self-reflection texts from 417 students at three different times, using a coding system that categorised learning strategies, metacognitive strategies and learning materials. Results and Conclusions: Our results show that learners who received personalised feedback intend to focus on different aspects of their learning in comparison to the learners who received minimal feedback and that the content of the LAD influences how students formulate their self-reflection texts. Furthermore, the extent to which students incorporated suggested behavioural changes into their reflections was predicted by state measures like perceived helpfulness of the feedback. Our findings outline areas where support is needed to improve learners' sense-making of feedback on LADs and self-reflection.
Descriptors: Field Studies, Student Reaction, Feedback (Response), Learning Analytics, Educational Technology, Scores, Study Habits, Learning Strategies, Metacognition, Behavior Change
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1studiumdigitale and Fachbereich Informatik, Pädagogische Psychologie, Goethe-Universität Frankfurt am Main, Frankfurt, Germany; 2Open University of the Netherlands, Heerlen, the Netherlands; 3CATALPA, FernUniversität in Hagen, Hagen, Germany; 4LIfBi - Leibniz-Institut für Bildungsverläufe, Bamberg, Germany; 5DIPF - Leibniz-Institut für Bildungsforschung Und Bildungsinformation, Frankfurt, Germany; 6Zentrum für Internationale Bildungsvergleichsstudien (ZIB), Munich, Germany; 7Ruhr-Universität Bochum, Bochum, Germany