ERIC Number: ED629433
Record Type: Non-Journal
Publication Date: 2023-May-16
Pages: 16
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
A Comparison of Machine Learning Algorithms for Predicting Student Performance in an Online Mathematics Game
Grantee Submission
This paper demonstrated how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. Using a data-driven approach, we examined: (1) how different ML algorithms influenced the precision of middle-school students' (N = 359) performance (i.e. posttest math knowledge scores) prediction; and (2) what types of in-game features (i.e. student in-game behaviors, math anxiety, mathematical strategies) were associated with student math knowledge scores. The results indicated that the Random Forest algorithm showed the best performance (i.e. the accuracy of models, error measures) in predicting posttest math knowledge scores among the seven algorithms employed. Out of 37 features included in the model, the validity of the students' first mathematical transformation was the most predictive of their posttest math knowledge scores. Implications for game learning analytics and supporting students' algebraic learning are discussed based on the findings. [This is the online first version of an article published in "Interactive Learning Environments."]
Descriptors: Teaching Methods, Algorithms, Mathematics Tests, Computer Games, Learning Analytics, Interaction Process Analysis, Middle School Students, Anxiety, Mathematics Instruction, Models, Validity, Algebra, Learning Processes, Computer Assisted Instruction, Comparative Analysis, Mathematical Concepts, Concept Formation, Sampling, Correlation, Scores, Prediction
Publication Type: Reports - Research
Education Level: Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); National Science Foundation (NSF)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A180401; 2142984
Author Affiliations: N/A