ERIC Number: EJ1276168
Record Type: Journal
Publication Date: 2020-Nov
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1360-2357
EISSN: N/A
Available Date: N/A
Using Image Recognition to Automatically Assess Programming Tasks with Graphical Output
Muuli, Eerik; Tõnisson, Eno; Lepp, Marina; Luik, Piret; Palts, Tauno; Suviste, Reelika; Papli, Kaspar; Säde, Merilin
Education and Information Technologies, v25 n6 p5185-5203 Nov 2020
There are thousands of participants in different programming MOOCs (Massive Open Online Courses) which means thousands of solutions have to be assessed. As it is very time-consuming to assess that amount of solutions manually, using automated assessment is essential. Since task requirements must be strict for the solutions to be automatically gradable, it often limits the types of different assignments and creativity. In order to promote more creativity we wanted to enable programming tasks with graphical output. In order to analyze and assess the creative tasks we developed, implemented and analyzed a system capable of assessing the graphical output of a solution program using image recognition. Image recognition is used to analyze the graphical output (image) produced by the solution program. The graphical output with a keyword attached to it is sent to an image recognition service provider that responds with a probability score. The solution is accepted or rejected based on the probability of a given object appearing in the image. The system was tested and evaluated in two runs of the MOOC "Introduction to Programming." In the first run, we used the system to automatically assess the solutions of programming tasks on a predefined topic and in the second run on a topic chosen by the participant. The evaluation of the usefulness of the system and overview of participants' feedback are presented as results. Suggestions for future improvements of the system and possible research are also listed.
Descriptors: Online Courses, Programming, Computer Assisted Testing, Visual Stimuli, Recognition (Psychology), Automation
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A