ERIC Number: EJ1338345
Record Type: Journal
Publication Date: 2022-Jul
Pages: 32
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0007-1013
EISSN: N/A
Available Date: N/A
Incorporating AI and Learning Analytics to Build Trustworthy Peer Assessment Systems
Darvishi, Ali; Khosravi, Hassan; Sadiq, Shazia; Gaševic, Dragan
British Journal of Educational Technology, v53 n4 p844-875 Jul 2022
Peer assessment has been recognised as a sustainable and scalable assessment method that promotes higher-order learning and provides students with fast and detailed feedback on their work. Despite these benefits, some common concerns and criticisms are associated with the use of peer assessments (eg, scarcity of high-quality feedback from peer student-assessors and lack of accuracy in assigning a grade to the assessee) that raise questions about their trustworthiness. Consequently, many instructors and educational institutions have been anxious about incorporating peer assessment into their teaching. This paper aims to contribute to the growing literature on how AI and learning analytics may be incorporated to address some of the common concerns associated with peer assessment systems, which in turn can increase their trustworthiness and adoption. In particular, we present and evaluate our AI-assisted and analytical approaches that aim to (1) offer guidelines and assistance to student-assessors during individual reviews to provide better feedback, (2) integrate probabilistic and text analysis inference models to improve the accuracy of the assigned grades, (3) develop feedback on reviews strategies that enable peer assessors to review the work of each other, and (4) employ a spot-checking mechanism to assist instructors in optimally overseeing the peer assessment process.
Descriptors: Artificial Intelligence, Learning Analytics, Peer Evaluation, Student Evaluation, Feedback (Response), Accuracy, Evaluation Methods
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A