ERIC Number: EJ1452655
Record Type: Journal
Publication Date: 2024
Pages: 8
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1043-4046
EISSN: EISSN-1522-1229
Available Date: N/A
The Conversational AI "ChatGPT" Outperforms Medical Students on a Physiology University Examination
Christophe O. Soulage; Fabien Van Coppenolle; Fitsum Guebre-Egziabher
Advances in Physiology Education, v48 n4 p677-684 2024
Artificial intelligence (AI) has gained massive interest with the public release of the conversational AI "ChatGPT," but it also has become a matter of concern for academia as it can easily be misused. We performed a quantitative evaluation of the performance of ChatGPT on a medical physiology university examination. Forty-one answers were obtained with ChatGPT and compared to the results of 24 students. The results of ChatGPT were significantly better than those of the students; the median (IQR) score was 75% (66-84%) for the AI compared to 56% (43-65%) for students (P < 0.001). The exam success rate was 100% for ChatGPT, whereas 29% (n = 7) of students failed. ChatGPT could promote plagiarism and intellectual laziness among students and could represent a new and easy way to cheat, especially when evaluations are performed online. Considering that these powerful AI tools are now freely available, scholars should take great care to construct assessments that really evaluate student reflection skills and prevent AI-assisted cheating.
Descriptors: Medical Students, Medical Education, Artificial Intelligence, Computer Software, Plagiarism, Cheating, Test Construction, Computer Assisted Testing, Science Tests, Comparative Analysis, Academic Failure, Prevention, Foreign Countries
American Physiological Society. 9650 Rockville Pike, Bethesda, MD 20814-3991. Tel: 301-634-7164; Fax: 301-634-7241; e-mail: webmaster@the-aps.org; Web site: https://www.physiology.org/journal/advances
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: France
Grant or Contract Numbers: N/A
Author Affiliations: N/A