ERIC Number: EJ1478517
Record Type: Journal
Publication Date: 2025
Pages: 37
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1303-6521
EISSN: EISSN-2146-7242
Available Date: 0000-00-00
How Successful Are Artificial Intelligence Chatbots on Higher Education Entrance Physics Exams in Turkey
Turkish Online Journal of Educational Technology - TOJET, v24 n2 p120-156 2025
In this study, the performance of artificial intelligence chatbots--OpenAI's ChatGPT, Google Gemini, and Microsoft's Copilot--was evaluated and compared based on their responses to questions from the Turkish Higher Education Entrance Physics Examination over the past three years. Analysis of the chatbots' responses to TYT Physics questions showed that ChatGPT correctly answered 38.09% of the questions, while both Gemini and Copilot achieved a correct answer rate of 28.57%. For AYT Physics questions, ChatGPT demonstrated a higher success rate, correctly answering 45.23% of the questions, compared to 26.18% for Gemini and 14.28% for Copilot. While ChatGPT exhibited the best performance overall, Copilot performed the worst. Nonetheless, the overall performance of all three chatbots was insufficient for providing consistently accurate answers to both TYT and AYT questions.
Descriptors: Artificial Intelligence, College Entrance Examinations, Physics, Science Tests, Foreign Countries, Test Items
Sakarya University. Esentepe Campus, Adapazari 54000, Turkey. Tel: +90-505-2431868; Fax: +90-264-6141034; e-mail: tojet@sakarya.edu.tr; Web site: https://tojet.net/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Turkey
Grant or Contract Numbers: N/A
Author Affiliations: N/A