ERIC Number: EJ1449991
Record Type: Journal
Publication Date: 2024
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1470-3297
EISSN: EISSN-1470-3300
Available Date: N/A
To What Extent Does ChatGPT Understand Genetics?
Innovations in Education and Teaching International, v61 n6 p1320-1329 2024
OpenAI's ChatGPT, is a conversational chatbot that uses Generative Pre-trained Transformer or GPT language model to mimic human-like responses. Here we evaluated its performance in providing responses to genetics questions across five different tasks including solid genetic basics, identifying inheritance pattern based on described pedigrees, interpreting genetic mutation notations, solving genetic population problems, and taking a medical genetics Ph.D. entrance exam. Our results showed that ChatGPT was able to generate correct answers to approximately 70% of questions (n = 145). Its performance on descriptive and memorisation tasks showed more accuracy compared to analytical and critical thinking ones. Failure to capture human writing nuances in questions, and applying genetic basics to solve problems, alongside providing false information were the most notable drawbacks. However, overall results were promising suggesting that ChatGPT could be a well-prepared assistant for genetic educators and healthcare providers.
Descriptors: Artificial Intelligence, Technology Uses in Education, Natural Language Processing, Genetics, Performance, Scientific Concepts, College Entrance Examinations, Doctoral Degrees, Accuracy, Memorization, Critical Thinking
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A