NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1475477
Record Type: Journal
Publication Date: 2025-Jun
Pages: 24
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0141-1926
EISSN: EISSN-1469-3518
Available Date: 2025-01-02
Can AI Replace Humans? Comparing the Capabilities of AI Tools and Human Performance in a Business Management Education Scenario
British Educational Research Journal, v51 n3 p1073-1096 2025
This study provides a comparative assessment of the capabilities of leading artificial intelligence (AI) tools and human participants in a business management education context. Specifically, we (a) assess how well current language models perform in providing answers to standardised essay-type assessments in a business and management education context, (b) examine the efficacy of emergent tools in detecting AI-generated texts and (c) evaluate online AI rewriting and paraphrasing tools and their efficacy in evading detection. Using an exploratory qualitative design, this study generated and evaluated 15 standard essays using ChatGPT (n = 5), Bard (n = 5) and human (n = 5). A comparison is provided between the average performance of AI-derived essays and that of ChatGPT-generated essays across all five essays. The results suggest that AI-generated content can achieve reasonably high marks in management and business assessments. According to the findings of the study, AI's performance is highly influenced by the types of prompts used, the user's experience and the degree to which the user can discern between relevant and irrelevant content. According to the findings, Turnitin's AI detection tool is highly effective at detecting content that has been created by AI, but the effectiveness is reduced by rewriters. The Turnitin AI detection tool, however, is significantly more effective at identifying content generated by Bard compared with content generated by ChatGPT. According to the results, ChatGPT produced better results when the user provided a clear context, outlined the topic and expectations, divided the assessment tasks into sections and fed the prompts in a conversational manner to train the model. By utilising AI chatbots effectively, traditional teaching and assessment methods can be supplemented with targeted and engaging learning experiences.
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1School of Business, Education and Law, The University of Huddersfield, Huddersfield, UK; 2Department of Strategy, Enterprise and Sustainability, Faculty of Business and Law, Manchester Metropolitan University, Manchester, UK; 3Department of Business Administration, Inland School of Business and Social Sciences, Innlandet, Norway