The remarkable strides in artificial intelligence (AI), exemplified by ChatGPT, have unveiled a wealth of opportunities and challenges in assessment. Applying cutting-edge large language models (LLMs) and generative AI to assessment holds great promise in boosting efficiency, mitigating bias, and facilitating customized evaluations. Conversely,…

The procedures of carrying out factorial invariance to validate a construct were well developed to ensure the reliability of the construct that can be used across groups for comparison and analysis, yet mainly restricted to the frequentist approach. This motivates an update to incorporate the growing Bayesian approach for carrying out the Bayesian…

As generative artificial intelligence tools like ChatGPT become increasingly integrated into educational environments, understanding their impact on critical thinking is crucial. Despite growing concerns about AI's potential to diminish students' independent reasoning, there is a lack of research tools specifically designed to evaluate students'…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Individuals are controlled by tests in every advanced society when they want to be admitted in educational courses, to proceed from one stage to the next, or to be given a certificate (Shohamy, 2001b). Accordingly, the present study was carried out to construct and validate educational, social, and psychological consequences questionnaires of…

This study aimed to develop a valid and reliable scale to measure individuals' and organizations' attitudes toward the use of ChatGPT, emphasizing the necessity for organizations to adapt to rapidly evolving information and technology environments. The methodology consisted of three stages. In the first stage, a 13-item draft scale was…

The purpose of this paper is to investigate the descriptive and evaluative findings of articles conducted in educational contexts on entrepreneurship education in the Web of Science (WoS) database. For this purpose, the bibliometric analysis method was used in this study. This systematic literature review examined 352 scientific articles published…

As technology advances, AI, like ChatGPT, has become a pivotal tool in improving educational practices, particularly in special education (SE). These tools support the fourth Sustainable Development Goal (SDG), which concerns quality education for all, and the tenth SDG addresses reducing disparities. The purpose of this study is to explore the…

Multilevel modeling (MLM) is a statistical technique for analyzing clustered data. Despite its long history, the technique and accompanying computer programs are rapidly evolving. Given the complexity of multilevel models, it is crucial for researchers to provide complete and transparent descriptions of the data, statistical analyses, and results.…

Accurately grading open-ended assignments in large or massive open online courses is nontrivial. Peer review is a promising solution but can be unreliable due to few reviewers and an unevaluated review form. To date, no work has leveraged sentiment analysis in the peer-review process to inform or validate grades or utilized aspect extraction to…

Introduction: This study examined the concurrent validity and inter-pair reliability of the proximity detection function on Bluetooth-enabled accelerometers across manufacturer-specified ranges. If valid, this method could be used for objectively measuring shared physical activity participation. Method: Thirty-six dyads aged 21.6 (2.1) years wore…

The present research paper introduces a translation evaluation method called Calibrated Parsing Items Evaluation (CPIE hereafter). This evaluation method maximizes translators' performance through identifying the parsing items with an optimal p-docimology and d-index (item discrimination). This method checks all the possible parses (annotations)…

Objectives: In the USA, 18% of school-aged young people are classified as obese, and rural populations appear to be particularly at risk. Achieving high levels of fitness reduces the risk of obesity and underlying health conditions. To better understand youth obesity trends and fitness levels, annual fitness testing ([FT], that is, surveillance)…

This study reports on the development, validation, and reliability of a geometry disposition scale (GDS) to measure pre-service teachers' (PSTs') attitudes to geometry learning. PSTs from two Colleges of Education (CoEs) in Ghana volunteered to participate in the study (N = 153). A principal component analysis (PCA) extracted four factors: deep…

This study assessed the effectiveness of an online-merge-offline Jamboard application as an innovation in teaching word problems to Grade 4 learners was evaluated in this study. The research evaluates a learner's level of mathematical word problem skills in terms of understanding, devising a plan, solving a problem, and interpreting, as well as…