Automatic item generation may supply many items instantly and efficiently to assessment and learning environments. Yet, the evaluation of item quality persists to be a bottleneck for deploying generated items in learning and assessment settings. In this study, we investigated the utility of using large-language models, specifically Llama 3-8B, for…

Background Study: Assessing learners' inquiry-based skills is challenging as social, political, and technological dimensions must be considered. The advanced development of artificial intelligence (AI) makes it possible to address these challenges and shape the next generation of science education. Objectives: The present study evaluated the SSI…

Team-based learning (TBL) is an active learning instructional strategy shown to improve student learning in large-enrollment courses. Although early implementations of TBL proved generally effective in an undergraduate exercise physiology course that delivered an online individual readiness assurance test (iRAT) before class, the instructor…

Assignments and tests are the main forms of evaluation in the educational process, students usually lose interest in boring exercises during course learning. In spired of elements from human-computer battle game, a course test system is designed to encourage students to take tests more frequently and actively to achieve better learning effect,…

This report describes the process of developing and validating the enhanced ACT. The report describes the changes made to the test content and the processes by which these design decisions were implemented. The authors describe how they shared the overall scope of the enhancements, including the initial blueprints, with external expert panels,…

The COVID-19 pandemic significantly impacted medical education, causing a shift towards online learning. However, this transition posed challenges in administering online assessments, particularly in proctoring and detecting academic misconduct. This study aimed to investigate the prevalence of academic misconduct among medical students during…

Conversational agents have been designed to improve instruction quality and support student learning. In addition to their instructional use, they can be incorporated into assessment--conversation-based assessment (CBA). This study primarily introduces a CBA with selected-response and constructed-response tests as a formative assessment tool for…

This study examines the growing issue of academic dishonesty in online assessments, a challenge intensified by the expansion of digital learning platforms. Specifically, it investigates the relationship between students' online engagement and their performance in online versus traditional paper-and-pencil tests. Employing a cross-sectional…

The Trends in International Mathematics and Science Study (TIMSS) was administered via computer, eTIMSS, for the first time in 2019. The purpose of this study was to investigate item block position and item format effect on eighth grade mathematics item easiness in low- and high-achieving countries of eTIMSS 2019. Item responses from Chile, Qatar,…

The highly adaptive testing (HAT) design is introduced as an alternative test design for the Programme for International Student Assessment (PISA). The principle of HAT is to be as adaptive as possible when selecting items while accounting for PISA's nonstatistical constraints and addressing issues concerning PISA such as item position effects.…

Multistage adaptive testing (MST) has been recently adopted for international large-scale assessments such as Programme for International Student Assessment (PISA). MST offers improved measurement efficiency over traditional nonadaptive tests and improved practical convenience over single-item-adaptive computerized adaptive testing (CAT). As a…

Digital administration of assessments allows for the collection of process data indices, such as response time, which can serve as indicators of rapid-guessing and examinee test-taking effort. Setting a time threshold is essential to distinguish effortful from effortless behavior using item response times. Threshold identification methods may…

Learning through the internet becomes popular that facilitates learners to learn anything, anytime, anywhere from the web resources. Assessment is most important in any learning system. An assessment system can find the self-learning gaps of learners and improve the progress of learning. The manual question generation takes much time and labor.…

Using item-response theory to model rater effects provides an alternative solution for rater monitoring and diagnosis, compared to using standard performance metrics. In order to fit such models, the ratings data must be sufficiently connected in order to estimate rater effects. Due to popular rating designs used in large-scale testing scenarios,…

This study aims to see the effect of student perceptions on web-based character assessment on the results of student character assessment. The population in this study was a junior high school in Batanghari Regency with a sample of 322 students using the purposive sampling technique. Quantitative methods are used in this study with descriptive and…